-- Logs begin at Sun 2022-08-28 18:49:34 UTC, end at Sun 2022-08-28 20:42:15 UTC. -- Aug 28 19:27:26.977526 n-d-854121-7 systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 19:27:26.993361 n-d-854121-7 devstack@keystone.service[82288]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 19:27:26 2022] *** Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: nodename: n-d-854121-7 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: machine: x86_64 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: clock source: unix Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: pcre jit disabled Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: detected number of CPU cores: 4 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: current working directory: / Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: detected binary path: /usr/bin/uwsgi-core Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: your processes number limit is 47680 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: your memory page size is 4096 bytes Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: detected max file descriptor number: 2048 Aug 28 19:27:26.996410 n-d-854121-7 devstack@keystone.service[82288]: lock engine: pthread robust mutexes Aug 28 19:27:26.998036 n-d-854121-7 devstack@keystone.service[82288]: thunder lock: enabled Aug 28 19:27:26.998036 n-d-854121-7 devstack@keystone.service[82288]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 19:27:26.998036 n-d-854121-7 devstack@keystone.service[82288]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 19:27:27.039077 n-d-854121-7 devstack@keystone.service[82288]: Python main interpreter initialized at 0x55920fe9e9c0 Aug 28 19:27:27.039077 n-d-854121-7 devstack@keystone.service[82288]: python threads support enabled Aug 28 19:27:27.039077 n-d-854121-7 devstack@keystone.service[82288]: your server socket listen backlog is limited to 100 connections Aug 28 19:27:27.039077 n-d-854121-7 devstack@keystone.service[82288]: your mercy for graceful operations on workers is 90 seconds Aug 28 19:27:27.039600 n-d-854121-7 devstack@keystone.service[82288]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 19:27:27.039600 n-d-854121-7 devstack@keystone.service[82288]: *** Operational MODE: preforking *** Aug 28 19:27:27.039848 n-d-854121-7 devstack@keystone.service[82288]: *** uWSGI is running in multiple interpreter mode *** Aug 28 19:27:27.039848 n-d-854121-7 devstack@keystone.service[82288]: spawned uWSGI master process (pid: 82288) Aug 28 19:27:27.040090 n-d-854121-7 systemd[1]: Started Devstack devstack@keystone.service. Aug 28 19:27:27.045884 n-d-854121-7 devstack@keystone.service[82288]: spawned uWSGI worker 1 (pid: 82298, cores: 1) Aug 28 19:27:27.045884 n-d-854121-7 devstack@keystone.service[82288]: spawned uWSGI worker 2 (pid: 82299, cores: 1) Aug 28 19:27:27.045884 n-d-854121-7 devstack@keystone.service[82288]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 19:27:31.915773 n-d-854121-7 devstack@keystone.service[82298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 19:27:31.915773 n-d-854121-7 devstack@keystone.service[82298]: from cryptography.utils import int_from_bytes Aug 28 19:27:31.916877 n-d-854121-7 devstack@keystone.service[82298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 19:27:31.916877 n-d-854121-7 devstack@keystone.service[82298]: from cryptography.utils import int_from_bytes Aug 28 19:27:31.917803 n-d-854121-7 devstack@keystone.service[82299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 19:27:31.917803 n-d-854121-7 devstack@keystone.service[82299]: from cryptography.utils import int_from_bytes Aug 28 19:27:31.918606 n-d-854121-7 devstack@keystone.service[82299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 19:27:31.918606 n-d-854121-7 devstack@keystone.service[82299]: from cryptography.utils import int_from_bytes Aug 28 19:27:31.980284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 19:27:31.980694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 19:27:31.980694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] command line args: [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 19:27:31.980971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 19:27:31.981119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ================================================================================ {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 19:27:31.981339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] admin_token = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.981592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] config_dir = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.981764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.982177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] config_source = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.982177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] debug = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.982416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.982745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.982919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.983042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 19:27:31.983162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.983283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 19:27:31.983393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] command line args: [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 19:27:31.983508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.983631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 19:27:31.983747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.983863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ================================================================================ {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 19:27:31.983984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_config_append = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.983984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.984180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] admin_token = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.984295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_dir = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.984397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] config_dir = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.984511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_file = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.984944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.985105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.985275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] config_source = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.985433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.985604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] debug = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.985796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.986858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.987046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.987181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.987377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.987520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.987714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.987847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_config_append = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.988042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.988174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.988174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_dir = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.988523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.988716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_file = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.988897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.989925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] publish_errors = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.995974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] standard_threads = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.996997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] use_journal = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] use_json = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.997671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] use_stderr = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.998176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.998319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] use_syslog = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.998445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] publish_errors = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.998577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.998700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.998874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:31.999017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.999131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:31.999254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.999381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:31.999515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.999635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:31.999863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:31.999985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.000105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] standard_threads = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.000235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.000444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.000626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.000813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.000959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.001586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.001586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] use_journal = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.001960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.002097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] use_json = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.002238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.002369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] use_stderr = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.002369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] use_syslog = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.002602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.002725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 19:27:32.002850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.002988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.003855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.004100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.004225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.004349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.004476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.004609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.004912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.005977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.006883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.007231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.007360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.007500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.007625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.007772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.007898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.008894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.009839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.010010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.010300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.010680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.010861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.010988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.011370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.011497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.011633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.011756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.011877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.012939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.013814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.014758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.015948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.016071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.016197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.016197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.016443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.016582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.016747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.017474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.017474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.017696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.017821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.018915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.019950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.020959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.021394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.021515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.021641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.021928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.022817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.023889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.024791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.025012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.025178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.025307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.025474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.025474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.025774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.external = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.029806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.password = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] auth.token = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.030979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.031124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.031254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.031254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.031489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.031627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.031627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.032970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.033093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.033093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.033401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.033546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.033546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.033820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.034933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.035911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.036930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.037066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.037205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.037335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.037464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.037464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.037698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.038848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.039975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.040094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.040212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.040333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.external = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.046918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.password = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.047909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] auth.token = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.048894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.049908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.050038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.050166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.050291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.050291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.050559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.050559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.051792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.052909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.053807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.054917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.055819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.056948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.057927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.058054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.058174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.058293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.058414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.062747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.063045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.063188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.063320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.063454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.063454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.064857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.065406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.065406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.065642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.065742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.065924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.066948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.067852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.068871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.069787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] role.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.070922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] role.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.071404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.072930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.073231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.073341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.073457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.073689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.073819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.073966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.074969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.075980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.076956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.077731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.078931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.079183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.079907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.080890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.081950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.082189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.082315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.082315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.082541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.082848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.082848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.083868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.connection = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.084968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.085827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.086876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.087910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.088124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] role.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] role.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.089030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.090959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.091262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.091771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.092076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.092402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.092727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.093053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.093387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.093699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.094062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.094383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.094691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.095168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.095419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.095596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.095957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.096283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.096601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.096906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.097211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.097512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.097816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.098144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.098481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.098787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.099112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.099429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.099845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.100032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.100356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.100790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.101197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.101596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.101998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.102389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.102793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.103179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.103563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.103968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.104363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.connection = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.104738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.105121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.105495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.106030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.106355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.106728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.107095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.107475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.107862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.108233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.108611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.108980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.109367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.109782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.110205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.110605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.110982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.111349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 19:27:32.111644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 19:27:32.112909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.113150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.113501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.123225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.142898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.148840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.148840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.153534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.155540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.155795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.174270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.174593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.234538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.238579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.306602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.307118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.307260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.307449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.473412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.473640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.473775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.474049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.474267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.474492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.477639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.477894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.478102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.478318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.478534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.478835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.499645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.499876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.500993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.501766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.502036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.502403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.502719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.503022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.523664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.523915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.547933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.548671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.548827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.548969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.549103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.549268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.549436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.549562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.549790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.549958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.550152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.550312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.550483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.550619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 19:27:32.569772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.570080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 19:27:32.570515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.570791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 19:27:32.571159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.571301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.571504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 19:27:32.571642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.571857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.572057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 19:27:32.572323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.572472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.572608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.572756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.572899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.573075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.583464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.583728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.584019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.589901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.590111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.590249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.590382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.590506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.591587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.592430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.595157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.595474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.595763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.595918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.596031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.596316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.596429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.596578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.596748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.596898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.597118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.597250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.597377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.597617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.597766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.597969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.598086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.598486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.598790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.599312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.599669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.600018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.623134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.624756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.625043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.625177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.627505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.627753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.631132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.631490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.631833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.632696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.632997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.633289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.639541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.639881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.640209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.640522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.644172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.644486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.644762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.644999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.645214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.645419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.645640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.645840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.645840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.646284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.646481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.646680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.646972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.647587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.647883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.648173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.665119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.665484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.665699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.665991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.670316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.671584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.677545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.677841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.678039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.678151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.679070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.679836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.682345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.683345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.685721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.686066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.686371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.686665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.686954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.687097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.687228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.687535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.687891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.688243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.688619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.689098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.703518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.703820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.704091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.704389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.706623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.706934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.707215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.707479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.711637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.713251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.714860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.715131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.715373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.716865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.717882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.718174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.718572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.718845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.719076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.719274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.719274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.722400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.722690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.723009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.723500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.723721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.731567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.731947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.732261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.732549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.732846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.733130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.733433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.738614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.738982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.739275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.739673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.739995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.740387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.740695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.750461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.753540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.756580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.758143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.758413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.759846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.760136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.760427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.761717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.764745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.766263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.767358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.767811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.768101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.768307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.768904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.772039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.772338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.772617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.772914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.775084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.776701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.779723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.780021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.786532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.786532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.786846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.786846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.786846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.789269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.789586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.789881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.790170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.790314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.790454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.790587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.790725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.790868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.791109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.791578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.792114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.792387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.792661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.792938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.793412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.793657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.798799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 19:27:32.799127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.799406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.799731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.800018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.800312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.800604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.800874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.801145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.801414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.801687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.801998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.802285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.802555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 19:27:32.830995 n-d-854121-7 devstack@keystone.service[82299]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55920fe9e9c0 pid: 82299 (default app) Aug 28 19:27:32.834973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bdab-c6ee-4674-8793-0f1d8fac551d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.835349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bdab-c6ee-4674-8793-0f1d8fac551d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.835708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bdab-c6ee-4674-8793-0f1d8fac551d None None] PATH_INFO: `/v3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.838530 n-d-854121-7 devstack@keystone.service[82298]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55920fe9e9c0 pid: 82298 (default app) Aug 28 19:27:32.840276 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Sun Aug 28 19:27:32 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:41.353004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:41.353004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:41.353637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:41.359962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:27:41.366615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:41.367156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:41.367156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:41.439539 n-d-854121-7 devstack@keystone.service[82299]: INFO dbcounter [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] Registered counter for database keystone Aug 28 19:27:41.462982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG oslo_db.sqlalchemy.engines [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 19:27:41.469976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writer thread running {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 19:27:41.660998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG passlib.handlers.bcrypt [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82299) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 19:27:41.661419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG passlib.handlers.bcrypt [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82299) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 19:27:41.717557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:41.719926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:41.862134 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 19:27:42.349203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:42.420239 n-d-854121-7 devstack@keystone.service[82298]: INFO dbcounter [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] Registered counter for database keystone Aug 28 19:27:42.441588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG oslo_db.sqlalchemy.engines [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 19:27:42.448958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writer thread running {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 19:27:42.574077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103643dc-699c-44ed-ba64-954dc7d761a9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:42.578510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:42.579179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.579459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.579729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.588985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:42.641688 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.common.rbac_enforcer.enforcer [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 19:27:42.641947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1bd16-1a6c-4dc6-890d-3ba2702d66a9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:42.652652 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1324 bytes} [Sun Aug 28 19:27:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:27:42.659427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:42.675468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2d41-2242-4682-991e-f7150ddbd7e5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:42.680268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:42.681403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.681692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.682003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] PATH_INFO: `/v3/projects/926e861f54084884ae9dc19520ca2e6d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.683742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] RBAC: Authorizing `identity:get_project(project_id=926e861f54084884ae9dc19520ca2e6d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:42.738347 n-d-854121-7 devstack@keystone.service[82299]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 19:27:42.738696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2798-a13d-4f93-bcce-938fe90adb15 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:42.743526 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3/5] 10.222.0.78 () {56 vars in 1207 bytes} [Sun Aug 28 19:27:42 2022] GET /identity/v3/projects/926e861f54084884ae9dc19520ca2e6d => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:44.693736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e772edc-77a8-4589-af24-fc62e5f6654d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:44.694321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e772edc-77a8-4589-af24-fc62e5f6654d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:44.694413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e772edc-77a8-4589-af24-fc62e5f6654d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:44.699880 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3/6] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:44.706678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:44.707222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:44.707310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:44.731208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:44.732903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:44.741921 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 19:27:45.017743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e772edc-77a8-4589-af24-fc62e5f6654d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.031014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e772edc-77a8-4589-af24-fc62e5f6654d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.035588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a19d4-c72b-4038-a074-0c7fdc789b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.036209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a19d4-c72b-4038-a074-0c7fdc789b1d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.036494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a19d4-c72b-4038-a074-0c7fdc789b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.036787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a19d4-c72b-4038-a074-0c7fdc789b1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.045654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a19d4-c72b-4038-a074-0c7fdc789b1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.048056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a19d4-c72b-4038-a074-0c7fdc789b1d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.058165 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1324 bytes} [Sun Aug 28 19:27:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:27:45.065220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.075208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d4cd6-21e5-471a-b87b-bf7545187309 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.081531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3d37d-23c8-498a-8ee1-592322d8c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.082408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3d37d-23c8-498a-8ee1-592322d8c05f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.082827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3d37d-23c8-498a-8ee1-592322d8c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.083290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3d37d-23c8-498a-8ee1-592322d8c05f admin admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.085404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3d37d-23c8-498a-8ee1-592322d8c05f admin admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.088045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3d37d-23c8-498a-8ee1-592322d8c05f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.089696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 5/9] 10.222.0.78 () {56 vars in 1198 bytes} [Sun Aug 28 19:27:45 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:47.147986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293ed2-d742-4d54-a495-8c9f24fcffee None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.148575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293ed2-d742-4d54-a495-8c9f24fcffee None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.148575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293ed2-d742-4d54-a495-8c9f24fcffee None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.149934 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:47.156222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.156945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.156945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.163835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13979-cc4a-4098-b5dc-039e9c2cf447 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.164288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13979-cc4a-4098-b5dc-039e9c2cf447 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.164695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13979-cc4a-4098-b5dc-039e9c2cf447 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.166195 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 6/11] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:27:47.172023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.172337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.172725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.179513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:47.180928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:47.226232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG passlib.handlers.bcrypt [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82298) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 19:27:47.226716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG passlib.handlers.bcrypt [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82298) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 19:27:47.273939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:47.274432 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 6/12] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:47.275558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:47.402906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 7/13] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:27:47.553476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:47.581528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:47.711181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc66f0-ebbd-45d2-9c9e-c9e0df091b5d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:47.725518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:47.759307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:47.760976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.761454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.762001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.781579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:27:47.790935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:27:47.791916 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:27:47.792751 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 7/14] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:27:47.798486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:47.835538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310434f-67fc-4fd0-9d19-5571d00e6225 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:47.838068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:47.878169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:47.879045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.879331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.879610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.888100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:47.907993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519160e9-d6e8-4cce-9aba-b099e3188024 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:47.946323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:47.946941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:47.947224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:47.947526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:47.948176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:47.948482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:47.949930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:47.954493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:47.956129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:47.963149 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 8/15] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:47.968991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:48.075624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 8/16] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:27:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:27:48.082069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:48.085412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:48.092467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83130778-2f5d-45fb-a4b6-c08a0879e847 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:48.131333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:48.131970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:48.132249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:48.132520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:48.134282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:48.136036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:48.137688 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 9/17] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:27:47 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:48.144334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:48.162936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:48.195325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece06ba-214b-4bb1-bf1d-0af55da97690 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:48.243413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:48.244228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:48.244514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:48.244792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:48.268638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:48.270221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:27:48.292115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:27:48.293314 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:27:48.294203 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:27:48.294203 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:27:48.294203 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:27:48.294203 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 9/18] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:27:48.299351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:48.300974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87626-b595-4955-86c7-b44838c650bb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:48.342252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:48.342901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:48.343231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:48.343661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:48.346205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:48.348975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:48.352029 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 10/19] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:48.358714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:48.380990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:48.451267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad4a7d-11e4-4560-8733-b5a5cc53db91 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:48.469719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:48.490430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f7d8-d749-45fd-b244-5535d6b96b6e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:48.496782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:48.497354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:48.497640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:48.497951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:48.498627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:48.498991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:48.500951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaba493-7284-4f0f-ab9f-4c8f04d2c1f2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:48.521259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 10/20] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:48.535642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:48.536294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:48.536613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:48.536857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:48.537697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.domain.id=default, user.id=f70e7022229a4fab8fd47caffd01ba01) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:48.538060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:48.541211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096c21-a4d3-4820-a9fb-51b8a88c138d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:48.550551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 11/21] 10.222.0.78 () {56 vars in 1322 bytes} [Sun Aug 28 19:27:48 2022] GET /identity/v3/role_assignments?user.id=f70e7022229a4fab8fd47caffd01ba01&scope.domain.id=default&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 233 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:51.023816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae8e6-32cf-435d-92d1-9e19c48a6506 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:51.024379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae8e6-32cf-435d-92d1-9e19c48a6506 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:51.024477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae8e6-32cf-435d-92d1-9e19c48a6506 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:51.026018 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 11/22] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:27:51.041484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f27e-e43d-4375-9349-e6ab12d044f1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:51.042013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f27e-e43d-4375-9349-e6ab12d044f1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:51.042261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f27e-e43d-4375-9349-e6ab12d044f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:51.082644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b436f27e-e43d-4375-9349-e6ab12d044f1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:51.084604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b436f27e-e43d-4375-9349-e6ab12d044f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:51.246920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 12/23] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:51.664017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60d1a-9c3b-489d-bf01-7e47312dcdd8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:51.664371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60d1a-9c3b-489d-bf01-7e47312dcdd8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:51.664483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60d1a-9c3b-489d-bf01-7e47312dcdd8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:51.665895 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 12/24] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:27:51.674180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:51.674945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:51.675047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:51.719921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:51.722167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:51.736517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd80971-07e5-436b-ab62-d8c931b166c7 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:51.737017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd80971-07e5-436b-ab62-d8c931b166c7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:51.737510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd80971-07e5-436b-ab62-d8c931b166c7 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:51.740745 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 13/25] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:51.747363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0d5c-b7c7-432f-bdef-7bdc0782cd41 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:51.747957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0d5c-b7c7-432f-bdef-7bdc0782cd41 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:51.748466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0d5c-b7c7-432f-bdef-7bdc0782cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:51.813885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fa7b0d5c-b7c7-432f-bdef-7bdc0782cd41 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:51.816013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fa7b0d5c-b7c7-432f-bdef-7bdc0782cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:51.974334 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 13/26] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:52.075835 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 14/27] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:52.077011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:52.082215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:52.226223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd91c-2a2a-4c07-8113-60528884c49d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:52.227037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd91c-2a2a-4c07-8113-60528884c49d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:52.227718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd91c-2a2a-4c07-8113-60528884c49d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:52.230204 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 15/28] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:27:52.236534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec129d4-a20d-4ddb-b6f4-aa2b190d25f3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:52.239211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:52.240041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:52.240747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:52.272651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:52.281884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:52.292625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:52.293330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:52.293614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:52.293959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:52.329275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:27:52.337362 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:27:52.339033 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:27:52.340440 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:27:52.347203 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 14/29] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:27:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:27:52.375099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:52.450503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:52.501995 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 16/30] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:27:52.524535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:52.578098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c58d-7d55-4f1c-8076-38acd5f3877d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:52.631821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:52.632502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:52.632804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:52.633055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:52.633747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:52.634086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:52.636064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:52.651510 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 15/31] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:27:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:52.658410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:52.807595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:52.843410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4c83a-c0e2-4ed3-b1ee-fd960eb35f47 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:52.956955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:52.958018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:52.958521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:52.959010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:52.966335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:52.969019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:52.972833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 17/32] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:27:52 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:52.981207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:53.115592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0368c-1cbc-4f9e-81a6-6d66834cebfe None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:53.126691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:53.169701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:53.186655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:53.188608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.189297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.189968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.191365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:53.194337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:53.239437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739994b2-edff-41a6-b5e6-9ffbf294ea7e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:53.290594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:53.291176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.292164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.292164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.307239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:53.308982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:27:53.328172 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:27:53.339087 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:27:53.340547 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:27:53.340547 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:27:53.340547 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:27:53.340547 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 18/33] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:27:53.340547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:53.466896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 16/34] 10.222.0.78 () {60 vars in 1131 bytes} [Sun Aug 28 19:27:52 2022] POST /identity/v3/roles => generated 219 bytes in 660 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:27:53.468013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:53.551527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:53.560790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8bfd8-e495-4cc1-b1aa-d6d6a5117998 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:53.622413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:53.623752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.624787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.625082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.628396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:53.632012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:53.636265 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 19/35] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:53.637627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:53.649481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b12e75-1890-42c6-9661-d2d353d7f6e6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:53.722110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207b368-5642-4921-9b95-0fa325c20ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:53.723535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b368-5642-4921-9b95-0fa325c20ae6 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.724278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b368-5642-4921-9b95-0fa325c20ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.724981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b368-5642-4921-9b95-0fa325c20ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.726563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207b368-5642-4921-9b95-0fa325c20ae6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:53.729747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207b368-5642-4921-9b95-0fa325c20ae6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:53.830550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4ed5-52ef-4c61-b515-eb13863a635a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:53.854750 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 17/36] 10.222.0.78 () {60 vars in 1131 bytes} [Sun Aug 28 19:27:53 2022] POST /identity/v3/roles => generated 225 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:53.857927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db841-ed38-4470-a7ed-25625b665446 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.857927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db841-ed38-4470-a7ed-25625b665446 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.858290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db841-ed38-4470-a7ed-25625b665446 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.861634 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 18/37] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:53.862701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db841-ed38-4470-a7ed-25625b665446 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:53.895907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:53.896999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.897551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.898225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.899559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:53.900148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:53.903092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67e5fb-2a82-4fdf-901b-5dfc718c55ed None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:53.923134 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:53.925237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5f63f-951c-4ddf-b3bf-d8a8fa741e52 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.925655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5f63f-951c-4ddf-b3bf-d8a8fa741e52 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.926131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5f63f-951c-4ddf-b3bf-d8a8fa741e52 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.928641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 21/39] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:53.930773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.931096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.931378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.952500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:53.953779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:53.957949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:53.988003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:54.036722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db841-ed38-4470-a7ed-25625b665446 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:54.049788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 22/40] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:54.050698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:54.088755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf0a84-f380-4495-af26-3b7d6d449217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:54.089930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf0a84-f380-4495-af26-3b7d6d449217 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:54.090467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf0a84-f380-4495-af26-3b7d6d449217 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:54.090952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf0a84-f380-4495-af26-3b7d6d449217 None admin] PATH_INFO: `/v3/domains/default/users/f70e7022229a4fab8fd47caffd01ba01/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:54.093617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf0a84-f380-4495-af26-3b7d6d449217 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f70e7022229a4fab8fd47caffd01ba01, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:54.095970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf0a84-f380-4495-af26-3b7d6d449217 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:54.225523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd4f4-803d-4049-80a3-c43d3a0f43c5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:54.252180 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 19/41] 10.222.0.78 () {58 vars in 1361 bytes} [Sun Aug 28 19:27:53 2022] PUT /identity/v3/domains/default/users/f70e7022229a4fab8fd47caffd01ba01/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:54.254067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:54.254401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:54.254721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:54.275880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:54.276300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:54.277083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:54.277543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:54.278002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:54.278235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:54.279089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:54.280950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:54.377328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 20/42] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:54.378229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:54.442216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:54.531417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb92c7-dfef-4d41-b3ec-7e572d5c708c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:54.560050 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 23/43] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:27:54 2022] POST /identity/v3/projects => generated 301 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:54.595939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:54.596916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:54.597360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:54.597828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:54.598791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:54.600670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:54.704756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:54.717519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:54.728824 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 21/44] 10.222.0.78 () {60 vars in 1131 bytes} [Sun Aug 28 19:27:54 2022] POST /identity/v3/roles => generated 223 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:54.854260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44fc8-e833-47a9-a6b0-38bb607e51d1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:54.894025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148998-d2ea-49c0-84c4-c64a49d374a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:54.894688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148998-d2ea-49c0-84c4-c64a49d374a5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:54.894982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148998-d2ea-49c0-84c4-c64a49d374a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:54.895264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148998-d2ea-49c0-84c4-c64a49d374a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:54.896515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c148998-d2ea-49c0-84c4-c64a49d374a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:54.898230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c148998-d2ea-49c0-84c4-c64a49d374a5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:54.899887 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 24/45] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:54.905627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:55.136953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:55.143219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3597b-14e7-47cc-99a8-ed501f8ff29a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:55.180189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb820b0-45eb-49d3-bea9-4e1f86aa6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:55.180832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb820b0-45eb-49d3-bea9-4e1f86aa6c86 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:55.181117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb820b0-45eb-49d3-bea9-4e1f86aa6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:55.181390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb820b0-45eb-49d3-bea9-4e1f86aa6c86 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:55.182135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb820b0-45eb-49d3-bea9-4e1f86aa6c86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:55.183641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb820b0-45eb-49d3-bea9-4e1f86aa6c86 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:55.288074 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 22/46] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:27:54 2022] POST /identity/v3/projects => generated 312 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:56.345350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba7e7-8e92-44b8-b778-a50127887af8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:56.345921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba7e7-8e92-44b8-b778-a50127887af8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:56.345921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba7e7-8e92-44b8-b778-a50127887af8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:56.347274 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 25/47] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:56.352905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:56.353241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:56.353241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:56.372915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:56.374621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:56.452037 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 23/48] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:27:56.723641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba7e7-8e92-44b8-b778-a50127887af8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:56.804808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:56.831077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba7e7-8e92-44b8-b778-a50127887af8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:56.868822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:56.869468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:56.869752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:56.870067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:56.882144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:27:56.888517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:27:56.889487 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:27:56.890255 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 26/49] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:27:56.895943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:56.986466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:57.018452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733460a5-504e-4132-86b6-eff2e3baf3a2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:57.059859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:57.060493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.060779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.061101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.061766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:57.062095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:57.063569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:57.072896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 24/50] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:57.079402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:57.194770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399146f-2d3f-4f17-a47a-162d221ea964 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:57.231726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee901b5-a3ce-43e5-a06f-f3cfa5381bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:57.232413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee901b5-a3ce-43e5-a06f-f3cfa5381bb5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.232702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee901b5-a3ce-43e5-a06f-f3cfa5381bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.232984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee901b5-a3ce-43e5-a06f-f3cfa5381bb5 None admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.234281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee901b5-a3ce-43e5-a06f-f3cfa5381bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:57.235788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee901b5-a3ce-43e5-a06f-f3cfa5381bb5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:57.237628 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 27/51] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:27:57 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:57.244644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:57.272050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0793-c2c0-49c4-8712-beea14881d6d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.272331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0793-c2c0-49c4-8712-beea14881d6d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.272609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0793-c2c0-49c4-8712-beea14881d6d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.274084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 28/52] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:27:57.282883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.283336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.283759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.292957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:57.310149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:57.311744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:57.380192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fbfc8-e791-4ebb-8cd7-9951f638d9ea None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:57.392352 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 29/53] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:27:57.424531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:57.425174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.425457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.425734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.427018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:57.428502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:57.430125 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 25/54] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:57.436069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:57.543301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b592fb-7e9b-42bd-9355-bb34452b55be None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:57.576820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:57.583339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:57.583964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.584248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.584527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.585265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.domain.id=default, user.id=f70e7022229a4fab8fd47caffd01ba01) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:57.585577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:57.587250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:57.598707 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 30/55] 10.222.0.78 () {56 vars in 1322 bytes} [Sun Aug 28 19:27:57 2022] GET /identity/v3/role_assignments?user.id=f70e7022229a4fab8fd47caffd01ba01&scope.domain.id=default&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:57.673501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:57.687992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:57.820144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4294654-e203-485b-b3e2-feb3a1cba43a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:57.857083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e75a9-fe81-4f95-bcb9-004185672454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:57.857716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e75a9-fe81-4f95-bcb9-004185672454 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:57.858027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e75a9-fe81-4f95-bcb9-004185672454 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:57.858300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e75a9-fe81-4f95-bcb9-004185672454 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:57.859410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e75a9-fe81-4f95-bcb9-004185672454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:57.860851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e75a9-fe81-4f95-bcb9-004185672454 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:57.862444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 26/56] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:57.868560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:58.103102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ffe9-e14f-4777-90b9-d3efbc169a37 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:58.147951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c9717-27ad-4b07-a19b-8650ad53fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:58.148644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9717-27ad-4b07-a19b-8650ad53fe12 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:58.148929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9717-27ad-4b07-a19b-8650ad53fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:58.149200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9717-27ad-4b07-a19b-8650ad53fe12 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:58.149894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c9717-27ad-4b07-a19b-8650ad53fe12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:58.151374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c9717-27ad-4b07-a19b-8650ad53fe12 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:58.327029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 31/57] 10.222.0.78 () {60 vars in 1140 bytes} [Sun Aug 28 19:27:57 2022] POST /identity/v3/projects => generated 298 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:00.351143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825dfcf-e83a-4c30-a4b4-be3d2b3bc302 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:00.351676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825dfcf-e83a-4c30-a4b4-be3d2b3bc302 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:00.351676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825dfcf-e83a-4c30-a4b4-be3d2b3bc302 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:00.353082 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 27/58] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:00.359024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:00.359525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:00.359607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:00.378689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:00.379916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:00.431476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:00.457691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 32/59] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:00.728400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825dfcf-e83a-4c30-a4b4-be3d2b3bc302 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:00.817618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:00.845567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825dfcf-e83a-4c30-a4b4-be3d2b3bc302 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:00.881946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aa8bd-f0c9-4ee8-9c41-52f302087d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:00.882602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa8bd-f0c9-4ee8-9c41-52f302087d06 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:00.882883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa8bd-f0c9-4ee8-9c41-52f302087d06 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:00.883158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa8bd-f0c9-4ee8-9c41-52f302087d06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:00.884374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7aa8bd-f0c9-4ee8-9c41-52f302087d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:00.886162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7aa8bd-f0c9-4ee8-9c41-52f302087d06 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:00.887807 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 28/60] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:00.894208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:01.006209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3efa95-b566-4e06-8474-6a220400c1d8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:01.053107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff148391-d2c9-4d18-8098-21f6b0c4244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:01.054182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148391-d2c9-4d18-8098-21f6b0c4244e None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.054694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148391-d2c9-4d18-8098-21f6b0c4244e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.055199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148391-d2c9-4d18-8098-21f6b0c4244e None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.056463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff148391-d2c9-4d18-8098-21f6b0c4244e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:01.059276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff148391-d2c9-4d18-8098-21f6b0c4244e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:01.243890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 33/61] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:00 2022] POST /identity/v3/users => generated 275 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:04.541343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d447e-3949-4a81-9a50-7800e699dc8a None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:04.542949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d447e-3949-4a81-9a50-7800e699dc8a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:04.543729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d447e-3949-4a81-9a50-7800e699dc8a None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:04.546648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 29/62] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:04.553424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c531e-6752-48e1-b78d-0a91592ff438 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:04.553959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c531e-6752-48e1-b78d-0a91592ff438 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:04.554448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c531e-6752-48e1-b78d-0a91592ff438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:04.589620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-240c531e-6752-48e1-b78d-0a91592ff438 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:04.591795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-240c531e-6752-48e1-b78d-0a91592ff438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:04.668004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:04.695284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e7a1-5692-46b0-aa29-ea66fc4d3360 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:04.698626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e7a1-5692-46b0-aa29-ea66fc4d3360 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:04.698626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e7a1-5692-46b0-aa29-ea66fc4d3360 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:04.699219 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 30/63] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:04.707153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596b7c1-3ea4-4820-b132-feed52080864 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:04.707153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596b7c1-3ea4-4820-b132-feed52080864 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:04.707153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596b7c1-3ea4-4820-b132-feed52080864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:04.762477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b596b7c1-3ea4-4820-b132-feed52080864 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:04.764544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b596b7c1-3ea4-4820-b132-feed52080864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:04.796769 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 34/64] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:04.910753 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 31/65] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:05.184729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4192-1b2d-4353-9040-fd85a8115ae6 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.185288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4192-1b2d-4353-9040-fd85a8115ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.185724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4192-1b2d-4353-9040-fd85a8115ae6 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.188092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 35/66] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:05.193814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.194346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.194781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.214557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e338e-ee03-449b-8d61-590fbcf96add None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.215486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e338e-ee03-449b-8d61-590fbcf96add None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.216265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e338e-ee03-449b-8d61-590fbcf96add None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.219270 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 36/67] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:05.222976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:05.224203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:05.228680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.229554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.230357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.265972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:05.265972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:05.366595 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 32/68] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:05.383244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:05.402285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:05.437043 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 37/69] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:05.451212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:05.582113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d28e7-2617-4ff6-b111-0e3c73c949fe None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:05.637343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:05.651924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d560a2-673c-4cab-a414-35a5d81c5538 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:05.662626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:05.663299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.663583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.663865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.685283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:05.695452 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:05.696376 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:05.697203 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 33/70] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:05.705585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:05.712824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:05.713476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.713942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.714218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.738442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:05.743983 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:05.745066 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:05.746076 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:05.748436 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 38/71] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:05.749604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:05.810698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:05.864135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de169b7-04ce-4d88-ae8e-990e39145317 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:05.892688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c6adf-7a9f-40bc-81dd-130f2b5034ad None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:05.907590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:05.908215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.908496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.908775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.909457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:05.909798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:05.911246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:05.919925 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 34/72] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:05.920870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:05.933755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:05.934419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:05.934699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:05.934968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:05.946738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:05.951587 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:05.952452 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:05.953894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 39/73] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:05.954527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:05.971391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.032271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3bf43-dca2-46e8-8adc-1c5a7b69a3f2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.059140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.059798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d099e2-a6c8-4acf-a719-4a155fabf6cf None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.068784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.069400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.080330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.080330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.080330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:06.080330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.080330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5f4d-5951-42ef-912c-5b435b76b86d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.082829 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 35/74] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:06.084097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bda02c-bc98-4f7f-b6c8-ffc55b1bd84a None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.084384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bda02c-bc98-4f7f-b6c8-ffc55b1bd84a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.084666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bda02c-bc98-4f7f-b6c8-ffc55b1bd84a None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.086126 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 36/75] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:06.086720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bda02c-bc98-4f7f-b6c8-ffc55b1bd84a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.099106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.099753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.100044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.100397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.113581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:06.118501 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:06.119858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:06.120609 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 40/76] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:06.125877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.210716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bda02c-bc98-4f7f-b6c8-ffc55b1bd84a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.223840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.252841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.253485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.253776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.254086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.257297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54b4d-e6cf-462f-83c5-703a85d59358 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.270293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.271783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.273526 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 37/77] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:06.274367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.301805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.302462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.302882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.303333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.304382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:06.304697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.306373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5a5f-d77b-4d38-8d55-0764b5122f25 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.320950 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 41/78] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:06.322286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a36710-d372-456a-a947-d559abc586a4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.322575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a36710-d372-456a-a947-d559abc586a4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.322858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a36710-d372-456a-a947-d559abc586a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.334152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.342160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-80a36710-d372-456a-a947-d559abc586a4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:06.343439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-80a36710-d372-456a-a947-d559abc586a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:06.398946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b60c4-9933-4a9b-848a-f1e421e25cc1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.425222 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 42/79] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:06.428957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a36710-d372-456a-a947-d559abc586a4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.444141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.444944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.444944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.445213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.446518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.447941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.449820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 38/80] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:06.454141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.512974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.564829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a36710-d372-456a-a947-d559abc586a4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.593133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84ac8f-6f34-4e05-8504-6b03223bc9b5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.610040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.610980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.611397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.611843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.612991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:06.613647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.615143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.617385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.631828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 43/81] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:06.633111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.648137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.649659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.650173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.650688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.731892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.733405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.754927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a4b0-3ad6-4fea-a5bf-edc918279c66 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.784765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.792886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.793495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.795167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.795167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.795408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:06.797219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:06.798870 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 44/82] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:06.799652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.847600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 39/83] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:06.848327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:06.866706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:06.918915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd56887-68ac-4279-ba5a-1d627b152744 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:06.965975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:06.966617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:06.966902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:06.967186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:06.967414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e00b-332c-4a58-93f5-d1d43d7f58ad None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.017331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.018021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.018305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.018577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.020169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.021695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.023330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 40/84] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:07.029357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.043020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.050639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.052317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.141565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.162525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09d10-1b15-418e-b3fa-a73c19e1bbff None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.196792 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 45/85] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:07.202504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.202773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.203197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.203724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.204001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.205245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.206758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.208517 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 41/86] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:07.209423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.313319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.318062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756946bf-f621-4531-aca1-3efdcdbe8126 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.319358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c69c5-df59-418b-a79e-4ccd09edf6ff None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.359951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.360331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.360749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.360903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.361166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.361250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.364199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.364367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.364451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.364451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.366563 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 42/87] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:07.367403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.394296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.449354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.450898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.504849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9027fd2-496b-42bc-aa4c-ec1691ec554b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.555966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.556629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.556860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.557132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.558153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.565116 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 46/88] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:07.565933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.646620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.648121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.668693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.681930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6807f-50d3-46ac-939d-3e1df202a9f8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.723747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.724739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.725241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.725748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.727347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.728918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.730671 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 47/89] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:07.731465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.757806 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 43/90] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:07.758952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.810548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.863261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b927dc-7200-4e9f-b842-cea61180dd69 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.878285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e218f-dbf1-452a-b704-df08d898f997 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.900245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.901349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.901983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.902267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.902542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.903198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.905089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.917830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.918469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.918770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.919027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.919760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=5f1b6d22b0144e1f97b5ee9f7857fec8) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:07.920075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.921549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.926998 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 44/91] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/role_assignments?user.id=5f1b6d22b0144e1f97b5ee9f7857fec8&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:07.927872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.010166 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 48/92] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:07 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:08.010166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.063582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b441-e503-4cb8-8c18-b57c6f61d65a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.107774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.108430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.108795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.109031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] PATH_INFO: `/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.110416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] RBAC: Authorizing `identity:get_project(project_id=8d47e4ab7d264c6e96ad2bd8585823ba)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.111981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.118803 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 45/93] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:07 2022] GET /identity/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:08.118803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.160139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde32-c61b-43ed-83af-fd8e2fb3b76b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.176669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:08.185806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:08.216254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.217164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.217604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.218095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.219044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=f70e7022229a4fab8fd47caffd01ba01) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:08.219532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.223967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.231883 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 49/94] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:08 2022] GET /identity/v3/role_assignments?user.id=f70e7022229a4fab8fd47caffd01ba01&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:08.233289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.271518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33a87e-1497-4da2-b846-a7e5067a6e02 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.333146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.333812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.334194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.334473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.340656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.342208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.345569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 46/95] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:08 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:08.351758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.435024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2370a-c760-4b02-a4df-d7bbe4312229 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.492395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.493032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.493318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.493613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.495306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=8d47e4ab7d264c6e96ad2bd8585823ba, user.id=5f1b6d22b0144e1f97b5ee9f7857fec8) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:08.495626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.497163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befac52-7e2c-4e46-9f6a-33c0156f43c9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.508267 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 50/96] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:08 2022] GET /identity/v3/role_assignments?user.id=5f1b6d22b0144e1f97b5ee9f7857fec8&scope.project.id=8d47e4ab7d264c6e96ad2bd8585823ba&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:08.539464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53263b5c-0d28-4522-bfa4-6a422ee572a5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.561514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:08.583081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.583713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.584220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.584321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.584999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] RBAC: Adding query filter params (role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=5f1b6d22b0144e1f97b5ee9f7857fec8) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:08.585324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.586928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6379a-68a5-4626-8092-c1e57eff0c13 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.594035 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 47/97] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:08 2022] GET /identity/v3/role_assignments?user.id=5f1b6d22b0144e1f97b5ee9f7857fec8&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:10.587504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59beca-a464-48c8-bad7-d45ecacbba0c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:10.588611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59beca-a464-48c8-bad7-d45ecacbba0c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:10.589102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59beca-a464-48c8-bad7-d45ecacbba0c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:10.590807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 51/98] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:10.596868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7442-386b-4f5c-b0d2-e2dfa410c75f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:10.597755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7442-386b-4f5c-b0d2-e2dfa410c75f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:10.598263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7442-386b-4f5c-b0d2-e2dfa410c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:10.622425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-66be7442-386b-4f5c-b0d2-e2dfa410c75f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:10.624150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-66be7442-386b-4f5c-b0d2-e2dfa410c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:10.713311 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 48/99] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:11.030060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4592-9c1c-4f83-8101-cbfebd5a71bd None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.030772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4592-9c1c-4f83-8101-cbfebd5a71bd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.031481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4592-9c1c-4f83-8101-cbfebd5a71bd None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.033595 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 52/100] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:11.039711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686bf7-4fba-407b-9002-87ae211ad2d0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.040377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686bf7-4fba-407b-9002-87ae211ad2d0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.040939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686bf7-4fba-407b-9002-87ae211ad2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.066927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-59686bf7-4fba-407b-9002-87ae211ad2d0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:11.068531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-59686bf7-4fba-407b-9002-87ae211ad2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:11.151386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 49/101] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:11.270087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b4592-9c1c-4f83-8101-cbfebd5a71bd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:11.335841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:11.353536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2812011-9acd-42e3-8523-37a30a373914 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.354825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2812011-9acd-42e3-8523-37a30a373914 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.355322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2812011-9acd-42e3-8523-37a30a373914 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.357277 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 50/102] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:11.363525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.363814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.364066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.409215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:11.410984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:11.465190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b4592-9c1c-4f83-8101-cbfebd5a71bd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:11.499388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:11.533107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 51/103] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:11.549032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:11.549684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.549993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.550270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.571620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:11.577001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:11.578419 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:11.579612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 53/104] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:11.584572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:11.646368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:11.740844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f8aa5-1b73-4cfc-bca4-4c8ae22a9cc5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:11.808258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:11.809487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.810051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.811035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.812795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:11.813316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:11.815263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:11.832627 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 52/105] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:11.838362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:11.892179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:11.937988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e94b9-478a-4a5a-aed4-a12d969320e6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:11.952373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:11.980594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:11.981236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:11.981520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:11.981799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:11.981922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba376ead-ec22-464a-bbdf-b172b68a5c74 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:11.994764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:12.000223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:12.001971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 54/106] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:12.003565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.029404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4346d2-ff18-4d39-9928-a900815dbd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.030089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4346d2-ff18-4d39-9928-a900815dbd57 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.030369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4346d2-ff18-4d39-9928-a900815dbd57 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.030644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4346d2-ff18-4d39-9928-a900815dbd57 None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.031875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4346d2-ff18-4d39-9928-a900815dbd57 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:12.033270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4346d2-ff18-4d39-9928-a900815dbd57 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:12.034924 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 53/107] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:11 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:12.040707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c08bd-d7bb-433f-a6e7-ae480444bc28 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.040991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c08bd-d7bb-433f-a6e7-ae480444bc28 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.041268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c08bd-d7bb-433f-a6e7-ae480444bc28 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 54/108] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e3396-4fc2-463e-b0b0-8230b5886268 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e3396-4fc2-463e-b0b0-8230b5886268 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e3396-4fc2-463e-b0b0-8230b5886268 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 55/109] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009455ae-e34b-4e76-a6df-f3701778e020 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.047974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009455ae-e34b-4e76-a6df-f3701778e020 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.048470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009455ae-e34b-4e76-a6df-f3701778e020 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.049777 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 56/110] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:12.049913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009455ae-e34b-4e76-a6df-f3701778e020 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.131665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835e449-5a82-404d-91a3-a8c92a3d48d2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.160665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009455ae-e34b-4e76-a6df-f3701778e020 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.162240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.168274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.169029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.169285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.169501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.181688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:12.188122 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:12.188993 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:12.189990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 55/111] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:12.191091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.209368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.210015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.210297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.210573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.211360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:12.211571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:12.213015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644a98-efb7-456b-9c8c-514e44fb8dcb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:12.223288 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 57/112] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:12.226122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a817d7d-5072-4863-aa98-1d7601fdecea None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.226869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a817d7d-5072-4863-aa98-1d7601fdecea None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.226869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a817d7d-5072-4863-aa98-1d7601fdecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.228236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.248632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4a817d7d-5072-4863-aa98-1d7601fdecea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:12.250813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4a817d7d-5072-4863-aa98-1d7601fdecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:12.307033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486c1f8-317f-4335-a41b-5237c921909a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.328977 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 58/113] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:12.330815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.331107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.331386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.346212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ade68-d85e-4559-aa12-3cc48c7372ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.346852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ade68-d85e-4559-aa12-3cc48c7372ef None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.347138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ade68-d85e-4559-aa12-3cc48c7372ef None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.347430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ade68-d85e-4559-aa12-3cc48c7372ef None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.348613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ade68-d85e-4559-aa12-3cc48c7372ef None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:12.350797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ade68-d85e-4559-aa12-3cc48c7372ef None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:12.352124 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 56/114] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:12 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:12.353045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.353331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.353608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.366260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:12.367498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:12.374282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:12.376383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:12.461434 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 57/115] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:12.462617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.479304 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 59/116] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:12.482770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.545471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.547882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.710835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0eec-5ce6-4b40-96dc-b2fb088ad029 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.744569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531306c-18fe-4a74-96a1-7423206c7aa9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.753277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.753941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.754264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.754545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.755231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:12.755540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:12.756986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:12.772388 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 58/117] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:12.773364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.807367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.808017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.808294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.808572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] PATH_INFO: `/v3/users/b89c949098924ec682a905589e3869f1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.824754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] RBAC: Authorizing `identity:get_user(user_id=b89c949098924ec682a905589e3869f1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:12.826287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:12.828805 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 60/118] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:12 2022] GET /identity/v3/users/b89c949098924ec682a905589e3869f1 => generated 289 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:12.829398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:12.930147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.936332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.949279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02866f-5a4f-43c6-9f82-9a770ca470b1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.950097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719441c6-e629-4886-9c87-81ef16cae33b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:12.986533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.986751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:12.986848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.986848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.992192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:12.992288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/5f1b6d22b0144e1f97b5ee9f7857fec8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.992360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:12.992360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:12.992474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c04f173e384bb08ddae310e94f5bf6, user_id=5f1b6d22b0144e1f97b5ee9f7857fec8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:12.992474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:12.998123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:13.003587 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:13.004586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:13.005410 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 61/119] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:13.006603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.084892 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 59/120] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:12 2022] PUT /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/5f1b6d22b0144e1f97b5ee9f7857fec8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:13.085746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.129357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301235-5a0d-4d1d-969d-7210b7895b3b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:13.182123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:13.182797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:13.183080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:13.183357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:13.185432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:13.187408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:13.195020 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 62/121] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:13.195020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.212998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:13.294815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c25d-5a9f-4bdf-a222-a4643f751db7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:13.346543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:13.347211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:13.347491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:13.347789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:13.352224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:13.352224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:13.352519 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 60/122] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:13.353490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.370763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991393e9-304a-4989-a8cd-36e631f03239 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:13.388158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:13.417873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:13.417873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:13.417873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:13.417873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:13.510130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa681d7-8435-49cf-b9a2-3d95931b69e2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:13.511876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:13.514190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:13.531277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:13.560400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:13.561051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:13.561498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:13.561884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:13.578281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:13.586391 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:13.587941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 61/123] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:13.594412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.667179 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 63/124] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:13.672379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.724798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:13.755660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52ce3-a715-4d57-919f-9654d704c4fe None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:13.808127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900363fc-38c7-46f4-93c2-b4da0ea5f652 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:13.808691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:13.809298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:13.809790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:13.810329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:13.812512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:13.812712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:13.815082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:13.827424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:13.828980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 62/125] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:13.829632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.867489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:13.868225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:13.868511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:13.868792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:13.870146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:13.871630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:13.873484 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 64/126] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:13.874244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:13.978427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12126-f706-421e-ad80-0ca781a4ac56 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.021636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f8e8-3961-4af3-bfb3-cbb6438121b2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.025407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.026418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.026711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.026994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.027669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.029256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.040649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:14.065135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.065655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.066055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.066340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.067030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:14.067332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.068730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.078708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 65/127] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:14.078708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.127482 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 63/128] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:28:13 2022] POST /identity/v3/projects => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:14.128456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.141252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:14.261572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe272a-be61-4370-81fe-c0f92041ab62 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.299325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03abce-b012-4ce6-801a-3f0757c982a1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.316968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.317746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.318085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.318370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.320404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.321934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.324331 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 66/129] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:14 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:14.325167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.375063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.376032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.376569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.377039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.383712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.386611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.390660 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 64/130] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:14 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:14.392346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.494302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8131c30-b6f9-41a6-9cae-8f5d90ac9b74 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.508272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:14.526383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:14.554612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.556073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.556563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.557035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/f70e7022229a4fab8fd47caffd01ba01/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.559745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c04f173e384bb08ddae310e94f5bf6, user_id=f70e7022229a4fab8fd47caffd01ba01, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.561815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.570131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5607ce2-31c3-48db-bfd7-dca39846c04b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.626967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.627663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.627947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.628249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.629609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.631192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.633059 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 65/131] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:14 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:14.633826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.701182 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 67/132] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:14 2022] PUT /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/f70e7022229a4fab8fd47caffd01ba01/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:14.703106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.828907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bcd08-4772-426a-8469-4b7cc4d7ac0d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:14.890294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:14.898062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:14.898700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.898989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.899270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.900043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] RBAC: Adding query filter params (role.id=bf350015327b4b8ba8a77ce752f17fab, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=b89c949098924ec682a905589e3869f1) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:14.900365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:14.901888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:14.913472 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 66/133] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:14 2022] GET /identity/v3/role_assignments?user.id=b89c949098924ec682a905589e3869f1&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=bf350015327b4b8ba8a77ce752f17fab => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:14.914450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:14.940049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bbd30-c152-41cd-8a9e-e0ab656b45bb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.017825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.018735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.019086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.025811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.025811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.025811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.025811 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 68/134] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:14 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:15.032182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.099514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:15.196340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803280a-6499-448c-9a61-1b23a3b7b76b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.205240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517fa61-1be6-40d6-9ccf-8f3dc85514de None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.272677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48336f-e5ac-464c-ac57-584262027391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.273369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48336f-e5ac-464c-ac57-584262027391 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.273654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48336f-e5ac-464c-ac57-584262027391 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.273968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48336f-e5ac-464c-ac57-584262027391 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/5f1b6d22b0144e1f97b5ee9f7857fec8/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.277124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48336f-e5ac-464c-ac57-584262027391 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c04f173e384bb08ddae310e94f5bf6, user_id=5f1b6d22b0144e1f97b5ee9f7857fec8, role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.278986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48336f-e5ac-464c-ac57-584262027391 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.310510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.312609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.321591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.322335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] PATH_INFO: `/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.330654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] RBAC: Authorizing `identity:get_project(project_id=8d47e4ab7d264c6e96ad2bd8585823ba)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.333163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.342288 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 67/135] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:14 2022] GET /identity/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba => generated 312 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:15.347893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.384041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 69/136] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:15 2022] PUT /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/5f1b6d22b0144e1f97b5ee9f7857fec8/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:15.475165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:15.482945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eead6-c15a-44eb-be20-16c8b41c35cd None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.483438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eead6-c15a-44eb-be20-16c8b41c35cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.485931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eead6-c15a-44eb-be20-16c8b41c35cd None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.486649 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 70/137] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:15.498787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.499823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.500319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.528068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:15.529743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.561064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abf9bd-1649-4527-b2bf-a95cc50bd3ec None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.652119 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 71/138] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:15.653168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.654294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.654822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.655393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] PATH_INFO: `/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba/users/5f1b6d22b0144e1f97b5ee9f7857fec8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.658454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d47e4ab7d264c6e96ad2bd8585823ba, user_id=5f1b6d22b0144e1f97b5ee9f7857fec8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.660345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.746754 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 68/139] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:15 2022] PUT /identity/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba/users/5f1b6d22b0144e1f97b5ee9f7857fec8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:28:16.042365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.090897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:16.206027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bc660-d08d-46af-b90c-0db8071b2e44 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.255261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.255914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.256329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.256685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.273371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:16.279045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:16.280660 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:16.281961 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 72/140] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:16.287372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.473898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee33cca-1f40-423f-b626-08cab19a09a3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.518368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:16.543788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.544535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.545032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.545455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.546783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:16.547306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.548980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.561027 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 69/141] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:16.570127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.715273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:16.737195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718c5d-a769-4935-98cd-c0789960d617 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.787776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b907c3-1fad-45e2-ba15-24470d21554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.788720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b907c3-1fad-45e2-ba15-24470d21554f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.789145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b907c3-1fad-45e2-ba15-24470d21554f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.789582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b907c3-1fad-45e2-ba15-24470d21554f None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.791047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b907c3-1fad-45e2-ba15-24470d21554f None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.792866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b907c3-1fad-45e2-ba15-24470d21554f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.795016 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 73/142] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:16.802775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:17.001211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67714-b016-4f32-95b5-482e3c37fab8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:17.062369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:17.063010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:17.063298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:17.063577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:17.123194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7b4c1-7a3d-4797-a05e-1154046d62ee None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:17.124045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7b4c1-7a3d-4797-a05e-1154046d62ee None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:17.124595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7b4c1-7a3d-4797-a05e-1154046d62ee None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:17.127094 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 74/143] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:17.134471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:17.135776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:17.137393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:17.168197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:17.183825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:17.185439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:17.231580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:17.233084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:17.408905 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 75/144] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:17.465788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 70/145] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:17.475160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:17.687108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:17.720198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573015a-2f23-4ad4-80e7-958ea29947d8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:17.797777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:17.798819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:17.799276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:17.799732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:17.807058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:17.809759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:17.813419 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 76/146] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:17 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:17.819629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:17.945625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:17.990057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:18.048108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e4507-3347-4569-905a-71841410e9f3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:18.137673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549c54c-732e-4656-b9ec-dbb61332411b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:18.153366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:18.154375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.154892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.155920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.157030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=5f1b6d22b0144e1f97b5ee9f7857fec8) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:18.157545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:18.159316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:18.173009 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 71/147] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:17 2022] GET /identity/v3/role_assignments?user.id=5f1b6d22b0144e1f97b5ee9f7857fec8&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:18.209649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85bd1b-d799-4f65-8035-c8c3bc77684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:18.210517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85bd1b-d799-4f65-8035-c8c3bc77684a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.210933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85bd1b-d799-4f65-8035-c8c3bc77684a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.211334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85bd1b-d799-4f65-8035-c8c3bc77684a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.214104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85bd1b-d799-4f65-8035-c8c3bc77684a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:18.216503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85bd1b-d799-4f65-8035-c8c3bc77684a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:18.219732 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 77/148] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:18.227213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:18.268163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c6bd-47fe-4dcb-92d4-2cf78032d036 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.268506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c6bd-47fe-4dcb-92d4-2cf78032d036 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.268721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c6bd-47fe-4dcb-92d4-2cf78032d036 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.270374 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 78/149] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:18.287467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e559d-cc24-4526-b6c7-ff24193d383a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.287771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e559d-cc24-4526-b6c7-ff24193d383a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.288032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e559d-cc24-4526-b6c7-ff24193d383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.339469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-747e559d-cc24-4526-b6c7-ff24193d383a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:18.341187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-747e559d-cc24-4526-b6c7-ff24193d383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:18.392394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:18.412717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc86347-5ca6-4280-967c-9614a03948c5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:18.476880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:18.477461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.477701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.478065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.479122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:18.480698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:18.533329 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 79/150] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 19:28:18.578322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35efa8-97c7-4448-956d-01a282a97044 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.578676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35efa8-97c7-4448-956d-01a282a97044 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.578967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35efa8-97c7-4448-956d-01a282a97044 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.580397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 80/151] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:18.585935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.586327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.586513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.600373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:18.605651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:18.606280 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 72/152] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:18 2022] POST /identity/v3/users => generated 283 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:18.607315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:18.707343 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 81/153] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:18.979471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.034074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.132321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeae4fd-3b72-4bd2-a333-d3805302c02a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.161377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:19.180764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c61b0c-763e-4e26-9597-afb79788b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.181726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c61b0c-763e-4e26-9597-afb79788b46f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.182113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c61b0c-763e-4e26-9597-afb79788b46f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.182394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c61b0c-763e-4e26-9597-afb79788b46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.189646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2dd4c-17f4-443a-8571-f9dddd695aed None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.198922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c61b0c-763e-4e26-9597-afb79788b46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e5c61b0c-763e-4e26-9597-afb79788b46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:19.205961 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:19.206866 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:19.207758 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 73/154] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:19.209039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e311c2b-cc45-43c3-bfc0-635fab075d94 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.209133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e311c2b-cc45-43c3-bfc0-635fab075d94 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.209472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e311c2b-cc45-43c3-bfc0-635fab075d94 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.210812 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 74/155] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:19.214214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e311c2b-cc45-43c3-bfc0-635fab075d94 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.242600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78f754-f48b-4c03-8e87-101f2b28c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.243192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f754-f48b-4c03-8e87-101f2b28c693 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.243462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f754-f48b-4c03-8e87-101f2b28c693 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.243737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f754-f48b-4c03-8e87-101f2b28c693 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.260640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78f754-f48b-4c03-8e87-101f2b28c693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-cd78f754-f48b-4c03-8e87-101f2b28c693 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:19.267331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:19.268913 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:19.269940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 82/156] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:19.271237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.271526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.271865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.298737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:19.300392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:19.302605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:19.366592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e311c2b-cc45-43c3-bfc0-635fab075d94 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.407427 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 83/157] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:19.408529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.417728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.418027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.418392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.418738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.419517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:19.419915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.422020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da39db-4e0f-406d-9942-645feccdcd13 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.433532 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 75/158] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:19.438408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cffc32-44fb-4085-8727-ef8880e62a92 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.438889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cffc32-44fb-4085-8727-ef8880e62a92 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.439300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cffc32-44fb-4085-8727-ef8880e62a92 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.440890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 76/159] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:19.441501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cffc32-44fb-4085-8727-ef8880e62a92 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.538649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:19.580381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b9e05-df49-4b37-9b16-f2a4d81cf441 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.605267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cffc32-44fb-4085-8727-ef8880e62a92 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.634878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.635504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.635782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.636049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.636725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:19.637027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.638481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c76c81-033c-425b-b296-82d6fb26f568 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.644894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:19.650012 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 84/160] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:19.651401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.651785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.652087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.662850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.663940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.664416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.664928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] PATH_INFO: `/v3/users/f70e7022229a4fab8fd47caffd01ba01` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.666528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] RBAC: Authorizing `identity:get_user(user_id=f70e7022229a4fab8fd47caffd01ba01)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.668309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.672558 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 77/161] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/users/f70e7022229a4fab8fd47caffd01ba01 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:19.674129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.677897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:19.677897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:19.763849 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 85/162] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:19.764854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.853746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dea17-2d80-4086-9305-fb6b7e99a709 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.879038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:19.897199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.897934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.898220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.898511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] PATH_INFO: `/v3/users/b89c949098924ec682a905589e3869f1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.899794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] RBAC: Authorizing `identity:get_user(user_id=b89c949098924ec682a905589e3869f1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.901260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.903098 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 78/163] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/users/b89c949098924ec682a905589e3869f1 => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:19.903800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.952830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dec11-f089-449e-b958-fd1b35cf9ba3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.974471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.023041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.024106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.024597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.025090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.026573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57773-e564-4288-9897-4e71055c7464 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.131561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.132158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.132478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.132750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.163235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:20.168463 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:20.169358 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:20.170161 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 79/164] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:20.171020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.214603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.216102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.318594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.416581 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 86/165] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:20.424645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.466472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8351d4-8f3d-461e-8619-9402ac9b6ae7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.492397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.516929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.517734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.518134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.518483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.520787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.522409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.525402 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 80/166] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:20.526905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.633709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc230-06d5-47fe-a7e0-ca14d4dcd360 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.675910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.676530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.676833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.677126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.677934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:20.678311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.679881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.690144 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 87/167] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:20.695892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.731923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.800025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13708-cece-4da6-80e6-d5f7c8c75e92 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.830901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2a29-afa6-45ed-acba-7145d4ba4bd7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.869490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.870608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.870913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.871235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.872443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.874446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.876276 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 88/168] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:20.881903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.910676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.911345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.911624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.911987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.955778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:20.961499 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:20.962422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:20.963643 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 81/169] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:20.969898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.998549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.013614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ff7cb-bdbf-4287-821a-136d8e3b6035 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.058187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.058957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.059252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.059833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/b89c949098924ec682a905589e3869f1/roles/bf350015327b4b8ba8a77ce752f17fab` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.063437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c04f173e384bb08ddae310e94f5bf6, user_id=b89c949098924ec682a905589e3869f1, role_id=bf350015327b4b8ba8a77ce752f17fab)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.066189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.097547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.161407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb3d8-f4b9-4aeb-999c-12055f0f3aa4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.169972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 89/170] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:20 2022] PUT /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/users/b89c949098924ec682a905589e3869f1/roles/bf350015327b4b8ba8a77ce752f17fab => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:21.171344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.249937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.250565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.250848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.251128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.255605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.258485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.262190 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 82/171] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:21.263218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.390060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddac3d7-3f38-41b4-a4bb-7d4ccae20af5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.440945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.441877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.442350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.443017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.445312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=f70e7022229a4fab8fd47caffd01ba01) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:21.445835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.448546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.461566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 90/172] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/role_assignments?user.id=f70e7022229a4fab8fd47caffd01ba01&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:21.466261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.507005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.511976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f828-bad2-49c8-91de-a58089ed395e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.547811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.607107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.608130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.609189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.609684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.610952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:21.611509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.614210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.623260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f1f9-6d6b-4d9e-ac68-9417811c947a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.637699 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 83/173] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:21.646978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.667631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.668634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.669185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.669671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.754376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.756268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.795365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.900885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b2bb7-9f47-40f9-bf20-9d254af6cfbe None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.910049 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 91/174] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:21.915145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.965008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.967019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.969733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.970227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] PATH_INFO: `/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.973628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1b6d22b0144e1f97b5ee9f7857fec8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.979125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.981155 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 84/175] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/users/5f1b6d22b0144e1f97b5ee9f7857fec8 => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:21.986944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.070191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63eb32e-7b8f-4433-8cfd-310de050accb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:22.080039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:22.092205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:22.117339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:22.118109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.118461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.118802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.120137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:22.121711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:22.125499 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 92/176] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:22.131704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.195267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220a7e7-7b3a-440e-a997-70a71aee26f0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:22.255707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95d87-bcd5-49f4-b6b0-d7d4f6676519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:22.256561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95d87-bcd5-49f4-b6b0-d7d4f6676519 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.257022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95d87-bcd5-49f4-b6b0-d7d4f6676519 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.257504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95d87-bcd5-49f4-b6b0-d7d4f6676519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.260797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c40f-ef47-4e3b-8956-bb25a8efb05e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:22.297242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:22.297880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.298295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.298571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.299412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] RBAC: Adding query filter params (role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=5f1b6d22b0144e1f97b5ee9f7857fec8) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:22.299730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:22.301201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b6f2-3f71-49db-b380-f7b865b31ef0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:22.307698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 93/177] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:22 2022] GET /identity/v3/role_assignments?user.id=5f1b6d22b0144e1f97b5ee9f7857fec8&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:22.308975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2748a2-a1b3-4c24-9f35-7fe0a4c2b7e3 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.309279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2748a2-a1b3-4c24-9f35-7fe0a4c2b7e3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.309561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2748a2-a1b3-4c24-9f35-7fe0a4c2b7e3 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.311077 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 94/178] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:22.312045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281847-580c-41d0-8d84-79792d910259 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.312324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281847-580c-41d0-8d84-79792d910259 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.312593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281847-580c-41d0-8d84-79792d910259 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.322045 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 95/179] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:22.322045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97436-b2ae-4547-bde6-db932ca57bdb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.322045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97436-b2ae-4547-bde6-db932ca57bdb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.322045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97436-b2ae-4547-bde6-db932ca57bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.354032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-54e97436-b2ae-4547-bde6-db932ca57bdb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:22.358967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54e97436-b2ae-4547-bde6-db932ca57bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:22.384880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db95d87-bcd5-49f4-b6b0-d7d4f6676519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:22.386515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db95d87-bcd5-49f4-b6b0-d7d4f6676519 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:22.448112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:22.466272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:22.483094 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 96/180] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:22.485096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f0c1-6b2a-46b5-a600-e7194c9e79a1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.485374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f0c1-6b2a-46b5-a600-e7194c9e79a1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.485642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f0c1-6b2a-46b5-a600-e7194c9e79a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.509216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0207f0c1-6b2a-46b5-a600-e7194c9e79a1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:22.510883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0207f0c1-6b2a-46b5-a600-e7194c9e79a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:22.605242 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 85/181] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:22.611330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a5bc0-7ae2-4d41-b0cf-e102e44b0735 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.611656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a5bc0-7ae2-4d41-b0cf-e102e44b0735 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.611903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a5bc0-7ae2-4d41-b0cf-e102e44b0735 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.613218 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 86/182] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:22.615648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a5bc0-7ae2-4d41-b0cf-e102e44b0735 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.617156 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 97/183] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:22.618888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.619171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.619445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.654696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:22.655920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:22.769585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a5bc0-7ae2-4d41-b0cf-e102e44b0735 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:22.812034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:22.812799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.813077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.813351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] PATH_INFO: `/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.822847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] RBAC: Authorizing `identity:get_project(project_id=8d47e4ab7d264c6e96ad2bd8585823ba)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:22.824504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:22.826543 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 87/184] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:22 2022] GET /identity/v3/projects/8d47e4ab7d264c6e96ad2bd8585823ba => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:22.827677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.830486 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 98/185] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:22.837427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.844683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:22.937242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:22.940530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ddc7d-3561-426b-8907-539a78249170 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:22.978084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:22.978956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.979382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.979826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.981124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:22.982766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:22.984582 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 88/186] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:22.990089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.078381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:23.099125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc30f-3145-4bba-a3a8-15b4ec71d172 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.099842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4961f-bfbc-4915-ac27-268a1f73d438 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.137979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.138866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.139294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.140287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.141111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:23.142746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:23.172313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.173069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.173245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.173474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.174234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=8d47e4ab7d264c6e96ad2bd8585823ba, user.id=5f1b6d22b0144e1f97b5ee9f7857fec8) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:23.174691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:23.176065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:23.182655 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 99/187] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:22 2022] GET /identity/v3/role_assignments?user.id=5f1b6d22b0144e1f97b5ee9f7857fec8&scope.project.id=8d47e4ab7d264c6e96ad2bd8585823ba&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:23.183315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.242821 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 89/188] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:22 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:28:23.244083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.314249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b20f9-fff0-4e62-b456-fdb8a31436fa None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.316189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:23.362940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.364002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.364352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.364691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.381150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:23.387088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:23.388816 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:23.391116 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 100/189] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:23.396182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.467341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fab9e-1905-48df-b5ff-8043e4ff3d5e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.526132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.526698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.526976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.527249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.531251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:23.541123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:23.547557 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:23.548604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:23.549400 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 90/190] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:23.554756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.565995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11342c-a3e6-4396-a5ed-c3c5c7cc1360 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.626661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.627413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.627904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.628388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.629155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:23.629630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:23.631830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:23.644638 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 101/191] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:23.652482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.697142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:23.708105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9467b21-9689-4069-842f-ea284284ef05 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.767538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.769003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.769291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.769570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.770333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:23.770956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:23.772679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:23.785910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 91/192] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:23.791488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.818753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b12a-ef4f-47a2-a1e4-af931fccfe0c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.878399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:23.878906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.880773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.881278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.882078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] PATH_INFO: `/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.904821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=8c26d2a2e6fc4421b4d99a0490dde9f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:23.907358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:23.909891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 102/193] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:23.916908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:23.939455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101c57-5967-4ea7-8c32-8ba065ef19d7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:24.005918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:24.006562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.006844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.007116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] PATH_INFO: `/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.009869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] RBAC: Authorizing `identity:get_user(user_id=8c26d2a2e6fc4421b4d99a0490dde9f7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:24.011335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:24.012988 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 92/194] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:24.033090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:24.079272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:24.124118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0aa1-d6ee-44e7-87fc-d19ecdc42bd1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:24.199959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37b75-9b05-44dd-9c0f-05a3e53b8621 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:24.220244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c00a4-2bb7-4dda-921e-849caa893c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:24.221206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c00a4-2bb7-4dda-921e-849caa893c53 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.221683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c00a4-2bb7-4dda-921e-849caa893c53 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.222178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c00a4-2bb7-4dda-921e-849caa893c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.234326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:24.244595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742044-b71b-45ee-8c84-8c3c9772b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:24.250412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742044-b71b-45ee-8c84-8c3c9772b86a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.250412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742044-b71b-45ee-8c84-8c3c9772b86a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.250412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742044-b71b-45ee-8c84-8c3c9772b86a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.311237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c00a4-2bb7-4dda-921e-849caa893c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:24.313828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c00a4-2bb7-4dda-921e-849caa893c53 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:24.346285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742044-b71b-45ee-8c84-8c3c9772b86a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:24.349891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742044-b71b-45ee-8c84-8c3c9772b86a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:24.440689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:24.467752 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 103/195] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:24.470071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed30f-1b5f-46e0-9308-79718837d337 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.470550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed30f-1b5f-46e0-9308-79718837d337 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.471001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed30f-1b5f-46e0-9308-79718837d337 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.472564 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 104/196] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:24.473720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fed30f-1b5f-46e0-9308-79718837d337 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:24.488670 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 93/197] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:24.494117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.494444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.494730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.515013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:24.516341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:24.541689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:24.596254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 94/198] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:24.597324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:24.607295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fed30f-1b5f-46e0-9308-79718837d337 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:24.646650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:24.647747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.648277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.648750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.650160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:24.651898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:24.653821 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 105/199] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:24 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:24.661523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:24.715181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254cce-aada-4f0f-84db-ca2938440ce8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:24.753717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:24.754406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.754683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.754956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.756222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:24.757776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:24.759970 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 95/200] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:24 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:24.767241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:24.806273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:24.807309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:24.892555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7df2-2800-4c74-bb1f-5adef0b164cb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:24.933381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:24.934253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:24.934539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:24.934814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:24.935566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] RBAC: Adding query filter params (role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=8c26d2a2e6fc4421b4d99a0490dde9f7) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:24.935879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:24.939662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:24.951123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 96/201] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:24 2022] GET /identity/v3/role_assignments?user.id=8c26d2a2e6fc4421b4d99a0490dde9f7&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:24.961349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b34f0-1f9f-4073-a5e7-54b5d8915722 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:25.011462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:25.023528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:25.024164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.024449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.024726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.025480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=8c26d2a2e6fc4421b4d99a0490dde9f7) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:25.025798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:25.027394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:25.042869 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 106/202] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:24 2022] GET /identity/v3/role_assignments?user.id=8c26d2a2e6fc4421b4d99a0490dde9f7&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:25.170326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:25.190986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef913f0c-0ceb-40af-8cd2-48a201a44a14 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:25.255896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:25.256580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.256864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.257138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.283151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:25.288422 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:25.289357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:25.290157 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 97/203] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:25.296182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:25.454631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4921-1dec-49ae-b1ce-88862f5bc5e0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:25.478989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:25.507515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:25.508291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.508576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.508856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.510367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:25.510748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:25.512341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:25.527284 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 107/204] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:25.536696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:25.742409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fed5e-41db-457f-b2ba-7e2339c92bfa None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:25.797721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac575ae-caf6-4b86-8136-924045381ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:25.798414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac575ae-caf6-4b86-8136-924045381ceb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.798701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac575ae-caf6-4b86-8136-924045381ceb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.798983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac575ae-caf6-4b86-8136-924045381ceb None admin] PATH_INFO: `/v3/users/b89c949098924ec682a905589e3869f1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.802720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac575ae-caf6-4b86-8136-924045381ceb None admin] RBAC: Authorizing `identity:get_user(user_id=b89c949098924ec682a905589e3869f1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:25.804323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac575ae-caf6-4b86-8136-924045381ceb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:25.806056 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 98/205] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:25 2022] GET /identity/v3/users/b89c949098924ec682a905589e3869f1 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:25.812507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:25.963775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a5bf1-f032-4470-a1cb-92159a211d81 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.964065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a5bf1-f032-4470-a1cb-92159a211d81 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.964375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a5bf1-f032-4470-a1cb-92159a211d81 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.966177 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 99/206] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:25.974867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8f39-2a8f-4129-b054-84f6797eb3df None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.975367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8f39-2a8f-4129-b054-84f6797eb3df None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.975884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8f39-2a8f-4129-b054-84f6797eb3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.988276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4c9e-fa3b-4018-8fdc-6e616ab3dc10 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:26.001948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1a2e8f39-2a8f-4129-b054-84f6797eb3df None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:26.003924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1a2e8f39-2a8f-4129-b054-84f6797eb3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:26.020126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:26.039480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:26.040104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.040385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.040660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.093364 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 100/207] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:26.095216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540124a-6fe0-45bc-ac09-03032f1af57c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.095703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540124a-6fe0-45bc-ac09-03032f1af57c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.096239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540124a-6fe0-45bc-ac09-03032f1af57c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.097725 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 101/208] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:26.104970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.106427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.107290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.137253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:26.147140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:26.148443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:26.188698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:26.190241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:26.308113 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 102/209] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:26.324894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 108/210] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:26.331861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:26.452115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:26.469546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:26.481908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84979f-629e-49af-b5e0-83d0ff638aa3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:26.557647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:26.558873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.560279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.560718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.563858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:26.565683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:26.569528 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 103/211] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:26 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:26.576052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:26.627160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:26.655949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0cb14-acf5-40be-8e43-141a6353bab7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:26.711025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:26.711971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.712400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.712845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.714194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:26.715854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:26.718972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 109/212] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:26.720542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:26.745971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47895c1-a39a-49a9-b8bc-0b60635951f9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:26.784003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:26.784772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.785165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.785536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.786400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] RBAC: Adding query filter params (role.id=bf350015327b4b8ba8a77ce752f17fab, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6, user.id=b89c949098924ec682a905589e3869f1) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:26.786804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:26.788344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:26.795278 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 104/213] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:26 2022] GET /identity/v3/role_assignments?user.id=b89c949098924ec682a905589e3869f1&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=bf350015327b4b8ba8a77ce752f17fab => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:26.796217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:26.810538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:26.842237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a6fa-fc32-4c04-a429-c8ac4abb8279 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:26.885069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:26.886073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:26.886515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:26.886982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:26.899738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:26.905603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:26.906601 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:26.907366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:26.909917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 110/214] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:26.919983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:26.929465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:26.992937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b04d-b21d-48a0-a9e8-5de30bf741ac None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.051827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.053405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.053975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.054504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.055441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.057422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.117297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59155-03c5-4f81-93a0-ae62b47d78a8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.178123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 105/215] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:26 2022] POST /identity/v3/users => generated 297 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:27.182994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.183690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.184024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.184405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.185274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:27.185610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.187802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.200326 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 111/216] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:27.207262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.298043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:27.346194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782a92f-a538-460b-9025-4a0bec312cb4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.413429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13745d7-7f04-46e3-96d2-135111ac4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.414112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13745d7-7f04-46e3-96d2-135111ac4f81 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.414478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13745d7-7f04-46e3-96d2-135111ac4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.417311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13745d7-7f04-46e3-96d2-135111ac4f81 None admin] PATH_INFO: `/v3/users/0a9447c0aae9468d8f175a95894134f1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.436823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13745d7-7f04-46e3-96d2-135111ac4f81 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9447c0aae9468d8f175a95894134f1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.438528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13745d7-7f04-46e3-96d2-135111ac4f81 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.440291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 106/217] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:27 2022] GET /identity/v3/users/0a9447c0aae9468d8f175a95894134f1 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:27.446229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.548881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:27.551810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5715-8455-4a7d-8c27-ddc8de303480 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.552114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5715-8455-4a7d-8c27-ddc8de303480 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.552355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5715-8455-4a7d-8c27-ddc8de303480 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.554125 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 107/218] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:27.562704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349985-5cd5-4d67-af7e-19bf780b57d3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.562974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349985-5cd5-4d67-af7e-19bf780b57d3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.563281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349985-5cd5-4d67-af7e-19bf780b57d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.587650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-68349985-5cd5-4d67-af7e-19bf780b57d3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:27.588892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68349985-5cd5-4d67-af7e-19bf780b57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:27.616934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da09b6-5757-4656-ae19-1b8a7b5f2793 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.685229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.685484 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 108/219] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:27.686182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.686182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.686540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.699312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61944db-4e0b-4e51-a536-b3209db06bac None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.699804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61944db-4e0b-4e51-a536-b3209db06bac None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.700258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61944db-4e0b-4e51-a536-b3209db06bac None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.704143 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 109/220] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:27.712801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.713077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.713545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.746614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:27.748661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:27.791988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.794376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.843944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:27.894634 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 110/221] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:27.926243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:27.978777 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 112/222] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:27.989100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:28.180954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660dbcf-9d46-4203-8724-0fc53bbfd0c6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:28.183528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:28.227253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:28.228332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:28.228883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:28.229291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:28.231749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:28.234883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:28.236734 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 111/223] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:27 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:28.247047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:28.357905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:28.442601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c808f5-4725-4ec2-aed4-fbe3b326293a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:28.464327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0b447-abd9-4f1e-908d-3479576897d4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:28.490557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:28.491145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:28.491424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:28.491748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:28.492780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=0a9447c0aae9468d8f175a95894134f1) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:28.493116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:28.495367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:28.502470 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 112/224] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:28 2022] GET /identity/v3/role_assignments?user.id=0a9447c0aae9468d8f175a95894134f1&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:28.503310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:28.558222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:28.559233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:28.559672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:28.560093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:28.601158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:28.606549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:28.611974 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 113/225] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:28.619733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:28.701191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:28.747507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c234-9bb4-40d2-a738-d0b9d8ebddf0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:28.781157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:28.828025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:28.828778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:28.829061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:28.829331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:28.844352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8c0a-56f7-48a4-8f82-4e305894943c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:28.846939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:28.852915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:28.854550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:28.856065 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 113/226] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:28.869110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:28.931897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:28.932705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:28.932819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:28.933132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:28.934098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:28.934646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:28.936731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:28.960312 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 114/227] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:28.970268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.071230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b6d25-9396-4f8c-9736-9579c51321db None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.131306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.131932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.132213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.132480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.133158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:29.133461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.135225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.150031 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 114/228] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:29.156293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.174974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:29.200354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:29.205244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07c506-ef92-4c31-84f7-cd87436293e5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.286922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.287777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.288055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.288329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] PATH_INFO: `/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.290751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] RBAC: Authorizing `identity:get_user(user_id=8c26d2a2e6fc4421b4d99a0490dde9f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.292218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.294014 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 115/229] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:28 2022] GET /identity/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:29.306050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.332827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd32f-2d7e-4210-8825-351fa58b0807 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.431898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.433102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.434485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.435585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] PATH_INFO: `/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.438742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] RBAC: Authorizing `identity:get_user(user_id=8c26d2a2e6fc4421b4d99a0490dde9f7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.440560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.443971 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 115/230] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:29 2022] GET /identity/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:29.448612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.527508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0010-2e44-48c9-a592-4f92965b47d8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.614262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.615836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.618190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.619216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.626322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.630821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.641317 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 116/231] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:29 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:29.646273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.695616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf66ec1-e23a-4774-8076-61c2a6b7e110 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.699694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:29.744078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:29.766624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.767286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.767572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.767852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.771645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.779094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.782631 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 116/232] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:29 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:29.791040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.903321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258b5d-43cc-4abf-b531-01a20150f3dc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.944977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ae584-7873-4113-926a-83ba721f3fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.946701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ae584-7873-4113-926a-83ba721f3fd9 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.947327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ae584-7873-4113-926a-83ba721f3fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.948155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ae584-7873-4113-926a-83ba721f3fd9 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/8c26d2a2e6fc4421b4d99a0490dde9f7/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.951015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ae584-7873-4113-926a-83ba721f3fd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f49ed0e2e9471bb19d16f6c439a516, user_id=8c26d2a2e6fc4421b4d99a0490dde9f7, role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.953592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ae584-7873-4113-926a-83ba721f3fd9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:30.021406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef367a-9750-490c-a2fa-ff2ca7af9bef None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:30.086070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431fd63-5700-41e7-b7eb-19da80030367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:30.087259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fd63-5700-41e7-b7eb-19da80030367 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:30.087743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fd63-5700-41e7-b7eb-19da80030367 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:30.088226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fd63-5700-41e7-b7eb-19da80030367 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/8c26d2a2e6fc4421b4d99a0490dde9f7/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:30.092039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431fd63-5700-41e7-b7eb-19da80030367 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f49ed0e2e9471bb19d16f6c439a516, user_id=8c26d2a2e6fc4421b4d99a0490dde9f7, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:30.095640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431fd63-5700-41e7-b7eb-19da80030367 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:30.098217 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 117/233] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:29 2022] PUT /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/8c26d2a2e6fc4421b4d99a0490dde9f7/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:30.200557 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 117/234] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:29 2022] PUT /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/8c26d2a2e6fc4421b4d99a0490dde9f7/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:30.468021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3705a-87ed-4040-8448-08db0adecacd None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:30.468263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3705a-87ed-4040-8448-08db0adecacd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:30.468612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3705a-87ed-4040-8448-08db0adecacd None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:30.470386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 118/235] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:30.479161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:30.480095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:30.480836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:30.491414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860180-9db9-45e1-b1dd-bda55471c36f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:30.492283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860180-9db9-45e1-b1dd-bda55471c36f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:30.492970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860180-9db9-45e1-b1dd-bda55471c36f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:30.496029 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 119/236] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:30.510986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:30.511620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:30.512090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:30.516806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:30.517577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:30.552178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:30.559392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:30.562442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:30.680006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 118/237] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:30.755831 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 120/238] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:31.042809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:31.212479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b9035-2674-40bc-9d97-426015c26dff None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:31.270124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca48ef-bf41-4516-9fa3-b0210f1e0212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:31.271146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca48ef-bf41-4516-9fa3-b0210f1e0212 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:31.271582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca48ef-bf41-4516-9fa3-b0210f1e0212 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:31.271992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca48ef-bf41-4516-9fa3-b0210f1e0212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:31.273637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca48ef-bf41-4516-9fa3-b0210f1e0212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:31.276029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca48ef-bf41-4516-9fa3-b0210f1e0212 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:31.278781 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 119/239] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:31.287008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:31.317947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:31.320181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f137-c02f-4b91-a2a8-09252c6e57d6 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:31.320655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f137-c02f-4b91-a2a8-09252c6e57d6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:31.321445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f137-c02f-4b91-a2a8-09252c6e57d6 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:31.323919 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 120/240] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:31.331820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:31.335903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:31.335903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:31.371946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:31.375211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:31.427899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:31.490411 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 121/241] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:31.496959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:31.552689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4236-5e49-456d-9ddd-38588efa53c6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:31.618515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:31.619050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:31.619327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:31.619607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:31.620277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:31.621782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:31.696952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404b5f-d0ae-439f-bad3-b3d18c4f2f1f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:31.743414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:31.744084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:31.744367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:31.744643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:31.753490 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 121/242] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:31 2022] POST /identity/v3/users => generated 293 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:31.767653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:31.772896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:31.774913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:31.776865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 122/243] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:31.787295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:31.934516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:31.965939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9656-4c64-480a-b565-f802e20457e1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.010674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.011479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.011769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.012061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.012732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:32.013050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:32.015529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:32.026571 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 122/244] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:32.035715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:32.108169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:32.116877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:32.263992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74c96-d23c-446c-91a4-ff3a5a299353 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.279909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8554b4-a5c5-4058-bdd5-25cbc483981c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.323562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.324707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.325195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.325746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] PATH_INFO: `/v3/users/859d7b4f9e024b11b0211eb05fceeb79` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.334637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:32.344625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.347540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.356782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] RBAC: Authorizing `identity:get_user(user_id=859d7b4f9e024b11b0211eb05fceeb79)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:32.356782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:32.356782 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 123/245] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:32 2022] GET /identity/v3/users/859d7b4f9e024b11b0211eb05fceeb79 => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:32.357563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.357563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.361240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:32.378463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:32.386483 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:32.387610 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:32.388463 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:32.392687 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 123/246] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:32.402145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:32.503294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:32.538855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14eef0-7aa8-470a-a9b3-870fe44e4188 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.569014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a2f5b-4119-4fbf-a9b4-78f1c0f72d53 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.590150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.591243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.591522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.591800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.632440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.633197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.633564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.633864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.634908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:32.635216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:32.636879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab6491-7d1d-43b9-8806-4b470f502362 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:32.649135 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 124/247] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:32.652639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d44e-ea2c-43ee-9a31-b3b5507a515d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.652915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d44e-ea2c-43ee-9a31-b3b5507a515d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.653181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d44e-ea2c-43ee-9a31-b3b5507a515d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.654600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 125/248] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:32.655920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d44e-ea2c-43ee-9a31-b3b5507a515d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:32.714119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:32.717661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:32.738045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:32.816812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d44e-ea2c-43ee-9a31-b3b5507a515d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.858846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:32.864713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd52fb2-14d9-42d9-ae8e-353cdd873935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.865687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52fb2-14d9-42d9-ae8e-353cdd873935 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.865973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52fb2-14d9-42d9-ae8e-353cdd873935 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.866246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52fb2-14d9-42d9-ae8e-353cdd873935 None admin] PATH_INFO: `/v3/users/0a9447c0aae9468d8f175a95894134f1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.867631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52fb2-14d9-42d9-ae8e-353cdd873935 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9447c0aae9468d8f175a95894134f1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:32.869890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52fb2-14d9-42d9-ae8e-353cdd873935 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:32.872729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 126/249] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:32 2022] GET /identity/v3/users/0a9447c0aae9468d8f175a95894134f1 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:32.874299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.876930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.876930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.884954 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 124/250] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:32.886046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:32.913125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:32.914755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:33.030408 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 127/251] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:33.031285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:33.121281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca15-a601-4b95-ae0e-87a23699d5e2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:33.140142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:33.182329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b13eb-396f-4e71-b19e-e862eedad8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:33.182977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b13eb-396f-4e71-b19e-e862eedad8a0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.183255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b13eb-396f-4e71-b19e-e862eedad8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.183523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b13eb-396f-4e71-b19e-e862eedad8a0 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.184769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b13eb-396f-4e71-b19e-e862eedad8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:33.186890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b13eb-396f-4e71-b19e-e862eedad8a0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:33.188824 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 125/252] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:32 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:33.190044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f3bf-5f7a-4793-a9c1-2b1ef0566e98 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.190339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f3bf-5f7a-4793-a9c1-2b1ef0566e98 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.190621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f3bf-5f7a-4793-a9c1-2b1ef0566e98 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.192359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 126/253] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:33.200399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.200851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.201307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.223065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d38ff-4060-442a-b39c-b1551a99e52f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:33.234377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:33.235678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:33.286349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:33.312866 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 127/254] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:33.313553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:33.338762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:33.340135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.340602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.341059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.343157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:33.344863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:33.351102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 128/255] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:33 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:33.359048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:33.452693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb43d4-4b88-4ff7-84f0-8424a3f624ba None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:33.498123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:33.498123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.498123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.498123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/0a9447c0aae9468d8f175a95894134f1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.498576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f49ed0e2e9471bb19d16f6c439a516, user_id=0a9447c0aae9468d8f175a95894134f1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:33.498576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:33.550193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d893-47bd-4a06-afe2-2bfc730bfa58 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:33.561819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 128/256] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:33 2022] PUT /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/0a9447c0aae9468d8f175a95894134f1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:33.567532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:33.577374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:33.597602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:33.598871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.599452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.600016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.601142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] RBAC: Adding query filter params (role.id=bf350015327b4b8ba8a77ce752f17fab, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=859d7b4f9e024b11b0211eb05fceeb79) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:33.601736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:33.604021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:33.612800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 129/257] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:33 2022] GET /identity/v3/role_assignments?user.id=859d7b4f9e024b11b0211eb05fceeb79&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=bf350015327b4b8ba8a77ce752f17fab => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:33.667447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:33.767506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4425f2-3736-4c6f-9bbf-e4beaae5e973 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:33.817807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:33.818590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:33.818875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:33.819151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:33.831894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:33.836932 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:33.837883 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:33.838810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 129/258] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:33.844547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:33.925778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:34.058946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0773-1903-4cf8-afd6-3039e85dbe4e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:34.142265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:34.152156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:34.152714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:34.152997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:34.153271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:34.154062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3f71-5e4a-4c53-9aec-da30ec5ceef8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:34.156639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:34.156965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:34.158416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:34.182008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 130/259] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:34.189530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:34.236665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:34.237441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:34.237726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:34.238076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:34.265542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:34.277930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:34.278964 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:34.280508 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 130/260] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:34.284980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:34.298678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:34.371273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdd79a-4fec-43ae-b159-ce0d51a243d9 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:34.461788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:34.462951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:34.463468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:34.463974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] PATH_INFO: `/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:34.468164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] RBAC: Authorizing `identity:get_user(user_id=8c26d2a2e6fc4421b4d99a0490dde9f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:34.470749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:34.477354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 131/261] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:34 2022] GET /identity/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:34.499392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:34.565480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49a8a8-fea4-492c-a919-06a7517e874b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:34.688557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:34.689568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:34.690083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:34.690558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:34.692201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:34.692833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:34.699293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:34.719676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 131/262] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:34.725367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:34.763359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:34.889927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf0888-94e7-4aff-9b9e-ce2efd7a3792 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:34.971161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:34.971381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d49a-b26c-4c79-b8fe-9429081f2506 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:35.024195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:35.025197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.025834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.031502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] PATH_INFO: `/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.031502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] RBAC: Authorizing `identity:get_user(user_id=8c26d2a2e6fc4421b4d99a0490dde9f7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:35.031502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:35.031502 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 132/263] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:34 2022] GET /identity/v3/users/8c26d2a2e6fc4421b4d99a0490dde9f7 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:35.037507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:35.050677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08129b-8334-467b-a8b3-a4faebd824e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:35.051723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08129b-8334-467b-a8b3-a4faebd824e2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.052220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08129b-8334-467b-a8b3-a4faebd824e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.052704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08129b-8334-467b-a8b3-a4faebd824e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.260656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:35.289658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c54be-dd99-4f59-aecc-7d5fce2bdc1b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:35.340008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:35.340806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.341182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.341464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.363281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08129b-8334-467b-a8b3-a4faebd824e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:35.366107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08129b-8334-467b-a8b3-a4faebd824e2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:35.440771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:35.442298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:35.548583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:35.568317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 133/264] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:35.575176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:35.670804 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 132/265] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1172 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:28:35.672979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ebd0-77c1-4241-9dc1-46ca67feb042 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.673467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ebd0-77c1-4241-9dc1-46ca67feb042 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.673992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ebd0-77c1-4241-9dc1-46ca67feb042 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.676595 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 133/266] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:35.681674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ebd0-77c1-4241-9dc1-46ca67feb042 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:35.721294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:35.723078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d446-e0c3-4ca6-bbff-bc6f4df5902e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:35.803807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e4eb6-c186-4439-af6d-6d4aca2374cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:35.804508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4eb6-c186-4439-af6d-6d4aca2374cd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.804792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4eb6-c186-4439-af6d-6d4aca2374cd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.805063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4eb6-c186-4439-af6d-6d4aca2374cd None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.807436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e4eb6-c186-4439-af6d-6d4aca2374cd None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:35.808893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e4eb6-c186-4439-af6d-6d4aca2374cd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:35.812908 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 134/267] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:35 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:35.815545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.818180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.818626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.862004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:35.864082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:35.878629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ebd0-77c1-4241-9dc1-46ca67feb042 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:35.957889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:35.958542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:35.958820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:35.959093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:35.962054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:35.963202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:35.964894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:35.966710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 134/268] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:35 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:35.972634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:36.014754 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 135/269] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:36.016182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:36.086812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:36.105267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca5a1c-8154-4212-8bbc-25877ba34cb4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:36.177240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:36.177963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:36.178307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:36.178584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:36.179396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] RBAC: Adding query filter params (role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=8c26d2a2e6fc4421b4d99a0490dde9f7) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:36.179711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:36.181444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d1f7b-ef76-4674-ba77-293990da78fa None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:36.195629 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 135/270] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:35 2022] GET /identity/v3/role_assignments?user.id=8c26d2a2e6fc4421b4d99a0490dde9f7&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:36.197645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276be5-f169-47e9-95c7-4800ef925de0 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:36.197987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276be5-f169-47e9-95c7-4800ef925de0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:36.198240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276be5-f169-47e9-95c7-4800ef925de0 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:36.201988 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 136/271] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:36.208053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:36.208495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:36.208968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:36.249740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:36.251618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:36.342294 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 137/272] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:36.410106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb6e78-274a-47bd-a21e-fbca66212d3c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:36.494155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:36.495209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:36.495703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:36.496263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:36.497647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=8c26d2a2e6fc4421b4d99a0490dde9f7) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:36.498289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:36.501282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:36.513551 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 136/273] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:36 2022] GET /identity/v3/role_assignments?user.id=8c26d2a2e6fc4421b4d99a0490dde9f7&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:36.581681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:36.719641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:36.746480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888605b1-4ce5-4c55-ac49-d79963e15f70 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:36.799860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:36.800516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:36.800802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:36.801061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:36.802644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:36.804168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:36.806306 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 138/274] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:36.812277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:36.929233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:37.017284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.031894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547982ac-eef8-46c7-b740-174680ca4a2b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.093149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.094729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.095512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.096543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.098181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:37.101111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:37.229892 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 137/275] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:28:36 2022] POST /identity/v3/users => generated 293 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:37.253284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bb34e-546a-4dc3-b74f-38ea4d0c4fb7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.324108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d4cf-9b83-48a5-a32c-1af0ee1ba5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.324855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d4cf-9b83-48a5-a32c-1af0ee1ba5b7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.325183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d4cf-9b83-48a5-a32c-1af0ee1ba5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.325476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d4cf-9b83-48a5-a32c-1af0ee1ba5b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.343135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d4cf-9b83-48a5-a32c-1af0ee1ba5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-f515d4cf-9b83-48a5-a32c-1af0ee1ba5b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:37.349498 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:37.350566 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:37.351388 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:37.352190 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 139/276] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:37.360477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.409091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209c732-7a07-4f44-b2c7-083c562a5dd8 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.409519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209c732-7a07-4f44-b2c7-083c562a5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.410009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209c732-7a07-4f44-b2c7-083c562a5dd8 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.411947 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 140/277] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:37.417807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.418173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.418380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.428829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:37.441310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:37.442975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:37.501204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b412a-b669-466c-9f89-05948d10f04c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.505417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:37.544389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 141/278] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:37.553439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.554172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.554456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.554728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.555415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:37.555719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:37.557233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:37.567679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 138/279] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:37.573319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.695627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86adf12-7776-43e1-8d3c-f32cc94e403e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.734480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.735226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.735417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.735695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] PATH_INFO: `/v3/users/2460c373e8224352b78b23f09d4e4aaf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.737893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:37.753311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] RBAC: Authorizing `identity:get_user(user_id=2460c373e8224352b78b23f09d4e4aaf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:37.755493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:37.758286 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 142/280] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/users/2460c373e8224352b78b23f09d4e4aaf => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:37.765018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.823665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.921029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aaf3b-1aa9-4b6c-99be-3888b051bc70 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.975016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.975803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.976219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.976632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.977772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, user.id=2460c373e8224352b78b23f09d4e4aaf, scope.system=all) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:37.978397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:37.980901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb925-2b67-43bf-b519-fc5f0ffe5cc7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:37.990367 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 139/281] 10.222.0.78 () {56 vars in 1308 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/role_assignments?user.id=2460c373e8224352b78b23f09d4e4aaf&scope.system=all&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:37.992475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539529-7a75-4822-951a-5c26745d279f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.992908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539529-7a75-4822-951a-5c26745d279f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.993321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539529-7a75-4822-951a-5c26745d279f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.995641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 140/282] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:37.998201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc945-8f93-41d3-bcb1-f3afcc70613f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:38.004185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:38.004615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:38.005030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:38.046525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:38.050998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:38.091582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:38.092990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:38.093274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:38.093657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:38.108668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:38.118241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:38.126253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:38.127218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:38.128000 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 143/283] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:38.134525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:38.226581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:38.244644 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 141/284] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:38.311880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2c29-e268-4d3a-8def-cf2fcf08e7c0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:38.376259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:38.376908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:38.377189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:38.377467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:38.378207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:38.378519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:38.380081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:38.393804 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 144/285] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:38.400913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:38.563020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:38.640271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705064a1-534b-469c-8c22-6b5024b3ffd1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:38.681191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:38.681927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:38.682307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:38.682618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] PATH_INFO: `/v3/users/0a9447c0aae9468d8f175a95894134f1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:38.683850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] RBAC: Authorizing `identity:get_user(user_id=0a9447c0aae9468d8f175a95894134f1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:38.685564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:38.688215 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 142/286] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:38 2022] GET /identity/v3/users/0a9447c0aae9468d8f175a95894134f1 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:38.695870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:38.759586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:38.762741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a33453-9d49-445c-aea8-667bbf7f40be None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:38.790835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:38.844711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:38.845272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:38.845555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:38.845833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:38.867950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618680a1-ec6b-493c-964d-6fe7637011ba None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:38.882011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:38.888302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:38.889240 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:38.890137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:38.898081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 145/287] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:38.900663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:38.921427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:38.922794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:38.923266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:38.923736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:39.056649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:39.058631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:39.103840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:39.199132 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 143/288] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:39.207408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:39.230970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4bcb1-b570-4b2d-8721-9e8ceb30aaea None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:39.336902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89590e6d-3eb9-4a59-bb5a-4941bfe1b604 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:39.338665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:39.339529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:39.340014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:39.340483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:39.341339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:39.341928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:39.344161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:39.364601 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 146/289] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:39.371344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:39.427834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:39.445570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:39.446270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:39.448738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:39.449014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:39.452583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:39.453109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:39.453227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:39.460077 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 144/290] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:39 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:39.466465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:39.620230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e78e-7b56-4175-b2de-33f199f8cec3 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:39.664358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:39.665590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:39.666116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:39.666618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] PATH_INFO: `/v3/users/859d7b4f9e024b11b0211eb05fceeb79` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:39.668080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] RBAC: Authorizing `identity:get_user(user_id=859d7b4f9e024b11b0211eb05fceeb79)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:39.669759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:39.677901 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 147/291] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:39 2022] GET /identity/v3/users/859d7b4f9e024b11b0211eb05fceeb79 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:39.679551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:39.706569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb680d-8be3-4125-83ad-c0486d7a774c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:39.769181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:39.770218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:39.770698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:39.771169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:39.772118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=0a9447c0aae9468d8f175a95894134f1) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:39.772643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:39.774399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:39.781308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 145/292] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:39 2022] GET /identity/v3/role_assignments?user.id=0a9447c0aae9468d8f175a95894134f1&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:39.908329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcb430-727c-48af-aa8b-231b99df7e55 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:39.914248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:39.995213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0b9b-1f09-4f5e-a650-dedffd1cd65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:39.996221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0b9b-1f09-4f5e-a650-dedffd1cd65b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:39.996676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0b9b-1f09-4f5e-a650-dedffd1cd65b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:39.997164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0b9b-1f09-4f5e-a650-dedffd1cd65b None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.000906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0b9b-1f09-4f5e-a650-dedffd1cd65b None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:40.003725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0b9b-1f09-4f5e-a650-dedffd1cd65b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:40.007322 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 148/293] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:39 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:40.013795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:40.129645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:40.178196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528891-579b-42bf-b621-69a31f64bfa4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:40.223093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786b542-9639-44f7-81a6-d0a9336ae6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:40.224148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786b542-9639-44f7-81a6-d0a9336ae6cb None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.224682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786b542-9639-44f7-81a6-d0a9336ae6cb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.225273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786b542-9639-44f7-81a6-d0a9336ae6cb None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/859d7b4f9e024b11b0211eb05fceeb79/roles/bf350015327b4b8ba8a77ce752f17fab` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.229051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786b542-9639-44f7-81a6-d0a9336ae6cb None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f49ed0e2e9471bb19d16f6c439a516, user_id=859d7b4f9e024b11b0211eb05fceeb79, role_id=bf350015327b4b8ba8a77ce752f17fab)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:40.231001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786b542-9639-44f7-81a6-d0a9336ae6cb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:40.331355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 146/294] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:28:40 2022] PUT /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/users/859d7b4f9e024b11b0211eb05fceeb79/roles/bf350015327b4b8ba8a77ce752f17fab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:28:40.355923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb956-024c-4e05-9fa9-d5f59123bd6f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.356444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb956-024c-4e05-9fa9-d5f59123bd6f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.356896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb956-024c-4e05-9fa9-d5f59123bd6f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.360042 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 149/295] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:40.366101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc32a-26a8-4498-a19f-40dee9cfc19d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.366387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc32a-26a8-4498-a19f-40dee9cfc19d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.366666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc32a-26a8-4498-a19f-40dee9cfc19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.391801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a3bbc32a-26a8-4498-a19f-40dee9cfc19d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:40.393380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a3bbc32a-26a8-4498-a19f-40dee9cfc19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:40.489897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 147/296] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:40.769258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb956-024c-4e05-9fa9-d5f59123bd6f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:40.847380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85a70-2130-4ab1-ba17-76d81c2cff7f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.848128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85a70-2130-4ab1-ba17-76d81c2cff7f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.848717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85a70-2130-4ab1-ba17-76d81c2cff7f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.852159 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 148/297] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:40.856932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2223-f269-4868-a74f-0947e97c783e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.857559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2223-f269-4868-a74f-0947e97c783e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.858068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2223-f269-4868-a74f-0947e97c783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.879905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6f2d2223-f269-4868-a74f-0947e97c783e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:40.881622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f2d2223-f269-4868-a74f-0947e97c783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:40.890275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb956-024c-4e05-9fa9-d5f59123bd6f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:40.930386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:40.931038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.931284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.931719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.944239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:40.944730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:40.950121 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:40.951012 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:40.952346 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:40.954708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 150/298] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:40.960174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:40.975285 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 149/299] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:40.995808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:41.035511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f201-a6ca-4011-b9f5-65bd8afb6a78 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.036408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f201-a6ca-4011-b9f5-65bd8afb6a78 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.036861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f201-a6ca-4011-b9f5-65bd8afb6a78 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.038595 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 150/300] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:41.044535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.045108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.045555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.071562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:41.074181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:41.092941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b209-788c-4659-8dc7-3b24bc0a2272 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.149698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.150780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.151304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.151831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.152668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:41.153259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:41.155093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:41.169716 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 151/301] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:41.171103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.176893 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 151/302] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:41.272087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.298296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:41.306607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86699de-09b1-4bb1-8693-703b9a054a5e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.348161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.348869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.349156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.349440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] PATH_INFO: `/v3/users/80022ab292f04a9598b22a1cc008958a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.365164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] RBAC: Authorizing `identity:get_user(user_id=80022ab292f04a9598b22a1cc008958a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:41.367035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:41.368714 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 152/303] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:41 2022] GET /identity/v3/users/80022ab292f04a9598b22a1cc008958a => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:41.374802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.394280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c491ebf-70d9-416d-a3b7-bbb3a3abebd4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.408227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:41.437895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.438731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.439163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.439496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.440881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:41.442564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:41.445316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 152/304] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:41.450925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.554536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28fdf2-118a-4314-b304-884a5791eefa None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.618217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.619340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.619830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.620316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.621707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] RBAC: Adding query filter params (role.id=bf350015327b4b8ba8a77ce752f17fab, user.id=80022ab292f04a9598b22a1cc008958a, scope.system=all) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:41.622287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:41.625448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:41.635652 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 153/305] 10.222.0.78 () {56 vars in 1308 bytes} [Sun Aug 28 19:28:41 2022] GET /identity/v3/role_assignments?user.id=80022ab292f04a9598b22a1cc008958a&scope.system=all&role.id=bf350015327b4b8ba8a77ce752f17fab => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:41.637238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.664436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc71fa-7376-4c16-9520-4b94c22c4acc None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.676026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:41.793041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.797799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.798361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.798826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] PATH_INFO: `/v3/groups` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.800140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:41.814798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:41.836698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd16721-9896-4c61-b99a-2d86475ff38d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.887666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.888377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.889304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.889826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.902037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:41.908292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:41.910053 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:41.911683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 154/306] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:41.922195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.941159 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 153/307] 10.222.0.78 () {60 vars in 1134 bytes} [Sun Aug 28 19:28:41 2022] POST /identity/v3/groups => generated 229 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:42.106365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:42.125628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fb734-9ffa-432a-a4b2-ba8eee75ae37 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:42.175044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:42.175684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:42.175967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:42.176245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:42.176939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:42.177684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:42.180006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:42.192691 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 155/308] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:42.199552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:42.249037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:42.338305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357be13-6cac-47ec-b70f-1e7da6f9403f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:42.379698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60516fb3-4e26-49d9-9a71-6932d6687917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:42.380248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60516fb3-4e26-49d9-9a71-6932d6687917 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:42.380536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60516fb3-4e26-49d9-9a71-6932d6687917 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:42.380808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60516fb3-4e26-49d9-9a71-6932d6687917 None admin] PATH_INFO: `/v3/users/2460c373e8224352b78b23f09d4e4aaf` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:42.382093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60516fb3-4e26-49d9-9a71-6932d6687917 None admin] RBAC: Authorizing `identity:get_user(user_id=2460c373e8224352b78b23f09d4e4aaf)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:42.384143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60516fb3-4e26-49d9-9a71-6932d6687917 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:42.386174 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 154/309] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:42 2022] GET /identity/v3/users/2460c373e8224352b78b23f09d4e4aaf => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:42.395577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:42.584203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f00f7-a3f3-4df0-9eb0-472436206bb6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:42.649316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319b2c7-43fe-4902-9dcf-78900302e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:42.649948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b2c7-43fe-4902-9dcf-78900302e239 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:42.650299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b2c7-43fe-4902-9dcf-78900302e239 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:42.650576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b2c7-43fe-4902-9dcf-78900302e239 None admin] PATH_INFO: `/v3/system/users/2460c373e8224352b78b23f09d4e4aaf/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:42.653126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319b2c7-43fe-4902-9dcf-78900302e239 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2460c373e8224352b78b23f09d4e4aaf, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:42.656411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319b2c7-43fe-4902-9dcf-78900302e239 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:42.747891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 156/310] 10.222.0.78 () {58 vars in 1334 bytes} [Sun Aug 28 19:28:42 2022] PUT /identity/v3/system/users/2460c373e8224352b78b23f09d4e4aaf/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:42.880052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c1eb9-438c-4e64-be0f-8427da1b8fd5 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:42.880492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c1eb9-438c-4e64-be0f-8427da1b8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:42.880642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c1eb9-438c-4e64-be0f-8427da1b8fd5 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:42.882105 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 155/311] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:42.889632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:42.890138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:42.890518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:42.897693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:42.916309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:42.916309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:43.034389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 157/312] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:43.371851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c1eb9-438c-4e64-be0f-8427da1b8fd5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:43.501213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c1eb9-438c-4e64-be0f-8427da1b8fd5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:43.509822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:43.543205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:43.543858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:43.544141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:43.544414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:43.557372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:43.562486 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:43.563567 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:43.564527 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 156/313] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:43.569818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:43.695268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ca658-a9b4-4960-9945-0f1c13707169 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:43.730500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:43.736177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:43.736878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:43.737281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:43.737546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:43.738257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:43.738562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:43.740136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:43.750986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 158/314] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:43.759541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:43.927253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9a219-e505-4176-aeae-b58c279f3890 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:43.986738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0938b-d85f-4785-92c5-e9e2664b4663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:43.987600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0938b-d85f-4785-92c5-e9e2664b4663 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:43.988026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0938b-d85f-4785-92c5-e9e2664b4663 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:43.988520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0938b-d85f-4785-92c5-e9e2664b4663 None admin] PATH_INFO: `/v3/users/859d7b4f9e024b11b0211eb05fceeb79` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:43.990239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0938b-d85f-4785-92c5-e9e2664b4663 None admin] RBAC: Authorizing `identity:get_user(user_id=859d7b4f9e024b11b0211eb05fceeb79)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:43.992424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0938b-d85f-4785-92c5-e9e2664b4663 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:43.995055 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 157/315] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:43 2022] GET /identity/v3/users/859d7b4f9e024b11b0211eb05fceeb79 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:44.001640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.080109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07f9bc-adf8-4241-ab1b-3a87d8e3ddec None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.080455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07f9bc-adf8-4241-ab1b-3a87d8e3ddec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.080786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07f9bc-adf8-4241-ab1b-3a87d8e3ddec None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.082662 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 158/316] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:44.091208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3bc8-7cf4-4b1f-bb78-f0f3efca8bbe None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.092141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3bc8-7cf4-4b1f-bb78-f0f3efca8bbe None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.093081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3bc8-7cf4-4b1f-bb78-f0f3efca8bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.117205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a5cb3bc8-7cf4-4b1f-bb78-f0f3efca8bbe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:44.118053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456795-afaf-4da3-9386-131ff11f75e2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:44.119050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5cb3bc8-7cf4-4b1f-bb78-f0f3efca8bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:44.152506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:44.175265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:44.176302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.176790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.177275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.205169 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 159/317] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:44.224639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6817b00-6d3f-4153-94c0-64d6edaf853c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.225160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6817b00-6d3f-4153-94c0-64d6edaf853c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.225582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6817b00-6d3f-4153-94c0-64d6edaf853c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.227497 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 160/318] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:44.233473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.234012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.234433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.257182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:44.259224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:44.280004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:44.290816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:44.292790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:44.362344 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 161/319] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:44.429824 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 159/320] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:44.436290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.492558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.550264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:44.565038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b6531-7f41-43ff-938b-554ab147a368 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:44.616550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:44.617198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.617500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.617810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.619061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:44.620514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:44.622903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 162/321] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:44 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:44.632305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.643348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:44.650900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80145-f8b0-4ef6-b506-b0c667348d6f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:44.692057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:44.692801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.693084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.693372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.707342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:44.712670 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:44.713582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 160/322] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:44.718870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.765207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c1464-03be-4d1b-bbdf-cb62cacc33f0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:44.817348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:44.817928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.818214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.818497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.819248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] RBAC: Adding query filter params (role.id=bf350015327b4b8ba8a77ce752f17fab, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516, user.id=859d7b4f9e024b11b0211eb05fceeb79) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:44.819562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:44.821070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:44.829658 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 163/323] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:28:44 2022] GET /identity/v3/role_assignments?user.id=859d7b4f9e024b11b0211eb05fceeb79&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=bf350015327b4b8ba8a77ce752f17fab => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:44.840102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.860408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb94241-cd3e-4296-b28d-ed85515d6a11 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:44.887856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:44.925198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:44.925983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:44.926279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:44.926630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:44.928024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:44.930306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:44.937610 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 161/324] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:44.938680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:44.975636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:44.995932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711a31-259c-41e6-98f0-dfe91ba811dc None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:45.048775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:45.049709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.050818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.051725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.052302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:45.052783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:45.055110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00999b82-b1d1-4aec-bda0-f89257c42900 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:45.069004 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 164/325] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:45.071598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255ba62-3718-4ddb-8b9d-489b01cf88c7 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.072047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255ba62-3718-4ddb-8b9d-489b01cf88c7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.072477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255ba62-3718-4ddb-8b9d-489b01cf88c7 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.075082 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 165/326] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:45.077794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255ba62-3718-4ddb-8b9d-489b01cf88c7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:45.097481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790b5e-2853-4064-9e7d-94a1415288ad None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:45.142584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:45.143199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.143478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.143751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.144381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:45.145825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:45.198502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:45.214569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255ba62-3718-4ddb-8b9d-489b01cf88c7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:45.252822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf2291-df4c-4160-8855-5de78f1dae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:45.253458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf2291-df4c-4160-8855-5de78f1dae0e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.253760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf2291-df4c-4160-8855-5de78f1dae0e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.254147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf2291-df4c-4160-8855-5de78f1dae0e None admin] PATH_INFO: `/v3/users/80022ab292f04a9598b22a1cc008958a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.255330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf2291-df4c-4160-8855-5de78f1dae0e None admin] RBAC: Authorizing `identity:get_user(user_id=80022ab292f04a9598b22a1cc008958a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:45.256871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf2291-df4c-4160-8855-5de78f1dae0e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:45.258814 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 166/327] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:45 2022] GET /identity/v3/users/80022ab292f04a9598b22a1cc008958a => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:45.260009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.260286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.260593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.264587 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 162/328] 10.222.0.78 () {60 vars in 1134 bytes} [Sun Aug 28 19:28:44 2022] POST /identity/v3/groups => generated 226 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:45.271961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:45.286830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:45.289255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:45.384880 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 167/329] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:45.397461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:45.431419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb61b8-bcdc-4435-8f12-f29be2c58a60 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:45.483676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:45.484864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.485291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.485744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] PATH_INFO: `/v3/system/users/80022ab292f04a9598b22a1cc008958a/roles/bf350015327b4b8ba8a77ce752f17fab` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.487511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80022ab292f04a9598b22a1cc008958a, role_id=bf350015327b4b8ba8a77ce752f17fab)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:45.489118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:45.559287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 163/330] 10.222.0.78 () {58 vars in 1334 bytes} [Sun Aug 28 19:28:45 2022] PUT /identity/v3/system/users/80022ab292f04a9598b22a1cc008958a/roles/bf350015327b4b8ba8a77ce752f17fab => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:45.680317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:45.854444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:45.871627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0ba2-1771-4c5f-838e-26eacf705294 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:45.913340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:45.914033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:45.914314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:45.914584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:45.928900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:45.934339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:45.935234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:45.936693 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 168/331] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:45.943783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:46.088376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a341-c39a-419e-9892-a0dab17af509 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:46.133073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:46.134098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:46.134458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:46.134736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:46.135437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:46.135829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:46.137365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:46.148546 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 164/332] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:46.158890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:46.372134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f73c67-80b3-4979-8ac3-a8006e8400ec None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:46.431780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0422e-a43d-48e8-bfc6-0cf9f2dfa20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:46.432436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0422e-a43d-48e8-bfc6-0cf9f2dfa20f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:46.432719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0422e-a43d-48e8-bfc6-0cf9f2dfa20f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:46.432998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0422e-a43d-48e8-bfc6-0cf9f2dfa20f None admin] PATH_INFO: `/v3/users/2460c373e8224352b78b23f09d4e4aaf` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:46.436357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0422e-a43d-48e8-bfc6-0cf9f2dfa20f None admin] RBAC: Authorizing `identity:get_user(user_id=2460c373e8224352b78b23f09d4e4aaf)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:46.438016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0422e-a43d-48e8-bfc6-0cf9f2dfa20f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:46.440083 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 169/333] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:46 2022] GET /identity/v3/users/2460c373e8224352b78b23f09d4e4aaf => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:46.446670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:46.465083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:46.688510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da231c6-19cc-479b-8c4a-2aa09fc61cda None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:46.771339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:46.772396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:46.772918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:46.773452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:46.774806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] RBAC: Adding query filter params (role.id=34f645bea60445e09a81ac9342eb51e8, user.id=2460c373e8224352b78b23f09d4e4aaf, scope.system=all) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:46.775387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:46.778255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c91de9-9250-4096-81b3-37f7729afaad None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:46.811374 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 165/334] 10.222.0.78 () {56 vars in 1308 bytes} [Sun Aug 28 19:28:46 2022] GET /identity/v3/role_assignments?user.id=2460c373e8224352b78b23f09d4e4aaf&scope.system=all&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 510 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:47.998935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f329b-6b98-480f-806a-fa4c43c39f8e None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:47.999705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f329b-6b98-480f-806a-fa4c43c39f8e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:47.999705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f329b-6b98-480f-806a-fa4c43c39f8e None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:48.001268 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 170/335] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:48.010311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab580-9604-4e34-94d5-fdf43d823344 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:48.011052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab580-9604-4e34-94d5-fdf43d823344 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:48.011052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab580-9604-4e34-94d5-fdf43d823344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:48.043806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8e3ab580-9604-4e34-94d5-fdf43d823344 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:48.045099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8e3ab580-9604-4e34-94d5-fdf43d823344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:48.134663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:48.146923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 166/336] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:48.458897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e46ad-3954-4126-875f-cc7bd91083eb None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:48.459239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e46ad-3954-4126-875f-cc7bd91083eb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:48.459690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e46ad-3954-4126-875f-cc7bd91083eb None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:48.461603 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 171/337] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:48.469522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e921b-3d86-48ce-882b-672c76e05f14 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:48.469966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e921b-3d86-48ce-882b-672c76e05f14 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:48.470121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e921b-3d86-48ce-882b-672c76e05f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:48.492994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bb5e921b-3d86-48ce-882b-672c76e05f14 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:48.494413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bb5e921b-3d86-48ce-882b-672c76e05f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:48.600328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 167/338] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:48.805467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de1e0-d8f2-4caf-9708-ac21d90a65c4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:48.805999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de1e0-d8f2-4caf-9708-ac21d90a65c4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:48.806150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de1e0-d8f2-4caf-9708-ac21d90a65c4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:48.807874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 172/339] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:48.815224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:48.815616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:48.815767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:48.843233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:48.844482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:48.853206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de1e0-d8f2-4caf-9708-ac21d90a65c4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:48.879671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:49.014606 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 168/340] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:49.065175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de1e0-d8f2-4caf-9708-ac21d90a65c4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:49.114416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:49.115150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:49.115483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:49.115888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:49.130681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:49.136325 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:49.138080 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:49.140127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 173/341] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:49.146933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:49.280570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:49.342101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403944b-35b3-4c3e-82e6-867fd8a427e6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:49.397780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:49.398478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:49.398751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:49.398990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:49.399861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:49.400171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:49.401577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:49.412424 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 169/342] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:49.424881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:49.462093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:49.582295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b391-4dd7-45a4-aaaf-fa0a15d3f526 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:49.594660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:49.628404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:49.629106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:49.629390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:49.633153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:49.696699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c87ba-c7ec-4580-8037-83dd52e49e7d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:49.730449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:49.754632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:49.755633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:49.755927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:49.756318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:49.784020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:49.798705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:49.800316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:49.801772 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 170/343] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:49.816785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:49.819667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:49.827859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:49.988419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:50.074478 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 174/344] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:50.077662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:50.081224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d557dd-4a64-485a-a482-05689777d012 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:50.149494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:50.150935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:50.151129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:50.151431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:50.152642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:50.153144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:50.156285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:50.172305 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 171/345] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:50.177893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:50.264005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:50.327556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024095-b5a4-474e-a43d-2dfab0d6282d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:50.383568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd739b24-47f8-4b03-8b69-f18300eaba26 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:50.432915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:50.433601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:50.433986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:50.434266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:50.465271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:50.467009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:50.467498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:50.467932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:50.468426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:50.470074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:50.472926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:50.473629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:50.475377 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 175/346] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:50.476997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:50.479811 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 172/347] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:50 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:50.486829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:50.611377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:50.620739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929fe1f-2264-42ce-a280-271ffec22633 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:50.632740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:50.663776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:50.664461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:50.664808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:50.665101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:50.665821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] RBAC: Adding query filter params (name=reader) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:50.667555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:50.667825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:50.679904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 173/348] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:50.680806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:50.787180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855db760-ad25-4de3-915b-d471c1002298 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:50.825532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc5ef-06b2-41b8-aaf4-2ed8fbaaf2de None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:50.858045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:50.859028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:50.859431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:50.859820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:50.870423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:50.870997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:50.871278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:50.871555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:50.879067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:50.880542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:50.882492 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 174/349] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:50 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:50.883669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:50.932044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:50.972872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:50.974418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:51.014140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc7e5-fa21-42ae-abdd-e7879dbb3cb4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:51.023835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:51.059978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bdb6f-e722-44b7-b3c0-56876ff6592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:51.061770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bdb6f-e722-44b7-b3c0-56876ff6592b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.061770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bdb6f-e722-44b7-b3c0-56876ff6592b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.062223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bdb6f-e722-44b7-b3c0-56876ff6592b None admin] PATH_INFO: `/v3/users/80022ab292f04a9598b22a1cc008958a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.064155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bdb6f-e722-44b7-b3c0-56876ff6592b None admin] RBAC: Authorizing `identity:get_user(user_id=80022ab292f04a9598b22a1cc008958a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:51.067034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bdb6f-e722-44b7-b3c0-56876ff6592b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:51.070592 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 175/350] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:28:50 2022] GET /identity/v3/users/80022ab292f04a9598b22a1cc008958a => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:51.073048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106ad3-26f8-44e2-a100-39a94c96a83f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.073533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106ad3-26f8-44e2-a100-39a94c96a83f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.074067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106ad3-26f8-44e2-a100-39a94c96a83f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.076703 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 176/351] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:51.077491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106ad3-26f8-44e2-a100-39a94c96a83f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:51.123832 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 176/352] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:51.125411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:51.216407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106ad3-26f8-44e2-a100-39a94c96a83f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:51.218275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:51.257464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:51.258109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.258734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.258917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.259674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:51.259988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:51.261834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4789fc-3d91-4ae4-a252-7b7482ddf894 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:51.262728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ceda8-f0c2-4024-ad42-66bc660bea26 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:51.270931 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 177/353] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:28:51 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:51.272150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.272446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.272720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.292917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:51.297894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:51.324931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:51.326019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.326685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.327236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.328235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] RBAC: Adding query filter params (role.id=bf350015327b4b8ba8a77ce752f17fab, user.id=80022ab292f04a9598b22a1cc008958a, scope.system=all) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:51.328752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:51.330805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:51.333110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:51.358075 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 177/354] 10.222.0.78 () {56 vars in 1308 bytes} [Sun Aug 28 19:28:51 2022] GET /identity/v3/role_assignments?user.id=80022ab292f04a9598b22a1cc008958a&scope.system=all&role.id=bf350015327b4b8ba8a77ce752f17fab => generated 510 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:51.359043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:51.390926 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 178/355] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:51.541374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d935a-5c6e-4845-9a0d-1bae6872c7c8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:51.587090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91463a6-14d9-43cf-9e86-2003eb6293a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:51.587778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91463a6-14d9-43cf-9e86-2003eb6293a1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.588048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91463a6-14d9-43cf-9e86-2003eb6293a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.588326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91463a6-14d9-43cf-9e86-2003eb6293a1 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.589771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91463a6-14d9-43cf-9e86-2003eb6293a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:51.591844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91463a6-14d9-43cf-9e86-2003eb6293a1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:51.593874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 178/356] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:51 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:51.604627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:51.747011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f29f-556b-472d-a27e-c6738e3e6aab None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.747462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f29f-556b-472d-a27e-c6738e3e6aab None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.747892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f29f-556b-472d-a27e-c6738e3e6aab None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.750592 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 179/357] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:51.762486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.762971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.763993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.766013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:51.777889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f79ca6-606c-4394-aeff-ed8be2ebe943 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:51.798142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:51.801203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:51.839693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:51.840765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:51.841327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:51.842370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:51.844096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:51.846156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:51.848435 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 179/358] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:51 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:51.855331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:51.939360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:51.964576 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 180/359] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:51.985047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af19c3-9569-4d6b-80f9-0031ae15ea43 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:52.029958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:52.031006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:52.031459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:52.031906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:52.032830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:52.033326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:52.035054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:52.042553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 180/360] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:28:51 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:52.165488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:52.375366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7cbd-89eb-4131-8885-19feaecfc254 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:52.439352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:52.454600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36af4f-2094-4e13-b231-9b0b5bade395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:52.455711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36af4f-2094-4e13-b231-9b0b5bade395 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:52.456179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36af4f-2094-4e13-b231-9b0b5bade395 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:52.456671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36af4f-2094-4e13-b231-9b0b5bade395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:52.483262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36af4f-2094-4e13-b231-9b0b5bade395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-cb36af4f-2094-4e13-b231-9b0b5bade395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:52.493507 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:52.494680 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:52.495478 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:52.496870 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 181/361] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:52.498844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502af36-c873-4ef8-959b-31918d7f1896 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:52.499340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502af36-c873-4ef8-959b-31918d7f1896 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:52.499829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502af36-c873-4ef8-959b-31918d7f1896 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:52.502769 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 182/362] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:52.505174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:52.509483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502af36-c873-4ef8-959b-31918d7f1896 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:52.605596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7823b5-1ab2-4d62-adac-e0f62103c7d0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:52.625713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:52.664588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd895-c1c4-4e6f-a6c0-a1fa39ebddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:52.665797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd895-c1c4-4e6f-a6c0-a1fa39ebddc9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:52.666307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd895-c1c4-4e6f-a6c0-a1fa39ebddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:52.666812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd895-c1c4-4e6f-a6c0-a1fa39ebddc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:52.695133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd895-c1c4-4e6f-a6c0-a1fa39ebddc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-185dd895-c1c4-4e6f-a6c0-a1fa39ebddc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:52.709059 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:52.710454 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 181/363] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:52.716578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:52.717364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:52.717364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:52.725161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502af36-c873-4ef8-959b-31918d7f1896 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:52.738766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:52.740467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:52.804596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:52.805215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:52.805492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:52.805761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:52.811774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:52.812088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:52.813508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:52.824860 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 183/364] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:52.826432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:52.871685 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 182/365] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:52.872548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:52.898271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.005376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049ed0-755d-4ef1-9a1b-10628da0ca7a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.030213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.090791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.091506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.091785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.091946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49471e3-c87c-44c2-93ea-d77b2ab97e2f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.092040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.092839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:53.093154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:53.095363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:53.106523 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 184/366] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:53.113471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.176281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.176929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.177216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.177590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.273445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ea05c-2e7c-40ef-97ef-fc2507dd0520 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.317506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:53.318989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.319490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:53.319666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.319902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.320178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.363119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.397269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.444981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:53.446519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:53.493222 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 183/367] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:53.495983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.597747 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 185/368] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:53.599056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.654648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902525af-98ad-4588-97fa-a5560711af42 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.681836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.701100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.706555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.707524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.708062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.708537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.722635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:53.729803 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:53.730750 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:53.731580 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:53.733010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785a3d-2aec-46ea-9ca2-cee8dfb4689f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.734914 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 184/369] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:53.736103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.774375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.774905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.775186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.775459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.776656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:53.778162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:53.780889 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 186/370] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:53.781778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.855594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a7c8-8190-46b5-bc0d-8e7b68b613b6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.895483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.896531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.897064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.897644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.899189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:53.900912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:53.901025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0795-1d44-4828-ac44-e9a354a0bd86 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:53.903121 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 185/371] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:53.904830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.944709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:53.945335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:53.945615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:53.945906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:53.946602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:53.946909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:53.948423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:53.960341 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 187/372] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:53.961349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:53.964234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.968228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:54.033231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a122e-5e5e-43bb-9b85-c1550e84cacb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:54.073834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:54.074926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.075408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.076521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.078011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:54.079711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:54.082004 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 186/373] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:54.083015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:54.112121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6612-561d-454a-b42d-9241a1e5734e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:54.153342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:54.154790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.155145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.155427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.156919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:54.158564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:54.160865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 188/374] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:53 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:54.161877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:54.208522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482288c0-fdb5-4341-b6ae-6c3c70a7fd5e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:54.229115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:54.257118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:54.259242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:54.260165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.260663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.261144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.298232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2462-11d9-4868-8158-ed72392df5da None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:54.343946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:54.344368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.344655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.344986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.345934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:54.346347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:54.347513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:54.349227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:54.354227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:54.360273 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 189/375] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:28:54 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:54.361301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:54.482916 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 187/376] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:28:54.491844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:54.509882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9290d5-694f-4d87-b048-5922c94682e2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:54.522761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:54.551400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:54.552381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.552840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.553288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.554285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:54.554809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:54.556659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:54.564762 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 190/377] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:28:54 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:54.565188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:54.670925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8bf7-8466-45b9-8f99-ad285410772d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:54.718801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd256-ab00-4b06-9c8d-19dba9029bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:54.719882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd256-ab00-4b06-9c8d-19dba9029bd5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.720374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd256-ab00-4b06-9c8d-19dba9029bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.720853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd256-ab00-4b06-9c8d-19dba9029bd5 None admin] PATH_INFO: `/v3/projects/926e861f54084884ae9dc19520ca2e6d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.722581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd256-ab00-4b06-9c8d-19dba9029bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=926e861f54084884ae9dc19520ca2e6d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:54.724621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd256-ab00-4b06-9c8d-19dba9029bd5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:54.727461 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 188/378] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:54 2022] GET /identity/v3/projects/926e861f54084884ae9dc19520ca2e6d => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:54.733979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:54.868606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4e05-6659-407d-aafd-22891d8c2b0f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.868606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4e05-6659-407d-aafd-22891d8c2b0f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.868880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4e05-6659-407d-aafd-22891d8c2b0f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.871421 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 189/379] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:54.877554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a681b45-3a38-424d-8b71-d2b7e7c4c42e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:54.877935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a681b45-3a38-424d-8b71-d2b7e7c4c42e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:54.878310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a681b45-3a38-424d-8b71-d2b7e7c4c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:54.928126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1a681b45-3a38-424d-8b71-d2b7e7c4c42e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:54.930120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a681b45-3a38-424d-8b71-d2b7e7c4c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:54.975840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaabe1-d49e-4df9-9b95-b8a2a5cbc0ce None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:55.104452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:55.105338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:55.105648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:55.106027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] PATH_INFO: `/v3/groups/7d0cd5a60d114ac59bfafe62bb7be6a0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:55.122774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] RBAC: Authorizing `identity:get_group(group_id=7d0cd5a60d114ac59bfafe62bb7be6a0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:55.124419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:55.126608 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 191/380] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:54 2022] GET /identity/v3/groups/7d0cd5a60d114ac59bfafe62bb7be6a0 => generated 229 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:55.132999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:55.136033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 190/381] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:55.176790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99c55-fc14-4296-a6db-bc1f0b5cf56d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:55.177110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99c55-fc14-4296-a6db-bc1f0b5cf56d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:55.177351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99c55-fc14-4296-a6db-bc1f0b5cf56d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:55.179068 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 191/382] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:55.184793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:55.185741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:55.186104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:55.222598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:55.224476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:55.225875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:55.243303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:55.266525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7590c-5765-4525-89ec-6d4e119747ed None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:55.327020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:55.327984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:55.328368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:55.328624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:55.329422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] RBAC: Adding query filter params (group.id=7d0cd5a60d114ac59bfafe62bb7be6a0, role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=926e861f54084884ae9dc19520ca2e6d) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:55.329821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:55.331485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:55.345539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 192/383] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:28:55 2022] GET /identity/v3/role_assignments?group.id=7d0cd5a60d114ac59bfafe62bb7be6a0&scope.project.id=926e861f54084884ae9dc19520ca2e6d&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:55.360181 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 192/384] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:55.507321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:55.673953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f190664-fdcf-435b-b3ce-311d9c3b0803 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:55.707534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:55.718161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:55.718847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:55.719131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:55.719404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:55.734086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:55.739417 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:55.740373 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:28:55.741199 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 193/385] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:55.751742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:55.915505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8e3d-b12d-41c1-bb9f-00eb8a7bab6b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:55.965474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:55.966650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:55.967126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:55.967606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:55.968492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:55.969000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:55.970661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:55.987747 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 193/386] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:55.994029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:56.050943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:56.057078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:56.203588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee183bbd-2f39-4ec3-9260-7cb9be432a47 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:56.284082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:56.284634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:56.284913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:56.285187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:56.288945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:56.290500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:56.292364 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 194/387] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:55 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:56.298897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec07d-5d5a-4660-b273-4d6a14d23776 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:56.303643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:56.350296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:56.350961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:56.351241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:56.351519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:56.366567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:56.373198 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:56.375069 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:56.376635 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 194/388] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:56.405402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:56.525612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:56.599331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:56.602957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e625807-15a1-4bc7-8694-6214bc87e947 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:56.671921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d227-b520-4c42-99f9-f0cf924cf022 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:56.729294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:56.730450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:56.730913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:56.731359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:56.734147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:56.736975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:56.747232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 195/389] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:56 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:56.750832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:56.788216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:56.789246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:56.789728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:56.790206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:56.791290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:56.791793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:56.794269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:56.823330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 195/390] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:56.839171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:57.089892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7ae3-3a76-4df6-9ec5-3737887ef43f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:57.139121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:57.158013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:57.159128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.159628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.160074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/groups/333a14838c19454683a4524d718b2c09/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.167389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c04f173e384bb08ddae310e94f5bf6, group_id=333a14838c19454683a4524d718b2c09, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:57.170733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:57.188933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ffdf9-9c71-4a41-8e8d-ff642add3307 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:57.241414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:57.254730 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 196/391] 10.222.0.78 () {58 vars in 1442 bytes} [Sun Aug 28 19:28:56 2022] PUT /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/groups/333a14838c19454683a4524d718b2c09/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:57.269698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:57.270954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.271368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.271821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.274209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:57.277237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:57.281016 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 196/392] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:56 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:57.290770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:57.487897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78301c4-9239-42f9-b535-525107851ce4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:57.538499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dea4-ed59-425c-a774-350d23b64bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:57.539276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dea4-ed59-425c-a774-350d23b64bd1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.539526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dea4-ed59-425c-a774-350d23b64bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.539808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dea4-ed59-425c-a774-350d23b64bd1 None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.541093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137dea4-ed59-425c-a774-350d23b64bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:57.542662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137dea4-ed59-425c-a774-350d23b64bd1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:57.545576 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 197/393] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:57 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:57.551815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:57.623119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f50e-c2c1-4fad-8ea0-93bb9222f980 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.623424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f50e-c2c1-4fad-8ea0-93bb9222f980 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.623601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f50e-c2c1-4fad-8ea0-93bb9222f980 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.625471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 198/394] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:57.640660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a837c2f-9652-4d0c-84bc-6166aee6fe90 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.640997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a837c2f-9652-4d0c-84bc-6166aee6fe90 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.641216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a837c2f-9652-4d0c-84bc-6166aee6fe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.665428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4a837c2f-9652-4d0c-84bc-6166aee6fe90 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:57.671613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a837c2f-9652-4d0c-84bc-6166aee6fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:57.730896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa41cb-3d2e-4cb2-95cd-0bd9b708d3a8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:57.749125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:57.783232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 199/395] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:28:57.798126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:57.799430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.799857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.800352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/groups/333a14838c19454683a4524d718b2c09/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.803044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c04f173e384bb08ddae310e94f5bf6, group_id=333a14838c19454683a4524d718b2c09, role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:57.805008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:57.839320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deff5e-14e1-4803-b57f-097b21b7d8dc None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.839708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deff5e-14e1-4803-b57f-097b21b7d8dc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.839935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deff5e-14e1-4803-b57f-097b21b7d8dc None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.841888 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 200/396] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:28:57.848705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6840d-9b19-4cce-aecc-2b5181de5fec None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:57.849537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6840d-9b19-4cce-aecc-2b5181de5fec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:57.850307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6840d-9b19-4cce-aecc-2b5181de5fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:57.882228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-20a6840d-9b19-4cce-aecc-2b5181de5fec None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:57.885056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-20a6840d-9b19-4cce-aecc-2b5181de5fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:57.943847 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 197/397] 10.222.0.78 () {58 vars in 1442 bytes} [Sun Aug 28 19:28:57 2022] PUT /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6/groups/333a14838c19454683a4524d718b2c09/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:58.026367 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 201/398] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:58.184568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:58.267320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3829d-367a-41b8-add3-805a689a40aa None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:58.267739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3829d-367a-41b8-add3-805a689a40aa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:58.270053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3829d-367a-41b8-add3-805a689a40aa None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:58.276763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:58.277246 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 202/399] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:28:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:28:58.284351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:58.285242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:58.286148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:58.332413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:58.335092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:58.371374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d18a5-eabb-44d9-8c76-72359b8949cb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:58.487215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:58.489076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:58.490454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:58.491078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:58.517507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:58.528378 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:58.531395 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:28:58.533006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:58.540267 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 203/400] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:28:58.541079 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 198/401] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:58.549830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:58.585528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:58.694163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:58.812799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116149e-6dee-453a-95b8-b293deabca25 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:58.899800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:58.900786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:58.901269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:58.901724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:58.902986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:58.904049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:58.906641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:58.915769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43c118-8ee2-4286-bd53-933309607a99 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:58.942604 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 204/402] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:58.955048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:58.964277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:58.992815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:58.993538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:58.993818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:58.994154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.016129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:59.021329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:59.022598 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:28:59.023508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:59.024401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 199/403] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:28:59.033826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:59.217182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882432-1f52-412a-8c4d-b4c13fc6bb02 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:59.221908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:59.233571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043230a-b8a0-41d4-9ab7-5f8447590910 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:59.290827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:59.291497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:59.291828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:59.292100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.292891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:59.293195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:59.295579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:59.298132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:59.300315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:59.301060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:59.301739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.305789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:59.313891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 200/404] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:59.313891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:59.316073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:59.321503 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 205/405] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:58 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:59.331149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:59.385131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:59.519060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da245195-50a0-494d-a2ca-f408b763cd5a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:59.520063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726e626-b53d-4ad8-bda9-8a1090a1ec1c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:59.569109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:59.570336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:59.570983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:59.571469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.586811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:28:59.594119 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:28:59.595161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:28:59.595956 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:28:59.598945 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 201/406] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:28:59.600169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:59.606324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:59.607702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:59.608189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:59.608685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.610909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:59.613822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:59.622406 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 206/407] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:59 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:28:59.622406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:59.719847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:59.820698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:59.836747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e4d2-8340-45bd-a270-f3d64e173f1a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:59.854057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c5c6-e888-4def-a032-3b2c856cf737 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:59.906011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:59.906775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:59.907191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:59.907618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.909448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:59.911965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:59.916133 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 202/408] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:28:59 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:59.918535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:59.926242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:59.928027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:59.928809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:59.929498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:59.930896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:59.931815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:59.934453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:59.951726 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 207/409] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:59.953504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:00.129447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84716a-97ae-4b6c-8d82-eb8d34c53c9c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:00.139034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c57dd-1f43-4983-bb31-e9cdbc339b0f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:00.140992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:00.182056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:00.182910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.183274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.183561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.185410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:00.187124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:00.187804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b15735-c3b3-4cd6-a80c-d2e84810ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:00.188768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15735-c3b3-4cd6-a80c-d2e84810ed34 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.189187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15735-c3b3-4cd6-a80c-d2e84810ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.189619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15735-c3b3-4cd6-a80c-d2e84810ed34 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/groups/333a14838c19454683a4524d718b2c09/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.192762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b15735-c3b3-4cd6-a80c-d2e84810ed34 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f49ed0e2e9471bb19d16f6c439a516, group_id=333a14838c19454683a4524d718b2c09, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:00.194259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 208/410] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:28:59 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:00.194916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:00.195356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b15735-c3b3-4cd6-a80c-d2e84810ed34 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:00.319090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914370a-9caa-449b-8848-31b4186326c8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:00.355478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbef8d-f9ce-4cc8-8eb1-57554c7bd3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:00.356160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbef8d-f9ce-4cc8-8eb1-57554c7bd3e7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.357048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbef8d-f9ce-4cc8-8eb1-57554c7bd3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.357343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbef8d-f9ce-4cc8-8eb1-57554c7bd3e7 None admin] PATH_INFO: `/v3/groups/7d0cd5a60d114ac59bfafe62bb7be6a0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.358418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbef8d-f9ce-4cc8-8eb1-57554c7bd3e7 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0cd5a60d114ac59bfafe62bb7be6a0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:00.360194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbef8d-f9ce-4cc8-8eb1-57554c7bd3e7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:00.361879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 209/411] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:29:00 2022] GET /identity/v3/groups/7d0cd5a60d114ac59bfafe62bb7be6a0 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:00.362979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51c9a-8866-4a10-a386-d87d9ecd017c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.363272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51c9a-8866-4a10-a386-d87d9ecd017c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.363429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51c9a-8866-4a10-a386-d87d9ecd017c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.369120 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 210/412] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:00.369120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51c9a-8866-4a10-a386-d87d9ecd017c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:00.374592 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 203/413] 10.222.0.78 () {58 vars in 1442 bytes} [Sun Aug 28 19:28:59 2022] PUT /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/groups/333a14838c19454683a4524d718b2c09/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:00.374592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.374592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.374592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.408545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:00.411140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:00.447853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:00.454033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:00.542146 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 204/414] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:29:00.546032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:00.604896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51c9a-8866-4a10-a386-d87d9ecd017c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:00.664824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:00.665789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.666166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.666424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/groups/333a14838c19454683a4524d718b2c09/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.671152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f49ed0e2e9471bb19d16f6c439a516, group_id=333a14838c19454683a4524d718b2c09, role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:00.673284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:00.720945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11805d-b13b-46a7-ba3a-2482aa58d683 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:00.768696 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 211/415] 10.222.0.78 () {58 vars in 1442 bytes} [Sun Aug 28 19:29:00 2022] PUT /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516/groups/333a14838c19454683a4524d718b2c09/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:00.773148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:00.774308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:00.774624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:00.774902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] PATH_INFO: `/v3/projects/926e861f54084884ae9dc19520ca2e6d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:00.776313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] RBAC: Authorizing `identity:get_project(project_id=926e861f54084884ae9dc19520ca2e6d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:00.778166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:00.780839 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 205/416] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:29:00 2022] GET /identity/v3/projects/926e861f54084884ae9dc19520ca2e6d => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:00.790541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:00.938841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:00.944852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239a064-c8a9-4a0a-b35f-45d28dd383aa None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:00.949105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:01.006548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:01.007240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:01.007606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:01.008214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] PATH_INFO: `/v3/projects/926e861f54084884ae9dc19520ca2e6d/groups/7d0cd5a60d114ac59bfafe62bb7be6a0/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:01.016159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:01.016982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=926e861f54084884ae9dc19520ca2e6d, group_id=7d0cd5a60d114ac59bfafe62bb7be6a0, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:01.021757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:01.126392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d663f2-dbc4-4ec3-a812-dae708d902c0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:01.192382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956c3f6-d39b-4f3e-9cec-aa672e0f29a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:01.193388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c3f6-d39b-4f3e-9cec-aa672e0f29a1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:01.193839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c3f6-d39b-4f3e-9cec-aa672e0f29a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:01.194238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c3f6-d39b-4f3e-9cec-aa672e0f29a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:01.213910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c3f6-d39b-4f3e-9cec-aa672e0f29a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:01.220264 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 212/417] 10.222.0.78 () {58 vars in 1442 bytes} [Sun Aug 28 19:29:00 2022] PUT /identity/v3/projects/926e861f54084884ae9dc19520ca2e6d/groups/7d0cd5a60d114ac59bfafe62bb7be6a0/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8956c3f6-d39b-4f3e-9cec-aa672e0f29a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:01.223999 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:01.227607 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:01.229309 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 206/418] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:01.233365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:01.442126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e91923-1517-41b4-810c-5bc13597eff8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:01.499324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:01.500125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:01.500527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:01.500924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:01.502005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] RBAC: Adding query filter params (name=member) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:01.502459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:01.504694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f556-b1e1-4d16-9a0f-048e4c132b36 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:01.511355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538caf9-8291-4a27-b6fe-2efb65f3c466 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:01.511750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538caf9-8291-4a27-b6fe-2efb65f3c466 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:01.512168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538caf9-8291-4a27-b6fe-2efb65f3c466 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:01.515297 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 207/419] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:29:01.521487 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 213/420] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:01.528400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538caf9-8291-4a27-b6fe-2efb65f3c466 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:01.532715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:01.533227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:01.539087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:01.574458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:01.576767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:01.614723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:01.678410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:01.729411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538caf9-8291-4a27-b6fe-2efb65f3c466 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:01.746560 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 214/421] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:01.798044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:01.799123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:01.799621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:01.800095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:01.944137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:01.946700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:02.112913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:02.141900 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 208/422] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:02.149986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:02.370338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544f17-1ce1-4d32-846a-0dedcad17fd0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:02.425464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:02.426219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:02.426503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:02.426777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:02.428108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:02.429671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:02.431806 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 215/423] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:29:02 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:02.439116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:02.527508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:02.586274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:02.796666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239c6c-29ae-48b1-9647-8c526e65e26d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:02.807611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99980d-862b-43c5-bfca-dcac315723db None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:02.863791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:02.864901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:02.865408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:02.865959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:02.868449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:02.872892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:02.875960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 209/424] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:29:02 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:02.893885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:02.930741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:02.931794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:02.932267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:02.932813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:02.965349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:02.970664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:02.971603 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:02.972933 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 216/425] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:29:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:02.978376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:03.008117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:03.111107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc5d9b-eae3-4da8-bba5-7a2cbe4639e4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:03.188759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:03.189937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:03.190449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:03.191001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:03.193033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:03.193607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:03.197326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b0d15-1cde-43d0-8eb8-7066ed97975a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:03.213335 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 210/426] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:29:02 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 611 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:03.215731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915babd-7b7a-4a88-9e64-e2bdfdb66097 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:03.216226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915babd-7b7a-4a88-9e64-e2bdfdb66097 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:03.219857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915babd-7b7a-4a88-9e64-e2bdfdb66097 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:03.227627 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 211/427] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:03.231039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:03.232426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:03.234569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:03.258955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:03.277732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:03.279964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:03.312704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7d08-97e2-4ca0-9614-88379284942f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:03.396186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:03.397168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:03.397662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:03.398194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:03.400221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:03.401005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:03.404858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:03.424289 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 217/428] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:03.431313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:03.459705 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 212/429] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:03.591779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2fb43-5d23-4060-a8cd-98c3ded4adf2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:03.647834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:03.648455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:03.648741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:03.649019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:03.666146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:03.764260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:03.767092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:03.788864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:03.858340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:03.921840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75273335-23e7-4335-9f05-c8e1d369ac46 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:03.969425 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 218/430] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:03.971093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:03.971903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:03.972284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:03.972654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:03.979245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:03.986757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:03.992643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:03.993617 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 19:29:03.994530 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:03.998409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 213/431] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:04.001673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:04.090571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:04.176424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef8c5e-c1dc-4537-bf4c-25a6991b9db9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:04.180570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbe14d-2704-479c-be83-78eff9d175c4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:04.185174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:04.219053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922aedd4-b600-4462-b856-7cb01d642e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:04.220165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aedd4-b600-4462-b856-7cb01d642e3b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.220662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aedd4-b600-4462-b856-7cb01d642e3b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.221158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aedd4-b600-4462-b856-7cb01d642e3b None admin] PATH_INFO: `/v3/projects/c7c04f173e384bb08ddae310e94f5bf6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.223442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922aedd4-b600-4462-b856-7cb01d642e3b None admin] RBAC: Authorizing `identity:get_project(project_id=c7c04f173e384bb08ddae310e94f5bf6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:04.226324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922aedd4-b600-4462-b856-7cb01d642e3b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:04.229807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 219/432] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:29:03 2022] GET /identity/v3/projects/c7c04f173e384bb08ddae310e94f5bf6 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:04.232602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89fab3-761e-4ddb-b25a-ba02e99061bf None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.233144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89fab3-761e-4ddb-b25a-ba02e99061bf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.233622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89fab3-761e-4ddb-b25a-ba02e99061bf None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.236287 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 220/433] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:04.237038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:04.238111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.238487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfe4f3-e80e-42b7-bb5f-5a5895dc55ce None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.238663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.238951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfe4f3-e80e-42b7-bb5f-5a5895dc55ce None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.239100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.239425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfe4f3-e80e-42b7-bb5f-5a5895dc55ce None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.240035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:04.240470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:04.241917 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 221/434] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:04.242548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81108c9c-69e8-4b66-b190-f86f3f2681f5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:04.243317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfe4f3-e80e-42b7-bb5f-5a5895dc55ce None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:04.256462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 214/435] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:04.258244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddf4f2-2035-497c-873a-274e3bbba460 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.258540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddf4f2-2035-497c-873a-274e3bbba460 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.258807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddf4f2-2035-497c-873a-274e3bbba460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.280287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3bddf4f2-2035-497c-873a-274e3bbba460 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:04.281719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3bddf4f2-2035-497c-873a-274e3bbba460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:04.379572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 215/436] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:04.381082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.381248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.381569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.382661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfe4f3-e80e-42b7-bb5f-5a5895dc55ce None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:04.395773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:04.409027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:04.410301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:04.436257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:04.436809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.437085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.437407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.438591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:04.440050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:04.441685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 222/437] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:04.442515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:04.532557 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 216/438] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:04.532557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:04.586807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88571398-2f42-4523-988a-ee7ef1de0266 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:04.610033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:04.626081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:04.626688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.627937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.627937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.686490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a870ec0-4c4d-4d01-a3a6-69b3bb09b330 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:04.691086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:04.723137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:04.726245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:04.736313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:04.737036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.737314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.737660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.738479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=c7c04f173e384bb08ddae310e94f5bf6) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:04.738799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:04.740282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:04.753904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 217/439] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=c7c04f173e384bb08ddae310e94f5bf6&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:04.753904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:04.897137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:04.908669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0628f2-6c38-411c-9cdf-0bf8d2c8e991 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:04.912849 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 223/440] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:04.914415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:04.955492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:04.956720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:04.957332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:04.957720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:04.974398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:04.980487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:04.982348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:04.983155 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 218/441] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:04.983920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.035204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.069503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843204-ebfc-494d-99ae-75264167bcf8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.123567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.124380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.124776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.125178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.140958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc8459-d7e9-47b1-a83c-6816f42c5ec3 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.141588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:05.151918 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:05.153627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:05.155212 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 224/442] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:05.158577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.206380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.207142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.207565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.207953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.209834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.212307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.219696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 219/443] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:29:04 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:05.219696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.240645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.288572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a89f-7af8-40bc-a8e0-106c9c42016a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.328367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.328984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.329272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.329542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.330269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:05.330578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.332096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.334893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.343183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178162e-4a9e-4fa5-993f-ef689227b47f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.351038 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 225/444] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:05.351038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.385788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.386441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.386725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.387002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.388305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:05.388617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.390093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.400388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 220/445] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:05.401261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.505967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.510615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af694e93-2af6-4676-bf7e-016adc70b5af None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.528013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a273cc-b3ee-4248-9286-9ecb80821ee6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.557180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.557845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.558158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.558421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.559907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.561419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.563127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 226/446] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:05.563931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.578746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.579369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.579647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.579915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.646020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.655799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.657370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.697029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206ae7-416c-4c4f-8761-2c62eb077e0b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.738864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.739518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.739807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.740081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.756596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.779081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 221/447] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:05.779949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.817418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.818900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.887674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56bed-1745-4f36-ba50-1180d82b7fb5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:05.888790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:05.924373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:05.924968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:05.925247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:05.925516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:05.926265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=34f645bea60445e09a81ac9342eb51e8, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:05.926575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:05.928001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:05.931113 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 227/448] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:05.931957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:05.937608 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 222/449] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=34f645bea60445e09a81ac9342eb51e8 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:05.938480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:06.014534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:06.066979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d09c1-f91a-4426-845d-e5e1c648edab None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:06.084631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58f5f-48f1-4239-a075-84111d4e7946 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:06.114331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:06.114980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:06.115405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:06.115537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] PATH_INFO: `/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:06.116782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f49ed0e2e9471bb19d16f6c439a516)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:06.119188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:06.120218 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 228/450] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/projects/b3f49ed0e2e9471bb19d16f6c439a516 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:06.126915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:06.132432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:06.133418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:06.133698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:06.134012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] PATH_INFO: `/v3/projects/926e861f54084884ae9dc19520ca2e6d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:06.135207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] RBAC: Authorizing `identity:get_project(project_id=926e861f54084884ae9dc19520ca2e6d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:06.136771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:06.143376 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 223/451] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:29:05 2022] GET /identity/v3/projects/926e861f54084884ae9dc19520ca2e6d => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:06.144529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:06.172471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:06.276016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5d02-37fe-49e0-a2c1-44190b32f3a0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:06.302659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d29c3-4412-4b01-9482-d1bd56b389d9 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:06.321817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:06.325158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:06.325342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:06.325558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:06.325802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] PATH_INFO: `/v3/groups/333a14838c19454683a4524d718b2c09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:06.327299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] RBAC: Authorizing `identity:get_group(group_id=333a14838c19454683a4524d718b2c09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:06.329339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:06.336458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 229/452] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:29:06 2022] GET /identity/v3/groups/333a14838c19454683a4524d718b2c09 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:06.336458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:06.351597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:06.351897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:06.352205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:06.352664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] PATH_INFO: `/v3/groups/7d0cd5a60d114ac59bfafe62bb7be6a0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:06.354421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0cd5a60d114ac59bfafe62bb7be6a0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:06.356037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:06.358420 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 224/453] 10.222.0.78 () {56 vars in 1180 bytes} [Sun Aug 28 19:29:06 2022] GET /identity/v3/groups/7d0cd5a60d114ac59bfafe62bb7be6a0 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:06.369918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:06.484688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0abe-daca-46fe-9d47-5a8ddfc80bf2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:06.486465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:06.510721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1a30d-7c47-4d56-85ac-b8a50bc9bc90 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:06.534301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:06.535912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:06.536197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:06.536483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:06.537300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] RBAC: Adding query filter params (group.id=333a14838c19454683a4524d718b2c09, role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:06.538025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:06.539121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e713f-294e-4c09-b6ee-e27b103ec5af None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:06.546178 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 230/454] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:29:06 2022] GET /identity/v3/role_assignments?group.id=333a14838c19454683a4524d718b2c09&scope.project.id=b3f49ed0e2e9471bb19d16f6c439a516&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:06.551290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:06.552043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:06.552529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:06.553237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:06.553978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] RBAC: Adding query filter params (group.id=7d0cd5a60d114ac59bfafe62bb7be6a0, role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=926e861f54084884ae9dc19520ca2e6d) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:06.554387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:06.556143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cecb-12b6-476d-904b-1e94d8781549 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:06.567583 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 225/455] 10.222.0.78 () {56 vars in 1376 bytes} [Sun Aug 28 19:29:06 2022] GET /identity/v3/role_assignments?group.id=7d0cd5a60d114ac59bfafe62bb7be6a0&scope.project.id=926e861f54084884ae9dc19520ca2e6d&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:09.187714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8b19-b539-4ff8-b27a-fb2984e3b3c9 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:09.188269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8b19-b539-4ff8-b27a-fb2984e3b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:09.188269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8b19-b539-4ff8-b27a-fb2984e3b3c9 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:09.190059 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 231/456] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:09.195648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614804a6-3547-469e-95ff-797bf0ebf668 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:09.196555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614804a6-3547-469e-95ff-797bf0ebf668 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:09.197052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614804a6-3547-469e-95ff-797bf0ebf668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:09.223140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-614804a6-3547-469e-95ff-797bf0ebf668 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:09.224719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-614804a6-3547-469e-95ff-797bf0ebf668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:09.282347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:09.325337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 226/457] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:09.661130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8b19-b539-4ff8-b27a-fb2984e3b3c9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:09.839966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8b19-b539-4ff8-b27a-fb2984e3b3c9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:09.897191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:09.898166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:09.898601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:09.899139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:09.906050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d731a-a8f7-42ca-8aaa-6c2ba84944e2 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:09.906809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d731a-a8f7-42ca-8aaa-6c2ba84944e2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:09.907299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d731a-a8f7-42ca-8aaa-6c2ba84944e2 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:09.911003 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 227/458] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:09.916767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:09.916985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a3f44-92a6-428f-b893-88ccee3bbf8f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:09.917250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a3f44-92a6-428f-b893-88ccee3bbf8f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:09.918004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a3f44-92a6-428f-b893-88ccee3bbf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:09.918253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:09.939581 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:09.941074 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:09.942553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:09.942553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:09.942553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:09.942553 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 232/459] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:09.946875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:09.964689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a58a3f44-92a6-428f-b893-88ccee3bbf8f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:09.966778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a58a3f44-92a6-428f-b893-88ccee3bbf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:09.971681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:10.069463 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 228/460] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:10.071646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459820-1618-463e-82f9-5fed1729ec9c None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:10.072069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459820-1618-463e-82f9-5fed1729ec9c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:10.072444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459820-1618-463e-82f9-5fed1729ec9c None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:10.074328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 229/461] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:10.089879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:10.090178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:10.091129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:10.091646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0fde6-f922-45b0-9ed8-26727b9f8716 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:10.112211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:10.113731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:10.147053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:10.148002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:10.148600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:10.149041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:10.149902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:10.150568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:10.153635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:10.172785 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 233/462] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:10.181292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:10.215641 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 230/463] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:10.280253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:10.306552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770d36-4d1c-447f-8551-cd88acddc975 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:10.347268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:10.353444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:10.353945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:10.354417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:10.355276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:10.356997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:10.476451 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 234/464] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:29:10 2022] POST /identity/v3/users => generated 246 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:29:10.559747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:10.631639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:10.725538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:10.771465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606acc6-cd18-4cb4-ad2e-b20aac4ce14f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:10.845134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:10.846323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:10.846824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:10.847314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:10.855904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b909d-f666-4e21-bffe-8c8c90b0ca6b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:10.881264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:10.884882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:10.916376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:10.917420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:10.917916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:10.918131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:10.919271 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:10.920180 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:10.920180 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:10.920180 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:10.920478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:10.920590 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 231/465] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:10.927409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:10.931484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:10.948397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:10.958138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:10.980527 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:10.982787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:10.984310 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:10.984310 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:10.984310 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:10.984310 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 235/466] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:10.993756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:11.146341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:11.153449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d993bc-f978-4aa7-8921-dfedd17fece0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:11.173337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6991-2442-468f-a790-0f94d379c6b2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:11.197226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:11.198197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.198600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.198886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.199578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:11.200446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:11.202262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81936-4ee2-455c-be66-36e019816e1b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:11.217282 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 236/467] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:11.218876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f29c-fc50-4a8f-9b4e-531ad9f3afbc None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.219198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f29c-fc50-4a8f-9b4e-531ad9f3afbc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.219430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f29c-fc50-4a8f-9b4e-531ad9f3afbc None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.224581 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 237/468] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:11.224581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee828b-9591-46b6-8266-9cbccb2454ae None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.224581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee828b-9591-46b6-8266-9cbccb2454ae None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.224581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee828b-9591-46b6-8266-9cbccb2454ae None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.224581 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 238/469] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:11.225276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee828b-9591-46b6-8266-9cbccb2454ae None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:11.247437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:11.248637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.249138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.249636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.250883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:11.251452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:11.254202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6cbe5-7938-4293-bb65-8d833976a568 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:11.279764 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 232/470] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:11.285749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982657e-eb89-44b6-9498-faf76ccb8003 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.286079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982657e-eb89-44b6-9498-faf76ccb8003 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.286369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982657e-eb89-44b6-9498-faf76ccb8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.307685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4982657e-eb89-44b6-9498-faf76ccb8003 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:11.307948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:11.308929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4982657e-eb89-44b6-9498-faf76ccb8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:11.401839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee828b-9591-46b6-8266-9cbccb2454ae None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:11.429748 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 233/471] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:11.432572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.433504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.434168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.466083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:11.467254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.468187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.469169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.470055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:11.470974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:11.472408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:11.473823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:11.578651 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 234/472] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:11.580534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:11.580981 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 239/473] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:29:11 2022] POST /identity/v3/users => generated 248 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:11.611518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:11.797336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69630cea-6b1e-48cf-ac6a-f3a7753cf08d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:11.882184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:11.883429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:11.883907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:11.884379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:11.885562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:11.888351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:11.936099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:12.029794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 235/474] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:29:11 2022] POST /identity/v3/users => generated 248 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:12.031540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:12.124647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b693a6e-61c9-430f-b366-5a58b8f700ca None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:12.127042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:12.168104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:12.171699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:12.178567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:12.178567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:12.178567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:12.187810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:12.189770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:12.208553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:12.209555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:12.210517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:12.210517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:12.210517 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:12.213001 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 240/475] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:12.221643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:12.233249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bb7e0-c7f0-4d37-a076-735cc7f417a5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:12.336496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:12.336496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:12.336496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:12.337307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:12.338092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:12.342212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:12.357805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c3c80-9c9f-4cf0-8947-e5ddeea6f005 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:12.411816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.sql.core [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 19:29:12.411816 n-d-854121-7 devstack@keystone.service[82299]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 19:29:12.411816 n-d-854121-7 devstack@keystone.service[82299]: [parameters: {'id': '85e7a59f833346f9af831a33b382ec5d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 19:29:12.411816 n-d-854121-7 devstack@keystone.service[82299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 19:29:12.421496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:12.424056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:12.424885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:12.425675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:12.427253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:12.428112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:12.431106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 19:29:12.444877 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:29:12.446477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application yield resource Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise self.value Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application session.commit() Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 19:29:12.449175 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.flush() Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application compat.raise_( Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 19:29:12.452945 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:29:12.456487 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:29:12.460867 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [parameters: {'id': '85e7a59f833346f9af831a33b382ec5d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:12.464978 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 19:29:12.466785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:12.468621 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 236/476] 10.222.0.78 () {60 vars in 1131 bytes} [Sun Aug 28 19:29:12 2022] POST /identity/v3/roles => generated 144 bytes in 417 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:12.468621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:12.488064 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 241/477] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:12.495476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:12.534143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:12.617581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea724-2cde-41fe-9828-76125d287032 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:12.658726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:12.682155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:12.683152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:12.683613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:12.684086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:12.716256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:12.719058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3105c-39b1-40f8-860a-1ae1621105c1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:12.726492 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:12.728292 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 19:29:12.729109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:12.732605 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 237/478] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:29:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:12.739359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:12.794497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb4c43-d8e2-4bf3-95f2-daa478cd1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:12.795491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4c43-d8e2-4bf3-95f2-daa478cd1537 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:12.796047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4c43-d8e2-4bf3-95f2-daa478cd1537 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:12.796517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4c43-d8e2-4bf3-95f2-daa478cd1537 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:12.797798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb4c43-d8e2-4bf3-95f2-daa478cd1537 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:12.800685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb4c43-d8e2-4bf3-95f2-daa478cd1537 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:12.899531 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 242/479] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:29:12 2022] POST /identity/v3/users => generated 249 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:13.005333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf7ce-86cf-40e0-9e1e-9f0beecd9101 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:13.078561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:13.079662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:13.080238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:13.080721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:13.081784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:13.082359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:13.084024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98732-60a8-4097-a453-6850809af640 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:13.095171 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 238/480] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:13.735485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb189f-70ce-44aa-969a-248af447f78e None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:13.736021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb189f-70ce-44aa-969a-248af447f78e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:13.736293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb189f-70ce-44aa-969a-248af447f78e None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:13.739403 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 243/481] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:13.745977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:13.746514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:13.746950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:13.783301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:13.785673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:13.872688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:13.920764 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 239/482] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:14.278578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb189f-70ce-44aa-969a-248af447f78e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:14.426427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:14.488556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb189f-70ce-44aa-969a-248af447f78e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:14.558421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:14.559571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:14.560082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:14.560597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:14.583053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:14.594541 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:14.595826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:14.596621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:14.597233 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 244/483] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:14.604247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:14.854393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff864ab-bcff-4dbc-8c0d-096843b11079 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:14.942005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:14.943188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:14.943777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:14.944274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:14.945534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:14.946109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:14.948815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:14.973464 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 240/484] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:14.982290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:15.185632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a273c2-506d-466b-8293-fdbded11c484 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:15.244286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:15.254816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:15.256011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:15.256453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:15.256877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:15.278494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:15.281140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8fda4b0f-5293-4837-8894-2056c2555d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:15.310860 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:15.311834 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:15.312662 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:15.312662 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:15.312662 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:15.313876 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 245/485] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:15.323311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:15.454401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:15.471981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb351-b484-43e1-ab38-79f47c22673d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:15.472507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb351-b484-43e1-ab38-79f47c22673d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:15.472955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb351-b484-43e1-ab38-79f47c22673d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:15.482055 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 246/486] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:15.485212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:15.485665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:15.486143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:15.519392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:15.521444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:15.662726 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 247/487] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:15.677374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e00a4-5491-4f1b-9601-8891575cf427 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:15.763401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:15.764400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:15.764893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:15.765383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:15.766786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:15.767342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:15.770108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880442-86f9-4b6e-90bd-10c9558bbc02 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:15.795983 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 241/488] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:15.803328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:15.948983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5283-2835-4a0c-ab14-339624f9b1e3 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:15.949597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5283-2835-4a0c-ab14-339624f9b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:15.950079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5283-2835-4a0c-ab14-339624f9b1e3 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:15.952769 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 242/489] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:15.961970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:15.961970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:15.961970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.014291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:16.015928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:16.042631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436946f-e33b-4c3f-94f0-253d66bac546 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:16.076299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:16.120984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:16.123375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.123881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.124359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.141922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:16.145445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:16.182010 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 243/490] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:16.182393 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:16.183765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:16.184699 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:16.185229 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 248/491] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:29:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:16.190554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:16.192030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:16.253610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:16.429896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3b2cd-39db-4835-b0b1-e172dc57cc1e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:16.430166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc5dd-c843-4004-8c60-f0af087cdef6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:16.476808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:16.477465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.478011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.478472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.479579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:16.480221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:16.483771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:16.532374 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 244/492] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:29:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:16.540819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:16.564984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4ee6-cb65-4d74-acd3-958717b6e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:16.566180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4ee6-cb65-4d74-acd3-958717b6e81d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.566698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4ee6-cb65-4d74-acd3-958717b6e81d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.567204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4ee6-cb65-4d74-acd3-958717b6e81d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.606331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f4ee6-cb65-4d74-acd3-958717b6e81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-172f4ee6-cb65-4d74-acd3-958717b6e81d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:16.618189 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:16.619420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:16.620311 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 249/493] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:16.622549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1d74-97d0-4994-925d-3be2e8d01f84 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.623018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1d74-97d0-4994-925d-3be2e8d01f84 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.623490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1d74-97d0-4994-925d-3be2e8d01f84 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.632734 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 250/494] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:16.634375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1d74-97d0-4994-925d-3be2e8d01f84 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:16.708104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:16.732928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:16.747969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1d1c-f28f-4bc3-b4ae-0236334a72d8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:16.796738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:16.797461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.797663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.798108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.854353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1d74-97d0-4994-925d-3be2e8d01f84 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:16.901072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:16.904496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:16.911109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:16.911741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.912027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.912303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.913013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:16.913320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:16.915630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ffc8e-f0d3-43a8-adae-94e063b61c03 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:16.935568 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 251/495] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:16.935568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.935568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.935568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.955138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:16.956623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:17.064475 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 252/496] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:17.066159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.103029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:17.123867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:17.126667 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 245/497] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:29:17.131558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.275681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5e83-24e4-42e8-819f-f54307c81fb9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:17.295940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70070d-f591-43aa-bebe-7611c465c2db None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:17.323452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b232-abd8-4766-8ce1-973ebf1228de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:17.324163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b232-abd8-4766-8ce1-973ebf1228de None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.324631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b232-abd8-4766-8ce1-973ebf1228de None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.324920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b232-abd8-4766-8ce1-973ebf1228de None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.339213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9b232-abd8-4766-8ce1-973ebf1228de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-b0c9b232-abd8-4766-8ce1-973ebf1228de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:17.344723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:17.346686 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:17.348215 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:17.358244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 253/498] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:17.358244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f536-9be0-48d5-9a8c-cbcb3fe2ac90 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.358244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f536-9be0-48d5-9a8c-cbcb3fe2ac90 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.358244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f536-9be0-48d5-9a8c-cbcb3fe2ac90 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.358244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 254/499] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:17.358244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f536-9be0-48d5-9a8c-cbcb3fe2ac90 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.374626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:17.375728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.376172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.376605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.394917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:17.397841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:17.429116 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:17.430481 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:17.431382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:17.431382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:17.431382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:17.431709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 246/500] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:17.433326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.484870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:17.509820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f536-9be0-48d5-9a8c-cbcb3fe2ac90 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:17.523833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:17.573352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:17.574464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.574961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.575455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.594664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:17.597510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:17.602735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73841c-fd8c-43df-a858-b44d75a4eb1f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-55081ef1-6b8c-462a-a712-420ddc4fe91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:17.622485 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:17.624414 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:17.625361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:17.625361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:17.625361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:17.625361 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 255/501] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:17.625361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.625632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.626086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.647524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:17.648864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:17.660252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:17.660832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.661330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.661810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.663122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:17.663666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:17.666393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:17.682938 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 247/502] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:17.684628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.745224 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 256/503] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:17.746834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.855449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:17.869551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a0df0-e69a-4762-82b9-9c1bf717a7d5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:17.872755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:17.900943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985902c-3704-4d85-bfe6-eaad20b12cd6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:17.933883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:17.934610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.934883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.935251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.948853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:17.950567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:17.966193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:17.966731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:17.967235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:17.967515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:17.968281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:17.968794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:17.970702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:17.976584 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:17.982550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:17.983386 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:17.983386 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:17.983386 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:17.983386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 248/504] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:17.983386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:17.993346 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 257/505] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:17.997920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.142140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1325fa-d78a-48a7-8139-fc1d1c87439f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.146346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6c56-6736-470c-af5d-c696f1cd7681 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.178224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:18.189293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.190035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.192020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.192020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.192313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.192313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.192566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.192847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.193444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:18.193755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.195239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:18.205186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.207074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:18.210307 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 249/506] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:18.211191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:18.229397 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:18.231777 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:18.234057 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:18.234057 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:18.234057 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:18.237815 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 258/507] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:18.238091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:18.238386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.374152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5ede6-6645-4aaf-9f3f-3e1f834aa8d5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.374479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b419d-d459-4322-94ff-4250f70e92e7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.429606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.430333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.430680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.431024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.431846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:18.432352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.434963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:18.443482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.444136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.444421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.444738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] PATH_INFO: `/v3/users/glance` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.451226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 250/508] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:18.452611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.455183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.457266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:18.471319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:18.472973 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 259/509] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:18.474715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.527863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:18.557716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:18.596543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920a31-6f04-4bf3-b0cb-09bfec5f7ecb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.628039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349f4c8-d916-4594-b0fb-03173be28dce None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.648959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.650086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.650667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.651160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.665569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.669162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:18.673653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.674673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.675133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.675566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.676780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:18.677546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.680321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:18.686504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:18.688191 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:18.689931 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 251/510] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:18.691685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.701704 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 260/511] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:18.703188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.823199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ab3d-9cee-4590-946a-ba706f3b0f42 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.860833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:18.864898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.865637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.866042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.866435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.867455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1344a-1a01-4799-99c1-da56c8cf2c09 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:18.868910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:18.880297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:18.885431 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:18.888297 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 252/512] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:18.890576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:18.920755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:18.921498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:18.921654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:18.921970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:18.922707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:18.924161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.026492 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 261/513] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:29:18 2022] POST /identity/v3/users => generated 247 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:19.027529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:19.070015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639394d9-b1c4-4b9e-9da0-a7a7d1218df6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:19.136036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:19.137540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:19.138024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:19.138661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:19.139810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:19.140305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:19.143305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.176153 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 253/514] 10.222.0.78 () {56 vars in 1137 bytes} [Sun Aug 28 19:29:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:19.179279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:19.239290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68d041-440f-4744-bbe6-4e6e91e74c2c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:19.286492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:19.295730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:19.296375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:19.296758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:19.297144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:19.298024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:19.305892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:19.305892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.332490 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 262/515] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:19.334424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:19.367207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:19.381189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d213e-505d-41c8-b62f-9e21bc6c881a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:19.444738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:19.445446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:19.445756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:19.446094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:19.454904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:19.456382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:19.471522 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:19.473206 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 254/516] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:19.474912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:19.512842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2155-e3f5-46fb-a32f-dd6e70d8e99c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:19.566250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:19.567386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:19.567884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:19.568398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:19.569683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:19.570272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:19.573024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.589527 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 263/517] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:19.591897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:19.633323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f494fd2-20ce-475d-a82d-19956e73e6d6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:19.652726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:19.684582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:19.685207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:19.685700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:19.686105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:19.730126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:19.762467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083627d-5407-4af6-9785-c225e3e7e961 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:19.807967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:19.809729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:19.810155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.810653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:19.811113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:19.811583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:19.812497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c9cf360f24634e1aa0edb2900994d9b7) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:19.813142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:19.815510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:19.830178 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 264/518] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:19 2022] GET /identity/v3/role_assignments?user.id=c9cf360f24634e1aa0edb2900994d9b7&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:19.830178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.010924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bfd1-8e87-4a73-a6bd-babd1eae980f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:20.016468 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 255/519] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:20.018064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.040343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:20.082591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:20.083604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:20.083906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:20.084451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:20.085309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:20.085776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:20.090940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:20.157195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:20.189990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 265/520] 10.222.0.78 () {56 vars in 1137 bytes} [Sun Aug 28 19:29:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:20.192243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.223522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc6e9-56ba-4236-8d10-4b8522a13c21 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:20.278495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:20.279645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:20.280270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:20.280810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:20.301900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:20.303704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:20.333223 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:20.334983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:20.336781 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:20.336781 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:20.336781 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:20.336781 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 256/521] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:20.336781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.410320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e04f-65f2-4882-b206-a1a704515073 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:20.432972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:20.480530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab0c2-eeb0-45ba-9be1-a9d54c501f84 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:20.482118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:20.483579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:20.484406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:20.485157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:20.505889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:20.509548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:20.524606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:20.525289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:20.525583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:20.525983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:20.542685 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:20.544435 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:20.546262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:20.546262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:20.546262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:20.549554 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 266/522] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:20.551674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.613660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:20.615098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:20.694369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:20.706629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:20.765633 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 257/523] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:20.767213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.768234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023d78a-2a17-46e5-9140-1c8cd7a07f05 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:20.836970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:20.838378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:20.839153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:20.840431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:20.841959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:20.842827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:20.845911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:20.872668 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 267/524] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:20.874671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:20.965049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c63c3-58da-4fea-b60d-5f0b22288ba5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.034083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.035122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.035614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.036101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.037402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:21.037976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.040875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.062480 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 258/525] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:21.063889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.087782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2bfc7-ff6e-476f-ae29-38b7487bdce9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.112275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:21.114000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:21.159464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.160943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.161713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.162571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.185900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.189196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:21.221972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:21.224409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:21.226586 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:21.226586 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:21.226586 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:21.231338 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 268/526] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:21.234297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.253389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adfb0-ffce-4579-a1f8-4cf3c0206b79 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.314080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.315149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.315627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.316103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.332646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.335469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:21.360503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:21.362242 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:21.363972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 259/527] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:21.365077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.434558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2486c-374a-4e2e-9d4f-f92a1493647b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.482604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.483355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.483635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.483907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.492619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.494262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-183c4968-1dac-420c-8839-cd788c6dcf45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:21.510109 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:21.512538 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:21.514714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:21.517173 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 269/528] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:21.518782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b998c5e-89ea-4b29-b954-831e40f7fb14 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.519066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b998c5e-89ea-4b29-b954-831e40f7fb14 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.519341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b998c5e-89ea-4b29-b954-831e40f7fb14 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.520811 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 270/529] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:21.521652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b998c5e-89ea-4b29-b954-831e40f7fb14 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.539636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:21.560199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806fa59-f250-487c-b5c0-b4fd5f909cc8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.577154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:21.616501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.617686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.618337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.618910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.620313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:21.620937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.624393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.651910 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 260/530] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:21.653272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.706901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b998c5e-89ea-4b29-b954-831e40f7fb14 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.765614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.766443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.766911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.767386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.768322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:21.768760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.770626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97943-6899-49b2-a672-b340acbae420 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.797753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 271/531] 10.222.0.78 () {56 vars in 1139 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:21.797753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72974fa-ffdb-422e-928f-343662817467 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.797753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72974fa-ffdb-422e-928f-343662817467 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.797753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72974fa-ffdb-422e-928f-343662817467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.819624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c72974fa-ffdb-422e-928f-343662817467 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:21.821446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c72974fa-ffdb-422e-928f-343662817467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:21.858415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a451-7787-454d-b06d-09dba01e336d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.909472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.910611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.910992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.911864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.912719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:21.913472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.915595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.934210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 272/532] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:21.934210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72974fa-ffdb-422e-928f-343662817467 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.947553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 261/533] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:21.948764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.954977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:21.967494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:22.095816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72974fa-ffdb-422e-928f-343662817467 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:22.152044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:22.153486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.155326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.155326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.163333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:22.164976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:22.179479 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:22.181360 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 273/534] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:22.183089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:22.202179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb47bf-b33a-4700-9766-c774850f4c45 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:22.243912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:22.244436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.244719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.245002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.329112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:22.330582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:22.332217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:22.335591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:22.383269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca788-97aa-43a0-9767-44cffbf76bd5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:22.437904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:22.438534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.438795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.439060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.439828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=2c178aac643a48d48f2707b407ffa65f) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:22.440147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:22.441839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:22.453639 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 274/535] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:22 2022] GET /identity/v3/role_assignments?user.id=2c178aac643a48d48f2707b407ffa65f&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:22.453639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:22.496344 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 262/536] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:22.498262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:22.611364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fcaa7-aa5b-4e1d-a793-3315c4a74046 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:22.663678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:22.664299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.664573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.664837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.665584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:22.665916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:22.667544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:22.669840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:22.687635 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 275/537] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:22.688904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:22.712884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755811cc-21f9-4935-9427-a72b3f0dd2a6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:22.716360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:22.768682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:22.769222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.769525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.770120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.794554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:22.804537 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:22.805527 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:22.806424 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:22.810899 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 263/538] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:22.812967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:22.837035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9a048-ef30-4453-b17a-4760f5cd88d3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:22.895157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:22.896264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.896761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.897267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.913183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:22.916112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9f70a42e-eb48-48a7-9051-88fc19f2c8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:22.945649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:22.946825 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:22.947846 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:22.947846 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:22.947846 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:22.947846 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 276/539] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:22.950094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf1000-c519-42d6-992e-a86db857fc44 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:22.950614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf1000-c519-42d6-992e-a86db857fc44 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:22.951102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf1000-c519-42d6-992e-a86db857fc44 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:22.959103 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 277/540] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:22.959103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf1000-c519-42d6-992e-a86db857fc44 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:22.970776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efc587-81ac-449e-8b97-e7bc2a423237 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:23.016243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:23.016871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:23.017164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:23.017460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:23.018290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=53cb76d30b8a4dc7961464c640315123) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:23.018613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:23.020290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:23.026796 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 264/541] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:22 2022] GET /identity/v3/role_assignments?user.id=53cb76d30b8a4dc7961464c640315123&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:23.028209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:23.052256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:23.092415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:23.173059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf1000-c519-42d6-992e-a86db857fc44 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:23.215656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34359923-1450-4ff2-9833-bf738aa2c641 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:23.247971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:23.249014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:23.249603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:23.250165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:23.251153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:23.251819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:23.254891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804442-40dc-466b-972f-aa61a081a0f1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:23.264840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:23.265730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:23.266065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:23.267043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:23.267254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:23.267418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:23.269121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:23.279698 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 278/542] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:23.282508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:23.283321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:23.283769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:23.285127 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 265/543] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:23.291168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:23.317578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:23.319625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:23.445968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:23.459557 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 279/544] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:23.459557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:23.493263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eea1a-46e0-4228-95da-aa8c26e2e20c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:23.525506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:23.630087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:23.631540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:23.632622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:23.633313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:23.656988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:23.660466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:23.671432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc631fc-0773-4a26-ba0e-dffc904092bc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:23.698983 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:23.700948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:23.702666 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:23.702666 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:23.702666 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:23.706856 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 266/545] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:23.719995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:23.827657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:23.828643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:23.829133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:23.829606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:23.859403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:23.862593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:23.895694 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:23.897432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:23.899681 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 280/546] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:23.909421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.014515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1cd5-e70e-4ff2-a17d-9697c56e9dc6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.087783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.089273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.090815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.091598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.093290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:24.094144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:24.097208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:24.115701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:24.120974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:24.129898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 267/547] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:24.129898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.136166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ddae4-9ece-44e4-a4b5-3d7fba4e8647 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.213231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.215350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.216047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.216876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.239946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:24.250666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:24.252420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:24.254013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:24.265989 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 281/548] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:24.268150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.342601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2cc7-f54c-43da-9700-ba86fcb9270a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.412082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.413181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.413801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.414471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.415967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:24.416646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:24.420570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:24.446936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 268/549] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:24.449842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.494533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b542-b3f5-4559-a925-d3b52c1d8506 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.568102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.569757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.570603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.571496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.573351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:24.590425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:24.593653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:24.620237 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:24.622085 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:24.623806 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:24.638675 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 282/550] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:24.641155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.653800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d05d-ec90-4ba4-a467-eb7e5aaf2420 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.679726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:24.726089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.727429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.728589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.728589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.729993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:24.731203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:24.734206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:24.757325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 269/551] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:24.757325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.836694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdef992-0552-478a-be6f-1db1d35a1ab5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.882492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.883719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.884219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.884674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.885729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=a4db71575637416dacaae1294f043167) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:24.886262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:24.888635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:24.896343 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 283/552] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:24 2022] GET /identity/v3/role_assignments?user.id=a4db71575637416dacaae1294f043167&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:24.897616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:24.949295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dde21-e026-4476-8062-37a3cdc5fba8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:24.981069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:24.996721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:24.997565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:24.997982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:24.998356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:24.999203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:24.999579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:25.001452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873843-6800-4bd3-8208-2633f2cbd7f4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:25.021187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:25.031121 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 270/553] 10.222.0.78 () {56 vars in 1135 bytes} [Sun Aug 28 19:29:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:25.032688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc38a8-ecc7-4ce9-b694-34c00a8b8051 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.033069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc38a8-ecc7-4ce9-b694-34c00a8b8051 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.033397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc38a8-ecc7-4ce9-b694-34c00a8b8051 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.036524 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 271/554] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:25.036524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc38a8-ecc7-4ce9-b694-34c00a8b8051 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:25.045595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa693fd-3287-4ca7-9755-0785e408caca None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:25.094572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:25.095281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.095557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.095896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.112582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:25.114526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-30995c35-6a02-4dc5-bbc5-3a7fae4f8d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:25.133627 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:25.137312 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:25.142333 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:25.142333 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:25.142333 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:25.142333 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 284/555] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:25.142333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.142333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.143034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.165653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:25.167461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:25.177737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc38a8-ecc7-4ce9-b694-34c00a8b8051 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:25.223724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff412c-e663-44f4-928a-5c5c2cf7c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:25.223986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff412c-e663-44f4-928a-5c5c2cf7c702 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.224080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff412c-e663-44f4-928a-5c5c2cf7c702 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.224467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff412c-e663-44f4-928a-5c5c2cf7c702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.261788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 285/556] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:25.263014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:25.313943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:25.352697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:25.356148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff412c-e663-44f4-928a-5c5c2cf7c702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:25.366097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff412c-e663-44f4-928a-5c5c2cf7c702 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:25.408258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6d2a1-e5b7-42aa-9bd2-7b52e3af6b7e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:25.455542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:25.456639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.457104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.457616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.458737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:25.459284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:25.461158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:25.477048 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 286/557] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:25.484235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:25.592608 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 272/558] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:25.594928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91a543-d7f9-4f44-9663-fa1127e4b35b None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.595408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91a543-d7f9-4f44-9663-fa1127e4b35b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.595928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91a543-d7f9-4f44-9663-fa1127e4b35b None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.602164 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 273/559] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:25.602164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91a543-d7f9-4f44-9663-fa1127e4b35b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:25.638400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025ec3-093a-44e1-a529-dfeea4f8832d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:25.673966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:25.692348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:25.693467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.694052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.694600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.708949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:25.712852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-fa758ff8-1451-4f8b-a086-299bda7be115 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:25.734301 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:25.736176 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:25.738023 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 287/560] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:29:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:25.739343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.740525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.741046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.770383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:25.771950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:25.772066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:25.810844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91a543-d7f9-4f44-9663-fa1127e4b35b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:25.862195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:25.862918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:25.863205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:25.863481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:25.876362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:25.878013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:25.889890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 288/561] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:25.889890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:25.905342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:25.906866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:25.908296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:25.908296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:25.908296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:25.908296 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 274/562] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:25.909359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.036773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001122c8-3d40-4e3f-bb65-d3e8eddc2afd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.066295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:26.106743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.108423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.109425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.110310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.112040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:26.112999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:26.114419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54625b7b-a3ca-40ef-a4e9-6c68249ac8f1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.116509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:26.150524 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 289/563] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:29:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:26.152065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.166088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:26.172377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.172377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.177828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.177828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.187292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:26.192499 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:26.194329 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:26.196568 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:26.198439 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 275/564] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:26.200024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.338990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30ae34-75c3-45da-9f8f-ba161467459d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.368698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29997-86e5-4b75-ab77-97806d0f2344 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.408084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.409520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.410034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.410472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.430613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:26.433574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:26.438251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.439241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.439241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.439544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.440138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:26.440444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:26.441960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:26.465225 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 290/565] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:26.465225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:26.465640 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:26.467335 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:26.470482 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:26.470482 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:26.470482 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:26.470482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 276/566] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:26.470482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.515079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:26.558799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:26.611265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80094-dc6f-4350-9bc7-789eef4f0015 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.640696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03256-b222-4dec-bcfa-2fcaa2ef7cab None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.658780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.659606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.659754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.659961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.660711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:26.661135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:26.662783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:26.678627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 291/567] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:26.679626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.691863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.692851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.693329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.693829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.716294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:26.722216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:26.723218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:26.724675 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 277/568] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:26.725723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.838396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:26.848486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e07d-77fc-424d-b69b-cfeeeb793be5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.900496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b6cf5-541c-4477-b01e-06e5f4edf80c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:26.906439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:26.907336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.908123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.908522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.908839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.922838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:26.925546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:26.943544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:26.945321 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 292/569] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:26.947143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:26.966368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:26.967058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:26.967347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:26.967616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:26.968289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:26.968602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:26.970116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:26.990997 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 278/570] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:26.991878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.095716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174bc56-3541-4507-af2e-9be9d4c974a5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.149614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.150703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.151476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.151942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.169673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.171454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.171692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32761-2fe9-4f59-9706-96fb728d899c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:27.190839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:27.192042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:27.193128 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:27.193128 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:27.193128 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:27.199941 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 293/571] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:27.199941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.211160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:27.236501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.237132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.237477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.237757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.238501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:27.238812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.240469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.251403 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 279/572] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:27.252292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.301059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:27.339700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed2869-ac46-4dab-9c69-abb30cf8fe3d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.403898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.404776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.405249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.405677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.406974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:27.407491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.409709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.426504 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 294/573] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:27.427397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.455251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb16e66-9f17-4bb8-b077-686e0892290a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.500925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.501944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.501944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.502205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.510452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.512844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.518108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:27.527683 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:27.538827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 280/574] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:27.539703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.568981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099da58-3f83-4f4c-b92b-e6bf2ea27784 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.625141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.626095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.626509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.626915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.627909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:27.628355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.630614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299584-193f-4d06-923a-e74cad1aaa66 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.643007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:27.651214 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 295/575] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:27.653549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b618-2ce3-4fd5-9a0e-9c396d869f10 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.658043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b618-2ce3-4fd5-9a0e-9c396d869f10 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.658043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b618-2ce3-4fd5-9a0e-9c396d869f10 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.658043 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 296/576] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:27.658583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84b618-2ce3-4fd5-9a0e-9c396d869f10 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.665794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d28bc-4d4d-474d-8bf5-5a48f0679d6d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.709258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.710469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.710958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.711454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.732526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.736559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:27.758843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:27.761419 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:27.764209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:27.764209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:27.764209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:27.764209 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 281/577] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:27.764209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.820305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84b618-2ce3-4fd5-9a0e-9c396d869f10 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:27.861775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:27.876330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:27.877190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:27.877595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:27.878041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:27.879182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=1120d09d46e5416a9257f2a40da688d5) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:27.879632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:27.882110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:27.901150 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 297/578] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/role_assignments?user.id=1120d09d46e5416a9257f2a40da688d5&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:27.901150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:27.926791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb38d98-b338-435d-9051-ba0776daa833 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:28.002051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:28.003127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.003688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.004201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.005548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:28.006148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:28.009315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90115784-8582-4ba0-848f-e5ab4f92be5a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:28.029832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:28.034298 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 282/579] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:28.039982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.040355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.043157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.072851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:28.074211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:28.099697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311b0bd-6304-4408-a545-3a5119d55793 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:28.162457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:28.163355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.163769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.164176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.176088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:28.178246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:28.193300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:28.195577 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 19:29:28.198560 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:28.202373 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 298/580] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:28.203440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:28.204920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 283/581] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:28.213943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:28.326813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:28.413518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd0a5-353f-4247-a183-77f3be275133 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:28.449955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8becaa-ecb4-4a2f-b1c1-e52911b9a5e6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:28.459621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:28.474695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:28.475825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.476298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.476761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c9cf360f24634e1aa0edb2900994d9b7/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.505901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=c9cf360f24634e1aa0edb2900994d9b7, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:28.508783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:28.528157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:28.529149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.529653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.530192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.531138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:28.531652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:28.533313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:28.549414 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 299/582] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:28.553631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:28.582866 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 284/583] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:28 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c9cf360f24634e1aa0edb2900994d9b7/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:28.584780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:28.700549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4cb5-566b-4a1d-be78-4fe11582726f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:28.722782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:28.750765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:28.751702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.752166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.752643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.753673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:28.754191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:28.757893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:28.780177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4589f-d2a9-4e67-b47a-d08595b3c0d9 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:28.798953 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 300/584] 10.222.0.78 () {56 vars in 1137 bytes} [Sun Aug 28 19:29:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:28.800220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:28.859053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:28.859988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:28.860488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:28.860962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:28.876084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:28.882077 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:28.884264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 285/585] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:28.885301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:28.936794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.005908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93ffb5-3f2b-4a6b-a04e-a722dc755476 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.016680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7421ef0-7478-492e-8e06-b323b4d242bd None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.062496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.063199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.063484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.063766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.081918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.081918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.082297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.082297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.082609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.083020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.097587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:29.098337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:29.099972 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:29.102942 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:29.102942 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:29.102942 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:29.103547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.106823 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 286/586] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:29.106823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:29.119481 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:29.122178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:29:29.124040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:29.126551 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 301/587] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:29.128233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.174307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.288619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.301500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c038-b201-4d19-b701-279ea0e80ab7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.307027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038149f-6be9-4778-8195-f139ab97545a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.348306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.349015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.349345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.349708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.350613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:29.351054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.354967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.373906 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 287/588] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:29.373906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.388026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.388666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.389100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.389538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.390478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:29.390794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.392402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.418873 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 302/589] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:29.420611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.554871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cedc8-e488-4c95-a7c6-e2d90133a04a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.590213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.600085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.601302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.601922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.602365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.607013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:29.607013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.607013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.615278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d130f4-66ca-4beb-86f4-f15b60fdf9a7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.635688 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 288/590] 10.222.0.78 () {56 vars in 1137 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:29.637670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.653433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.673108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.674217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.674533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.675441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.689528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.691488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:29.722929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:29.724232 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:29.725188 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:29.725188 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:29.725188 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:29.733687 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 303/591] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:29.736063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.771227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e737-5114-4f5b-921c-761363c58290 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.814403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.815890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.816332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.816756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.825637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.827434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:29.842929 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:29.844003 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:29.844981 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:29.854718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 289/592] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:29.857622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:29.906891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685fa6-979d-452d-b9b4-977f5239526f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:29.951329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:29.952031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.952414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.952700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.970055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.972950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:29.974936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:29.992519 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:29.994709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:29.996803 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:29.996803 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:29.996803 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:29.999775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:30.000371 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 304/593] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:30.001334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.072517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf3de-cb87-45d9-8422-46a2bef09532 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.124478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe97b2-cefb-4021-ac98-b019ed9bc724 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.129025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.129645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.129969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.130246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.130909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:30.131215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.132979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.150600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 290/594] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:30.153273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.197160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.199266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.200168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.201168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.202550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:30.203086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.206023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d700d7-44a8-4f96-bacc-ae99fe1bd886 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.231066 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 305/595] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:30.233488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278372d-fe4b-4583-bf84-f77f756f4070 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.234019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278372d-fe4b-4583-bf84-f77f756f4070 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.234506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278372d-fe4b-4583-bf84-f77f756f4070 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.237348 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 306/596] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:30.238828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278372d-fe4b-4583-bf84-f77f756f4070 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.347599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bd01e-6718-46b8-9d71-d69ac5ca614a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.356121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:30.392142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:30.399900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.400529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.400810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.401082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.402788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:30.402788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.404132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.423515 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 291/597] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:30.423515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.435452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278372d-fe4b-4583-bf84-f77f756f4070 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.478009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.478654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.478933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.479212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.491203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.493499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-4abdeb6b-0d20-4b44-9566-f02d54c17c52 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:30.509967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:30.520903 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 307/598] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.522990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.524338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.534358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:30.535587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:30.620730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be459fb3-0452-4593-a894-3a33a19a7637 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.641886 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 308/599] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:30.641886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.684567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.685434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.685714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.686047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/2c178aac643a48d48f2707b407ffa65f/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.699313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:30.708985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=2c178aac643a48d48f2707b407ffa65f, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.716176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.775520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08851832-d672-4968-ac4f-d633f272ecaa None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.821424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.822479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.822954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.823452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.832605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.834419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:30.850814 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:30.851810 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:30.852676 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:30.853290 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 309/600] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:30.859171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.892575 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 292/601] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:30 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/2c178aac643a48d48f2707b407ffa65f/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:30.892575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:31.042368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:31.111580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297549-1357-4ca6-82e1-9aa81661e8a1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:31.113584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:31.137368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf457f-090d-4f08-965e-5e67f83ece98 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:31.162074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:31.162637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.162887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.163131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.163925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:31.164220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:31.165770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:31.185286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:31.185992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.186344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.186812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.187665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:31.187978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:31.189809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be9430-99ad-4c56-9566-892db83ba0c2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:31.190949 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 310/602] 10.222.0.78 () {56 vars in 1139 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:31.194513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:31.207173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 293/603] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:31.208584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66598e3-ea41-4150-9652-e6f367a4e61c None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.208873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66598e3-ea41-4150-9652-e6f367a4e61c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.209149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66598e3-ea41-4150-9652-e6f367a4e61c None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.218054 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 294/604] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:31.219599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66598e3-ea41-4150-9652-e6f367a4e61c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:31.349198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf130134-c561-4d40-a523-c0441c552254 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:31.366947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:31.373961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66598e3-ea41-4150-9652-e6f367a4e61c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:31.398977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:31.400020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.400540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.400976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.424022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:31.431967 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:31.434079 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:31.435406 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 311/605] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:31.436927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:31.440697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:31.441608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.442710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.442710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.461033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:31.462713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:31.475196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b33fe9b0-1349-47af-aee2-b63a21bc35e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:31.493738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:31.495118 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:31.496734 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:31.496734 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:31.496734 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:31.502313 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 295/606] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:31.503780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.504430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.504430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.525657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:31.526987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:31.598825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab42b7-9f61-49fd-a5ae-3ca0c3b3bd87 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:31.607528 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 296/607] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:31.610032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:31.653838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:31.654553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.654833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.655111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/53cb76d30b8a4dc7961464c640315123/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.691668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=53cb76d30b8a4dc7961464c640315123, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:31.694765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:31.750958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:31.774800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d5a7-6da3-4353-8b93-4b55b9a83aeb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:31.826284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 312/608] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:31 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/53cb76d30b8a4dc7961464c640315123/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:31.827575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:31.831617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:31.832801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:31.833563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:31.834174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:31.836277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:31.840458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:31.842068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:31.858714 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 297/609] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:31.865883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.000687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:32.001900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374c8d-288f-4b53-8cb1-5178ea58a086 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.045900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.046493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.046775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.047057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.060678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.062205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.065508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:32.072585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080be072-69a7-43d2-8e30-4d218a028893 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:32.079637 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:32.081330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:32.082519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:32.082519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:32.082519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:32.082519 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 298/610] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:32.086176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.146559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.147263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.147551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.147820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.149128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:32.149545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.152358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.172871 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 313/611] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:32.174025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.270616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4825-8bf1-4ac0-a584-85db76effe85 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.338591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.340156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.340393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.340787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.357185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:32.363420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:32.364632 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:32.365503 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:32.372781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8d53-2998-40cf-a054-587fef41be37 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.373118 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 299/612] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:32.374536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.407561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:32.420294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.422080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.422620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.423823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.424037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:32.424842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.426767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.458590 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 314/613] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:32.460145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.471221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:32.528571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baef3a-dbab-4c1c-8251-75a586ccd81e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.587200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.588322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.588915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.590099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.598591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.600469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.607241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2bddf-4dd0-4139-8096-c109c2635e77 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:32.614250 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:32.615323 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:32.616231 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:32.623454 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 300/614] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:32.624778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.664578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.665350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.665888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.666424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.667393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:32.667846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.669900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.687351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 315/615] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:32.688382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.752364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984f76-4dc7-4d69-9133-0013b92f3773 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.773481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:32.796662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.797692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.798217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.798406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:32.798845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.809131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.810868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:32.826048 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:32.828101 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:32.830246 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:32.834186 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 301/616] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:32.835348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.889737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431c1ea-242e-4695-a368-f0fcac4de8a4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:32.933673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:32.934635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:32.935082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:32.935505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:32.936438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:32.936958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:32.938816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:32.954053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 316/617] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:32.955372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:32.967653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61182d-d485-43a4-abd5-a83d52de7349 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.010994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.012296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.012510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.012748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.026985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.028838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:33.046869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:33.047899 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:33.048799 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:33.048799 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:33.048799 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:33.052663 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 302/618] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:33.053731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.090122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c09b7-6ef2-4d68-82be-72a0b6c2741e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.090370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:33.108412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:33.134034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.135462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.135879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.136514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.137588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:33.137949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.139597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.172638 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 317/619] 10.222.0.78 () {56 vars in 1135 bytes} [Sun Aug 28 19:29:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:33.174326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.201497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc21d67-d9db-4175-8981-b1c861c01ada None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.260280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.260990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.261371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.261654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/a4db71575637416dacaae1294f043167/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.285170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=a4db71575637416dacaae1294f043167, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.287379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.315318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c92390-bb11-409f-8f2b-fb098c79dbfb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.359590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.361111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.361111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.361111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.361477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:33.361759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.363216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35596-74c3-4a57-a287-92734ec292d7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.385884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 318/621] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:33.385884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a578cb4-1d7e-41dc-9a73-3edf1e8b7d49 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.385884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a578cb4-1d7e-41dc-9a73-3edf1e8b7d49 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.385884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a578cb4-1d7e-41dc-9a73-3edf1e8b7d49 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.385884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 319/622] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:33.385884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a578cb4-1d7e-41dc-9a73-3edf1e8b7d49 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.387112 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 303/622] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:33 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/a4db71575637416dacaae1294f043167/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:33.394148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.455999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:33.576838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:33.604992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a578cb4-1d7e-41dc-9a73-3edf1e8b7d49 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.627445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3690c44-6c37-4d8c-ad9e-dbd42f782c07 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.690407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.691538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.692055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.692519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.704441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.705114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.705403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.705683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.719550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.720416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.721068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.724270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-14803543-b4b7-4526-ac05-32efba77314a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:33.736397 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:33.738236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 304/623] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:29:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.739976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.741339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:33.759812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:33.762022 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:33.763249 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:33.763249 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:33.763249 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:33.765163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:33.765720 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 320/624] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:33.766664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:33.767249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.854065 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 305/625] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:33.855219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.882142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:33.906846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ffc52-b0b0-4f95-a024-9e44161f5c91 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:33.946392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:33.951277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:33.952181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:33.952644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:33.953117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:33.954199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:33.954712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:33.956549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:33.981088 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 321/626] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:29:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:33.989553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:33.993740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8d44-eb15-4a0e-984d-4b6793c6c419 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.043044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.043689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.043689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.043897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.044576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:34.044940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:34.046571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:34.062713 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 306/627] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:34.068510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:34.150273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1fdb-7b34-4af2-aee4-fce8d6c127a3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.193652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262df3ea-a8cf-4e37-914a-bc06724a7133 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.210545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b148a7-8b62-4eae-a251-54428530665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.212330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b148a7-8b62-4eae-a251-54428530665e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.212992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b148a7-8b62-4eae-a251-54428530665e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.213773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b148a7-8b62-4eae-a251-54428530665e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.234888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:34.236381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:34.246056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.252762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.252762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.252762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.257183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:34.259240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-93b19aad-de51-4283-88bc-964ca3252e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:34.274182 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:34.275525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:34.277203 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:34.280622 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 307/628] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:34.287467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785947ac-9318-44cf-ae52-3ea24ada676c None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.288338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785947ac-9318-44cf-ae52-3ea24ada676c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.288839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785947ac-9318-44cf-ae52-3ea24ada676c None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.291413 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 308/629] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:34.294088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785947ac-9318-44cf-ae52-3ea24ada676c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:34.361550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b148a7-8b62-4eae-a251-54428530665e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:34.364492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b148a7-8b62-4eae-a251-54428530665e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:34.429938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785947ac-9318-44cf-ae52-3ea24ada676c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.482056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.482794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.483140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.483483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.484254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:34.484630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:34.486212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:34.505471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 322/630] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:34.505667 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 309/631] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:34.505667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:34.506936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.507225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.507559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.528222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:34.529443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:34.567905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:34.594240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:34.643019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb99449-cb07-4648-8810-849cbcb8b72c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.653711 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 323/632] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:34.654965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:34.728554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.729205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.729508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.730329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.747131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:34.753935 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:34.755888 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:34.757790 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:34.760973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 310/633] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:34.761607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:34.825327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947df7-17dd-465e-baab-71369eb51e87 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.873594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.874267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.874540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.874814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.888927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:34.890972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:34.916372 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:34.917974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:34.918871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:34.918871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:34.918871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:34.920665 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 324/634] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:34.923196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1e62-6f94-4cc5-a54d-591b096f532d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:34.927084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:34.938552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:34.962998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:34.969245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:34.969952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:34.970244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:34.970518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/1120d09d46e5416a9257f2a40da688d5/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:34.990612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=1120d09d46e5416a9257f2a40da688d5, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:34.992017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.063584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b403c27-4d2b-46f3-ba08-10b7cc29d358 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.068915 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 311/635] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:34 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/1120d09d46e5416a9257f2a40da688d5/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:35.079491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.122327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.123504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.123970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.124397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.125342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:35.126296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:35.128807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.143301 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 325/636] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:35.144446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.281443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134003c-c8c0-40df-b00e-db7e5f70909e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.283772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:35.312966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce4857-cccf-46f2-8fdd-4b0efa72b2ef None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.334859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.335490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.335772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.336044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.336710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:35.337015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:35.338537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.367648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 312/637] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:35.369122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.382354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.383319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.383834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.384304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.403416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:35.411136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:35.412039 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:35.412969 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:35.413833 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:35.416668 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 326/638] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:35.422738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.555764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c5508-4686-4696-a275-8ec6d6be8d6a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.556649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24d49-566f-4f3a-8137-382e6197eef5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.597604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.598357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.598639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.598998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.612730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:35.614358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.615002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.615911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.616356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.616787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.625782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:35.628048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:35.633437 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:35.635442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:35.637306 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:35.637306 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:35.637306 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:35.640253 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 313/639] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:35.643554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:35.649654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:35.650929 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:35.652367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:35.654641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 327/640] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:35.655754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.660676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:35.741147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:35.781873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9cec6-f78f-40eb-ac8d-bca65f5f402b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.782878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da822-285a-45d8-a60a-b6895a5a6dd0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.826277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.826821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.827100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.827371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.828565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:35.828943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:35.830311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.832107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:35.833433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:35.833972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:35.834462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:35.835341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:35.835875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:35.838506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:35.847472 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 314/641] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:35.847682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.869334 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 328/642] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:35.869334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:35.978456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e6e62-0479-43f4-a38b-df37b46b9496 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:35.988784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:36.012657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:36.018114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.019020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.019518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.019992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.020896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:36.021425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.023102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.036939 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 315/643] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:36.038157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.067238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341a5a-ad32-46d6-af8d-f3fda4a562f3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.138058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.139316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.139523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.139794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.151355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.154070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd866-3de8-4cde-bb21-0e62a7f4ec67 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.154539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:36.170667 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:36.176600 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:36.177754 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:36.177754 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:36.177754 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:36.177754 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 329/644] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:36.177754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.202459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.203252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.203715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.204032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] PATH_INFO: `/v3/users/glance` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.217926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.220636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-15c7e100-ef75-48c7-a38d-a9414a05610a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:36.246100 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:36.247616 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:36.249480 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 316/645] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:36.250671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aa7df-11c5-45ce-abfe-bafe74e7869d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.250671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aa7df-11c5-45ce-abfe-bafe74e7869d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.250671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aa7df-11c5-45ce-abfe-bafe74e7869d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.252040 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 317/646] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:36.252743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aa7df-11c5-45ce-abfe-bafe74e7869d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.317250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9288-deb5-414c-8c9c-e00804319ba7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.326017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:36.341438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:36.372714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.373354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.373696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.373998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.374727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c9cf360f24634e1aa0edb2900994d9b7) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:36.375134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.376664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.397997 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 330/647] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/role_assignments?user.id=c9cf360f24634e1aa0edb2900994d9b7&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:36.397997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.415416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aa7df-11c5-45ce-abfe-bafe74e7869d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.478826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.480168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.480455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.480726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.481454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:36.481760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.484963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b4c86-80e0-44f5-a18e-a8b58599da8e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.508120 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 318/648] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:36.511049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.511917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.512403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.546230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:36.548282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:36.555722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a262e-6fe1-4e8e-94c2-c6ccc004aa70 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.624712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.626391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.627118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.627845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.629597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:36.630421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.632446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.643297 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 319/649] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:36.646008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.678111 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 331/650] 10.222.0.78 () {56 vars in 1137 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:36.684081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.708888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:36.776065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:36.796195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7179163-4396-4916-87c4-5f9a8f396e31 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.837825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.838878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.839487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.839978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:36.847398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6083cd-f269-4681-8241-729658d015e9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:36.849049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:36.851299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:36.865910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:36.866980 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:29:36.867989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:36.871275 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 320/651] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:36.877335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:36.902040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:36.902694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:36.902967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:36.903234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.045232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62250d-143f-45da-9482-c630e0eaf6ba None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:37.046998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:37.048688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:37.057699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:37.093484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:37.094515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.094857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.095196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.097010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:37.097400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:37.099510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:37.103807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:37.121507 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 321/652] 10.222.0.78 () {56 vars in 1137 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:37.125925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:37.201660 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 332/653] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:37.204932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:37.287904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7be0-c34d-442b-9a20-9ce00a2f58ee None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:37.366208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:37.368587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.369321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.370280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.374391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfac9b-b6bc-4f29-855d-32d9a83c6bb8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:37.389346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:37.394308 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:37.395866 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 322/654] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:37.397550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:37.434922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:37.435292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:37.435715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.436060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.436488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.446512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:37.532559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:37.534541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:37.551645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0c419-7e8b-4ab3-8505-69612b6d1212 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:37.594388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:37.595399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.595804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.596275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.611593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:37.613476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-93298c12-2588-45a1-a38f-bb6e426dcba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:37.632891 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:37.634006 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:37.635018 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:37.635018 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:37.635018 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:37.635018 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 323/655] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:37.636045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f348-a042-4b64-a990-13666f199d28 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.636045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f348-a042-4b64-a990-13666f199d28 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.636215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f348-a042-4b64-a990-13666f199d28 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.642664 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 324/656] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:37.642664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68f348-a042-4b64-a990-13666f199d28 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:37.678401 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 333/657] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:37.678401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:37.731924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:37.751453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:37.809307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68f348-a042-4b64-a990-13666f199d28 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:37.830376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa658a6-4465-497c-a968-0fc421902ab5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:37.853715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:37.854376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.854691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.855055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.855746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:37.856054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:37.857464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b01a-10a4-49ba-8fdb-ea3c42f8adaa None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:37.877512 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 325/658] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:37.879480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.879943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.880496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.884579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:37.885520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:37.886557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:37.887021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:37.888116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:37.888638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:37.890680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:37.911939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 334/659] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:37.913287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:37.913561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:37.915064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:38.012644 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 326/660] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:38.014501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.056017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:38.063662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1d41d-ffb8-4fc7-b583-d6572bd0dd9b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:38.141279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:38.142366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:38.142881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:38.143395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:38.171010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:38.171505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:38.174762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:38.211649 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:38.214225 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:38.216001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:38.216001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:38.216001 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:38.216001 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 335/661] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:38.216001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.261930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495c2e1-6727-4473-86fc-7008b1bc935f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:38.341736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:38.342801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:38.343285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:38.343766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:38.359512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:38.362025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:38.385550 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:38.387152 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:38.388015 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:38.388015 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:38.388015 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:38.394301 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 327/662] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:38.394301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.427356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8509ef8-58a7-4bfc-b4ce-1a555ba62b18 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:38.477753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:38.479371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:38.479371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:38.479371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:38.487624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:38.489087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:38.501117 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:38.502429 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:38.504233 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:38.507587 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 336/663] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:38.508426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.523305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:38.537581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2db47-7685-425f-a677-83724e89202f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:38.560626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:38.590110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:38.590959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:38.591276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:38.591517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:38.592199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:38.592511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:38.594097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:38.619739 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 328/664] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:38.621408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.665661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffddf08-e8c2-4cd3-b744-ede04c95a8d7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:38.730346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:38.731434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:38.731938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:38.732436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:38.759986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:38.771129 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:38.772173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:38.773042 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:38.773788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 337/665] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:38.774422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.786057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375bb0f-0752-442d-88f3-a0142ac1cfbc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:38.837741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:38.840000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:38.840905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:38.841737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:38.843201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:38.843916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:38.846940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:38.868132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 329/666] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:38.869214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:38.912431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:38.938601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:38.953046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d37be-1a31-4813-8a05-190a5a705f25 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.007195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.008152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.008640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.009137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.010500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:39.011698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.014516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.034543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439f134-ee02-41fc-80bd-706f3f089cd1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.044930 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 338/667] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:39.044930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.099305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.100362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.100846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.101331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.112365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.113927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:39.129263 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:39.130382 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:39.132039 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:39.134067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 330/668] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:39.135703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.186251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7bd1c-9f12-4476-9dbb-8c86f8cabb1c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.219906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:39.226029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.226652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.226934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.227207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.227894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:39.228217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.230145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc709d-8fe3-41ed-826d-a4e24a4f6c4f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.240021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 339/669] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:39.242023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1301b3-a3cd-4b75-9ff4-9056d89fc445 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.242469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1301b3-a3cd-4b75-9ff4-9056d89fc445 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.242803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1301b3-a3cd-4b75-9ff4-9056d89fc445 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.244624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 340/670] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:39.250957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1301b3-a3cd-4b75-9ff4-9056d89fc445 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.258081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:39.264842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae08e5-54a0-48e5-852c-0eba17bb6912 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.304462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.305110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.305417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.305710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.315811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.317296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:39.330613 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:39.332367 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 19:29:39.333385 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:39.336565 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 331/671] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:39.337553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.394938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1301b3-a3cd-4b75-9ff4-9056d89fc445 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.449957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.450934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.451323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.451692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.452585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=2c178aac643a48d48f2707b407ffa65f) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:39.453035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.454767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.462368 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 341/672] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/role_assignments?user.id=2c178aac643a48d48f2707b407ffa65f&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:39.463477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.497758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5117-58d5-431d-bd53-a65f52a5ca7a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.552730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.553613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.554051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.554451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.555472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:39.555897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.558902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062bab6-a6b2-4fcb-a782-92ab3bed8d2f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.566932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:39.581428 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 332/673] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:39.582807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.583195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.583512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.604932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:39.606415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:39.623533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:39.642527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c6d91-0f4c-430f-b551-90123468db00 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.697906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.699463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.699463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.699463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.709660 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 333/674] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:39.711246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.717001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.718621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:39.737234 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:39.739980 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:39.740896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:39.740896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:39.740896 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:39.740896 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 342/675] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:39.740896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.860106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9ff66-98f2-4062-97c3-f86ec04ec301 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.897825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb783bd-f54e-4276-9f83-e6ae6e27558f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:39.906615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.907274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.907552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.907820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.908758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:39.909606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:39.909731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.912753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.934971 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 334/676] 10.222.0.78 () {56 vars in 1139 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:39.935651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:39.945115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:39.946048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:39.946460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:39.946972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:39.947859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:39.948597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=53cb76d30b8a4dc7961464c640315123) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:39.949031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:39.950788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:39.966050 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 343/677] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/role_assignments?user.id=53cb76d30b8a4dc7961464c640315123&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:39.967316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:40.114411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b82b-9cd1-4943-b5ef-c5cc97f94d31 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:40.164028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:40.164828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:40.165231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:40.165626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:40.166793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:40.167859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:40.169439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:40.191241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e2e03-bb3a-48b0-9e2c-70ba5ad387b3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:40.192711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 335/678] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:40.194236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:40.242252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:40.243327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:40.243602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:40.243896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:40.316840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:40.319724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:40.361033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:40.363411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:40.366264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1814d6-517b-4d8c-8a64-f2b2df9291ac None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:40.422164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:40.423187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:40.423566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:40.423989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:40.437365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:40.443320 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:40.444515 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:40.445524 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:40.452521 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 336/679] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:40.453678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:40.531344 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 344/680] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:40.532468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:40.640531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb970d9-7c6b-4f0b-ba5f-45ee8a24a61c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:40.685659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:40.699757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:40.722366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:40.723053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:40.723338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:40.723607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:40.732544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:40.734057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:40.748417 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:40.750342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 337/681] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:40.751881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:40.765909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193025d-46b4-4430-8f66-3e8f7113e029 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:40.835964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:40.837677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:40.838498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:40.839843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:40.841435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:40.842323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:40.845139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:40.863417 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 345/682] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:40.865491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:40.874182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abac5d7-1a93-4ce9-95c2-bd47df2ce3ba None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:40.916194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:40.917170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:40.917672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:40.918233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:40.937118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:40.938753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:40.957754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:40.959466 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:40.960787 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:40.960787 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:40.960787 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:40.964212 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 338/683] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:40.965444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.018232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.057084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6edde3-d362-452c-97b0-9bfdcc9537d6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.101073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.102309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.102800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.103273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.103587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a3ae7-349a-44c0-a201-7edc74c7594a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.104521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:41.105042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.106946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.109351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.132237 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 346/684] 10.222.0.78 () {56 vars in 1135 bytes} [Sun Aug 28 19:29:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:41.133633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.147187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.147924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.148208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.148481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.162664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.164159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:41.197713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:41.199331 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:41.200199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:41.200199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:41.200199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:41.200965 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 339/685] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:41.202810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.266626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ac20-930a-41d7-a1ee-1ab21207cb9c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.310575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.312099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.312730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.313246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.314399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:41.314992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.316771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.332857 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 347/686] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:41.334188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.377063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.397118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121cdd-2e70-4721-997f-3ae797fdefb6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.406231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.448949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.449504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.449789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.450464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.467737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384808ef-3c7a-4d67-a8bc-c2ad0c3ff401 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.511226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.512614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.513106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.513578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.514477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:41.515022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.516719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.531913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 348/687] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:41.533558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.533668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.535093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.637309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.654984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a31c9-e9c1-44c5-b8f1-71ebee367970 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.658745 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 340/688] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:41.659983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.672986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.700410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.701436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.701972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.702465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.711976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.714073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:41.728223 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:41.729196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:41.730153 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:41.732622 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 349/689] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:41.733837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.866693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb691905-74d3-4af7-95e1-aa308f56b916 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.868743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a06a4a-5134-4dc6-b642-6ef63dfee74d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:41.912220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.913334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.913879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.914358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.928219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.930303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.941576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:41.942764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:41.943250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:41.943812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:41.949844 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:41.950899 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:41.951853 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:41.951853 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:41.951853 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:41.954130 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 350/690] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:41.955311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:41.960378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:41.962980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:41.987033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:41.991755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:41.992738 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:41.993677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:41.999350 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 341/691] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:41.999350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:42.082838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03be26-1c84-4314-a89e-1d6ced48ca1a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:42.106058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:42.127645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:42.128642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.129127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.129602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.130597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:42.131112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:42.133149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:42.147085 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 351/692] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:42.148346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:42.217689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088fe4-ccf6-4dc4-9494-69ac9a6cab82 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:42.272419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:42.290828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:42.292370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.292952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.293422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.294665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:42.295200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:42.298132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:42.305003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49dfe-82e0-4978-a6b2-870e2d8c3719 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:42.324152 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 342/693] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:42.325597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:42.390769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:42.392168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.392900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.393602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.395300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:42.396062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:42.399109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aec26-5401-4239-9e6c-36ae1e02d49d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:42.451275 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 352/694] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:29:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:42.454103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6407-1341-4a27-8f0e-f989a2679930 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.454995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6407-1341-4a27-8f0e-f989a2679930 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.455733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6407-1341-4a27-8f0e-f989a2679930 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.465546 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 353/695] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:42.467517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6407-1341-4a27-8f0e-f989a2679930 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:42.511455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebb9e4-3376-4fe0-86f2-0fb679cfc483 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:42.528849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:42.565380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:42.566087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.566342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.568691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.569713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=a4db71575637416dacaae1294f043167) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:42.570467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:42.571959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:42.580116 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 343/696] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:42 2022] GET /identity/v3/role_assignments?user.id=a4db71575637416dacaae1294f043167&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:42.581030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:42.684009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6407-1341-4a27-8f0e-f989a2679930 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:42.745331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:42.746095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.746483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.746885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.757792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:42.760069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:42.770228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148707-cd10-493c-8def-ccf942108a7b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-281496b8-60d8-4f58-9611-88ec09cb4ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:42.773915 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:42.775013 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:42.775949 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 354/697] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:42.777983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802afea-fe3e-4179-a1b9-898b5e60aa8a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.778269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802afea-fe3e-4179-a1b9-898b5e60aa8a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.778541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802afea-fe3e-4179-a1b9-898b5e60aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.785595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:42.798841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6802afea-fe3e-4179-a1b9-898b5e60aa8a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:42.800122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6802afea-fe3e-4179-a1b9-898b5e60aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:42.840977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:42.842073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.842607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.843090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.926386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:42.935988 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 355/698] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:42.937251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9872df-08bc-4dca-91d0-a09176091040 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:42.937539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9872df-08bc-4dca-91d0-a09176091040 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:42.937814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9872df-08bc-4dca-91d0-a09176091040 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:42.946983 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 356/699] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:42.946983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9872df-08bc-4dca-91d0-a09176091040 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:43.003328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:43.007933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:43.135427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9872df-08bc-4dca-91d0-a09176091040 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:43.180862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:43.190749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:43.191372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:43.191645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:43.191905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:43.192793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:43.193161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:43.195779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d6ce-9d2b-4c9b-bbe7-97b05d855205 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:43.217964 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 357/700] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:43.217964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:43.217964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:43.217964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:43.238364 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 344/701] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:43.239631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:43.259137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:43.260923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:43.346548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:43.374917 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 358/702] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:43.376504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:43.398711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a1dc5-4241-4a29-a326-50d047e246b9 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:43.453567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:43.454200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:43.454473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:43.454769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:43.455461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=1120d09d46e5416a9257f2a40da688d5) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:43.455767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:43.457218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:43.466093 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 345/703] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:43 2022] GET /identity/v3/role_assignments?user.id=1120d09d46e5416a9257f2a40da688d5&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:43.471114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:43.603976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d850a7-fbdb-4070-8f89-545c44463f74 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:43.619525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b333f67-d5e3-4ead-b9bb-882e0893b1d4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:43.674687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:43.675439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:43.676120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:43.676404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:43.676681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:43.686682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:43.702791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:43.705251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:43.717302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:43.718094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:43.718384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:43.719105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:43.732633 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:43.734489 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:43.736236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:43.736236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:43.736236 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:43.736564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:43.736564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:43.740184 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 346/704] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:43.748550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:43.771725 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:43.772909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:43.773971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:43.773971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:43.773971 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:43.774237 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 359/705] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:43.782005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:43.938783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b28db6-0abe-4e95-8b06-7a5c27925956 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:43.958326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f3b6-a8df-413d-9cf1-eaa94d546e41 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:43.991515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:43.992331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:43.992616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:43.992952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:43.994050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:43.994358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:43.996402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.014511 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 347/706] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:44.015401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.034407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.035429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.035912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.036396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.037947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:44.038823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.041446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.067317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 360/707] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:44.068859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.083141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:44.137701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:44.163123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a2d1-e7fa-4bc4-87f8-e303689a8b05 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:44.222010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.223269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.224056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.224831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.226221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.229161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.232859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b1c6-4636-48ff-bf3e-d2d3a50ff5f8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:44.252001 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:44.254508 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:44.256461 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 348/708] 10.222.0.78 () {56 vars in 1129 bytes} [Sun Aug 28 19:29:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:44.259576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.295746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.299360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.299360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.299360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.301047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.302472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.409129 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 361/709] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:29:44 2022] POST /identity/v3/users => generated 254 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:44.413768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.475807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53962b47-3f9a-44e5-887b-e3225024a7d4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:44.506822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:44.555712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.556376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.556655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.556930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.576693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.578290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:44.608656 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:44.609652 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:44.610572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 349/710] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:44.619271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.626728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:44.639532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c1c6-b1fc-459b-b983-a7689eed642c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:44.690430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.691063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.691387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.691674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.692533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:44.692851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.695014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.700859 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 362/711] 10.222.0.78 () {56 vars in 1124 bytes} [Sun Aug 28 19:29:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:44.707583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.781155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a19201-4a38-4e03-93ce-fe91a0189e12 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:44.843917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.844628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.844908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.845178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.845929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:44.846244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.847709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.866706 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 350/712] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:44.869051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dc041-58c6-4945-a166-17c91a98b935 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:44.881692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:44.952944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:44.953773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:44.954145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:44.954431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:44.955465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:44.955772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:44.957438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcf850-a629-4676-8d85-d0c047916d78 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:44.962179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:44.968869 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 363/713] 10.222.0.78 () {56 vars in 1124 bytes} [Sun Aug 28 19:29:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:45.119810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f61e-778d-48a9-bbfa-ac703fa86b20 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:45.187530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:45.188230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:45.188561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:45.189040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:45.190471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c9cf360f24634e1aa0edb2900994d9b7) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:45.191015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:45.193960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb84c-bd6e-45e2-9355-ed8e6b97a6c9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:45.204924 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 351/714] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:44 2022] GET /identity/v3/role_assignments?user.id=c9cf360f24634e1aa0edb2900994d9b7&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:45.273580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3efa3-76ba-4c26-8a8c-4cba4c8f57a3 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:45.273920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3efa3-76ba-4c26-8a8c-4cba4c8f57a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:45.274323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3efa3-76ba-4c26-8a8c-4cba4c8f57a3 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:45.275866 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 364/715] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:45.282999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:45.283466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:45.283874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:45.317877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:45.320067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:45.443248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 352/716] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:45.807408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3efa3-76ba-4c26-8a8c-4cba4c8f57a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:45.833872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:45.951240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3efa3-76ba-4c26-8a8c-4cba4c8f57a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:45.996066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:45.997104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:45.997609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:45.998153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:45.998959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:46.000600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-fead1e57-f82c-493f-8440-8762c6ed43e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:46.015674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:46.016709 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:46.017532 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:46.021193 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 365/717] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:45 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:46.027694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:46.083572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:46.183694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef98be8-b7ce-4c3f-8c59-c870a7f7e6a8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:46.189519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ac3d1-5d52-4779-9787-37ccd59a6e91 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:46.190169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ac3d1-5d52-4779-9787-37ccd59a6e91 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:46.190650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ac3d1-5d52-4779-9787-37ccd59a6e91 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:46.192568 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 366/718] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:46.199128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:46.199441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:46.199686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:46.228295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:46.228905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:46.229233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:46.230041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:46.230747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] RBAC: Adding query filter params (name=network) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:46.231053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:46.232435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:46.243578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:46.244835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:46.247368 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 353/719] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:29:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:46.248256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:46.390817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:46.403126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b89ec-3702-49c8-bcbd-24bea62331ca None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:46.444742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 367/720] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:46.452356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:46.453269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:46.453733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:46.454213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:46.455085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] RBAC: Adding query filter params (type=network) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:46.455546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:46.457286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:46.470372 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 354/721] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:29:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:46.898897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:46.916200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:47.030966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d75f1-52d2-4c80-a30d-81f192c90cbb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:47.110658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe55a8-35f6-457f-9963-4a9fd51313ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:47.111325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe55a8-35f6-457f-9963-4a9fd51313ca None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.111601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe55a8-35f6-457f-9963-4a9fd51313ca None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.111880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe55a8-35f6-457f-9963-4a9fd51313ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.134520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe55a8-35f6-457f-9963-4a9fd51313ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1cbe55a8-35f6-457f-9963-4a9fd51313ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:47.140181 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:47.141166 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:47.142492 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 368/722] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:47.147130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:47.209210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fb9a6-007f-4926-b1f9-ccf29559aa8a None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.209395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fb9a6-007f-4926-b1f9-ccf29559aa8a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.209681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fb9a6-007f-4926-b1f9-ccf29559aa8a None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.211239 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 369/723] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:29:47.219630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.219909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.220186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.246626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:47.247832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:47.296714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9d9d8-55a1-42ef-af2c-a02dfb60af6f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:47.335904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:47.341898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.341898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.341898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.341898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:47.341898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:47.341898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:47.349173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 355/724] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:47.359310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:47.382930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:47.450020 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 370/725] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:29:47.529082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebff68-2905-4b2a-bb46-aae4af7cd5da None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:47.582275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:47.582917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.583218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.583509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.601616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:47.603092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-0140e2b1-a3f2-401a-8872-0fcc1320f793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:47.623826 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:47.624810 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:47.625696 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:47.625696 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:47.625696 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:47.625696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 356/726] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:47.631987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:47.634654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:47.700719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1b81-34f1-4d89-a4b0-eafa56cbbd4a None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.701066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1b81-34f1-4d89-a4b0-eafa56cbbd4a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.701265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1b81-34f1-4d89-a4b0-eafa56cbbd4a None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.702795 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 357/727] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:29:47.707898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.708198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.708447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.742909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:47.744228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:47.780526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f4c6-720b-4101-b3fd-1c7d8773c960 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:47.819463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:47.820087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:47.820360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:47.820629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:47.821298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:47.821602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:47.824526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:47.855064 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 371/728] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:47.857422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:47.897224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:47.904376 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 358/729] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:29:47.946061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:47.946751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:48.048429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95dbd7-5013-42d7-8a65-3b2b3503302e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:48.121240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04d9c-0d08-4ca3-8a4f-b5e73324a95f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:48.124804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:48.126018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.126641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.127207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.142594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:48.144294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-00cccfed-526c-46fc-9cb6-2a1246fde883 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:48.158966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:48.160059 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:48.161192 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 372/730] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:48.161842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1040-7ca4-4fa9-bf25-c0f9fc14f2c5 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.161842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1040-7ca4-4fa9-bf25-c0f9fc14f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.161842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1040-7ca4-4fa9-bf25-c0f9fc14f2c5 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.168085 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 373/731] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:48.169336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.169618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.169910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.194656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:48.196858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:48.219984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:48.221627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.222088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.222906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.238344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:48.244579 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:48.246268 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:48.247142 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:48.249418 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 359/732] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:48.250632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:48.302805 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 374/733] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:29:48.314354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:48.321760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:48.375770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5674e-8261-499b-aa7d-0470bbaf3e48 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:48.376439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:48.422707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:48.423672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.424361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.425096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.427004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:48.428045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:48.431480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:48.441587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbe7c-e35e-4645-9e44-688d30bd18a1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:48.474619 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 360/734] 10.222.0.78 () {56 vars in 1135 bytes} [Sun Aug 28 19:29:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:48.476569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:48.482977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:48.485902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.485902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.485902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.485902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:48.485902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:48.487571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:48.498419 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 375/735] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:48.499491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:48.622055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd300b-e95a-4dbb-9c3e-6422848a80df None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:48.625382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecad44-0cc2-4cc4-a0d1-17d7d2127699 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:48.641220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:48.645815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:48.671579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:48.676060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.676060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.676288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:48.676378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.676448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:48.676448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:48.676448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:48.676448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:48.676448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:48.754414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:48.756153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:48.806066 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 361/736] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:29:48 2022] POST /identity/v3/services => generated 251 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:48.806066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:48.912882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 376/737] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:29:48.915019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:48.938078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:48.991175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ecb0c-960e-48e6-b71d-246915530127 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.055067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.055978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.056481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.058264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.072637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27cbae-bc60-483f-9b02-b2f6d5ea16fa None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.076409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.078058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:49.093758 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:49.095501 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:49.097045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:49.097045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:49.097045 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:49.097045 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 362/738] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:49.097792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.138318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:49.154576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53084307-3cc1-415b-863b-2b525a9b8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.155274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53084307-3cc1-415b-863b-2b525a9b8017 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.155550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53084307-3cc1-415b-863b-2b525a9b8017 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.155820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53084307-3cc1-415b-863b-2b525a9b8017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.169276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53084307-3cc1-415b-863b-2b525a9b8017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-53084307-3cc1-415b-863b-2b525a9b8017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:49.174143 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:49.175274 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:49.176107 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 377/739] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:49.176809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497daa-331b-4c7f-a816-219a08dafb1b None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.177990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497daa-331b-4c7f-a816-219a08dafb1b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.177990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497daa-331b-4c7f-a816-219a08dafb1b None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.181916 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 378/740] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:49.181916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497daa-331b-4c7f-a816-219a08dafb1b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.260543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a638-36c4-4cf4-9bc7-229858f97b34 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.275626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:49.310377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497daa-331b-4c7f-a816-219a08dafb1b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.320301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.321107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.321559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.322088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.339853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.342010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:49.364285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:49.365447 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:49.366497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:49.366497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:49.366497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:49.370586 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 363/741] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:49.371617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.372501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.373214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.373495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.382275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.382275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:49.382275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.382275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7267d-8cc6-447a-b94a-9e7c4af3a7aa None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.396076 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 379/742] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:49.402405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.402686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.402961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.433011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:49.435019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:49.486632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:49.517771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e68df-18e1-424d-ba02-b16c3a20935d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.524863 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 380/743] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:29:49.527598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.565883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.566626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.566946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.567459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.569365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:49.569711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.572014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.587671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 364/744] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:49.589432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.618131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:49.661794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad230863-d840-48c8-ba7c-93e3d9939da0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.701976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.702174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58127f45-c096-46df-842c-4363b9a32cdb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.702967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.703434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.704064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.705010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:49.705498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.707088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.725163 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 381/745] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:49.726443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.747010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.748099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.748099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.748383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.758315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.759811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.762351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:49.777007 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:49.778107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:29:49.779055 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:49.783211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 365/746] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:49.784759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.850908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9d76-1abc-482c-abda-933d30982383 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.876626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:49.888250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:49.889125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:49.889355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:49.890630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:49.902216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:49.903824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:49.921303 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:49.923168 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:49.931808 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:49.931808 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:49.931808 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:49.931808 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 382/747] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:49.931808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:49.961661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74fd54-c53d-4a24-87fc-a3b4d9595d10 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:49.999731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.000354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.000635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.000911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.008249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.009696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:50.023552 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:50.024531 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 366/748] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:50.030861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.074163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3cda1-568f-4e23-b18f-ed4f57257c61 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.109622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.121230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.121875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.122155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.122423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.123176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:50.123480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.124982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.151883 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 383/749] 10.222.0.78 () {56 vars in 1149 bytes} [Sun Aug 28 19:29:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:50.151883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.174104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26cdad-655a-4082-a8b6-71b5b94b8bbb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.209900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.233486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.234194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.234551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.234960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.235710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.237191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.301100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae50b-b1f9-4970-8c64-c086e722b2ec None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.328318 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 367/750] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:29:50 2022] POST /identity/v3/services => generated 240 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:50.329170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.373410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.374527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.375009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.375507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.376500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:50.377168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.379153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.396414 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 384/751] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:50.397927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.470906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022aa510-cb48-48d2-9570-0e780e685e65 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.494006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.515947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.516577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.516979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.517124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.517835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:50.518187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.519669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.527539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.536701 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 368/752] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:50.537919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb095441-c0da-4deb-bf8f-e7cc8155c59f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.538075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.603146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.604884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.605275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.607020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.689363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790743-c26d-485f-a744-edc8f0e2c536 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.698601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.700467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.739691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.740545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.740834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.741103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.750764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.752181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:50.767563 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:50.768772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:50.769943 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 369/753] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:50.774971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.824046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.826466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.843907 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 385/754] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:29:50.845183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.905905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3593eb9-506b-4a77-bca9-83a4f472cb15 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.951343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.952069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.952394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.952684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.953660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=1120d09d46e5416a9257f2a40da688d5) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:50.953943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.955654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.966493 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 370/755] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/role_assignments?user.id=1120d09d46e5416a9257f2a40da688d5&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:50.967700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.982805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d9679-2174-4c4b-8ae1-32e531abac02 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.035454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.036434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.036862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.037277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.038303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:51.038795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.040439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f75d-62f7-4346-9855-84614091b473 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:51.064304 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 386/756] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:51.066002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddaac8-a246-4507-905a-6a0b245c69cb None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.066434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddaac8-a246-4507-905a-6a0b245c69cb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.066964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddaac8-a246-4507-905a-6a0b245c69cb None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.068899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 387/757] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:51.071043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddaac8-a246-4507-905a-6a0b245c69cb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:51.139576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7ae64-8c7c-4915-82f9-9c59d619a830 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.141743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:51.147747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:51.200163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.201391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.202012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.202552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.215976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddaac8-a246-4507-905a-6a0b245c69cb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.225168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.228252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-99dcd440-4436-4039-8118-a6e0408d229b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:51.260345 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:51.261740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:51.262825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:51.262825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:51.262825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:51.264792 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 371/758] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:51.267457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.268071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.268664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.269985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.270943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.271279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.271530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.290475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.293472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:51.295598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:51.297182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:51.325537 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:51.326735 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:51.327842 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:51.327842 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:51.327842 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:51.332924 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 388/759] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:51.334732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:51.392587 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 372/760] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:29:51.399119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:51.558234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:51.574907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:51.585812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a06532-639a-4147-bfc2-cab29ca35b87 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.591275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc36ef-642a-421a-bb1e-9535f539d964 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.668675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.670502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.670805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.671153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.672240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:51.672642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.674989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:51.696642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.697373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.698427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.698738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.699403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:51.699707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.701243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:51.713916 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 373/761] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:51.720879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:51.739632 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 389/762] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:51.745702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:51.925742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bf36d-1194-4a69-8d8e-d171149969f0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.977657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.978726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.979071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.979351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.985776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db614a7-53d5-49e0-9be4-0a1858777aee None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.988482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.991431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:52.006830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:52.007845 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:52.008718 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:52.013446 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 390/763] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:52.014544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.042399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:52.062087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.063177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.063674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.064177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.081011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.083886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:52.108151 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:52.110405 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:52.112493 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 374/764] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:52.113740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.120061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:52.143603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18bde2-6324-431e-b5ee-eabcfb2ca8ce None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.186810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.187677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.187677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.187920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.188540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.190650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:52.200399 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:52.202505 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:52.204056 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 391/765] 10.222.0.78 () {56 vars in 1129 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:52.205404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.304868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:52.308006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c55ab-3f71-4db5-b239-b7311658d967 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.330343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458fbbc-d470-4ffb-9ee6-e48bb069f868 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.360998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.361941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.362377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.362793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.363655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:52.364133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.365977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.387040 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 375/766] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:52.388955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.389772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.390443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.390724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.391095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.391821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:52.392205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.393736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.412679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 392/767] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:52.414511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.495251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:52.555056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940039-2af5-4235-a873-4f4c666ab07c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.568341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e2098-eef8-4c72-8fc7-063f0cd2948b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.596600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.597751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.598306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.598862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.599858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:52.600374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.602141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.609845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 376/768] 10.222.0.78 () {56 vars in 1124 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:52.611182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.615755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.616922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.617409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.617983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.619041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=4898339418664af0b17fbfed27604480) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:52.620182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.622193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.629707 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 393/769] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/role_assignments?user.id=4898339418664af0b17fbfed27604480&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:52.631365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.657994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:52.798383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e669-37d9-45aa-986a-9a188d3993a3 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.829874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4826b-a15a-4d72-ad6b-18f3e6c92b38 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:52.845766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:52.857655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4441d6-967c-4c9f-ad84-04c7f6a740cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.858685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4441d6-967c-4c9f-ad84-04c7f6a740cb None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.859697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4441d6-967c-4c9f-ad84-04c7f6a740cb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.859697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4441d6-967c-4c9f-ad84-04c7f6a740cb None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c9cf360f24634e1aa0edb2900994d9b7/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.862493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4441d6-967c-4c9f-ad84-04c7f6a740cb None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=c9cf360f24634e1aa0edb2900994d9b7, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.864568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4441d6-967c-4c9f-ad84-04c7f6a740cb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.875286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:52.876188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.876461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.876729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.877394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:52.877695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:52.879131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3268167-eedc-4320-a1ab-c2fbd853d848 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:52.890008 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 394/770] 10.222.0.78 () {56 vars in 1124 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:52.890008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268f94-942e-4429-9881-aed771b9de50 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.890008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268f94-942e-4429-9881-aed771b9de50 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.890008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268f94-942e-4429-9881-aed771b9de50 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:52.890008 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 395/771] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:52.892146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8268f94-942e-4429-9881-aed771b9de50 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:52.945894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 377/772] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:52 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c9cf360f24634e1aa0edb2900994d9b7/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:52.945894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:52.945894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:52.945894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:53.003850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:53.008684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:53.082237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:53.174932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8268f94-942e-4429-9881-aed771b9de50 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:53.190553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 378/773] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:29:53.235511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:53.236348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:53.236816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:53.237347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:53.238211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] RBAC: Adding query filter params (interface=public, service_id=f8ee8997fbc941f29c33c0d8f60cc914, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:53.238619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:53.240233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a239e3-b81e-456b-8cfb-41592caeb58c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:53.250316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 396/774] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:29:52 2022] GET /identity/v3/endpoints?service_id=f8ee8997fbc941f29c33c0d8f60cc914&interface=public®ion_id=RegionOne => generated 194 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:53.256022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:53.379141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477eb56d-9966-4538-a7b7-7144351bbadc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:53.399888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:53.424928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f152de-a22b-47ea-ba5b-a98b1e14f409 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:53.425250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f152de-a22b-47ea-ba5b-a98b1e14f409 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:53.425531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f152de-a22b-47ea-ba5b-a98b1e14f409 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:53.429982 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 397/775] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:53.431731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:53.432499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:53.432775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:53.433041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:53.433658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:53.434042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:53.434418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:53.434770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:53.435156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:53.447037 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 379/776] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:29:53 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:53.466914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:53.468293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:53.570146 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 398/777] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:29:53.639777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:53.787755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daf5ce-a12b-4d25-b19b-69c9c8062405 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:53.855471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:53.856528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:53.857007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:53.857488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] PATH_INFO: `/v3/services/network` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:53.858567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:53.861044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:53.878523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:53.879569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:53.880381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:53.882009 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 380/778] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:53 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:53.887699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:53.891451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:53.966873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:54.034825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e580-6dd3-4df5-bb59-cb2246b45517 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:54.158885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:54.159432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:54.159704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:54.159994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:54.160703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] RBAC: Adding query filter params (name=network) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:54.160998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:54.162570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:54.180498 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 381/779] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:29:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:54.186590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:54.197325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:54.272068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a757-7633-4b5c-8472-fceff52a36e2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:54.386072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:54.386733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:54.387650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:54.387650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:54.425622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6444cb-594a-4436-95f7-8feb06301555 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:54.430578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:54.436069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:54.437974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:54.439678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:54.442008 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 399/780] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 550 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:54.446930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:54.456681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:54.529011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:54.530619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:54.533372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:54.534369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:54.535909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] RBAC: Adding query filter params (type=network) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:54.537323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:54.542446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:54.558605 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 382/781] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:29:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:29:54.567241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:54.718568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1064-0d3b-48d8-af28-225e72dd1ec2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:54.797591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:54.805946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d35f-4569-4853-8f54-12fbd544349e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:54.815059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:54.816504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:54.817258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:54.818022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:54.819498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:54.820427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:54.823388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:54.846173 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 400/782] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:54.852525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:54.879911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:54.881146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:54.881623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:54.882122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:54.883488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] RBAC: Adding query filter params (interface=public, service_id=61edcb6080ea436685e1c78ea10ebde4, region_id=RegionOne) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:54.884025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:54.886710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:54.920538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 383/783] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:29:54 2022] GET /identity/v3/endpoints?service_id=61edcb6080ea436685e1c78ea10ebde4&interface=public®ion_id=RegionOne => generated 194 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:54.926734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:55.039316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:55.073704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d1045-097c-4203-b2c2-964c746ad179 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:55.203493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:55.204396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.204698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.204943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.231378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:55.238420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:55.245267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50ad3-cc45-4157-9515-742412be7ad3 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:55.279005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:55.280402 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:55.281290 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:55.281290 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:55.281290 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:55.288977 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 401/784] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:55.294731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:55.331354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044360-134f-47ce-983e-8b14ebb4e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:55.332408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044360-134f-47ce-983e-8b14ebb4e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.332913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044360-134f-47ce-983e-8b14ebb4e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.333398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044360-134f-47ce-983e-8b14ebb4e6c7 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.334587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b044360-134f-47ce-983e-8b14ebb4e6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:55.337229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b044360-134f-47ce-983e-8b14ebb4e6c7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:55.348522 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 384/785] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:29:54 2022] GET /identity/v3/services => generated 772 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:55.350886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b5cc4-4232-49e0-aa65-e572155690ab None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.351275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b5cc4-4232-49e0-aa65-e572155690ab None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.351662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b5cc4-4232-49e0-aa65-e572155690ab None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.358100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:55.361289 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 385/786] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:55.367335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba21f-f7f0-4ab4-a261-d1c8114f5de0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.369911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba21f-f7f0-4ab4-a261-d1c8114f5de0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.369911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba21f-f7f0-4ab4-a261-d1c8114f5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.406975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b3fba21f-f7f0-4ab4-a261-d1c8114f5de0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:55.408376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b3fba21f-f7f0-4ab4-a261-d1c8114f5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:55.560651 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 386/787] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:29:55.613519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506364b5-26a2-4bf2-8ec8-5325fd111744 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:55.652977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f43de-e8f1-4b10-b734-3a7b2a6d0d54 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.653426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f43de-e8f1-4b10-b734-3a7b2a6d0d54 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.654241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f43de-e8f1-4b10-b734-3a7b2a6d0d54 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.657360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 387/788] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:55.665037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.665441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.666013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.703713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1860095-ac27-4622-b839-639794314915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:55.705192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1860095-ac27-4622-b839-639794314915 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.705964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1860095-ac27-4622-b839-639794314915 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.706665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1860095-ac27-4622-b839-639794314915 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.708184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1860095-ac27-4622-b839-639794314915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:55.708963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1860095-ac27-4622-b839-639794314915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:55.711639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1860095-ac27-4622-b839-639794314915 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:55.723720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:55.725823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:55.735089 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 402/789] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:55.743068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1860095-ac27-4622-b839-639794314915 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:55.771068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:55.833996 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 388/790] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:29:55.910100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1860095-ac27-4622-b839-639794314915 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:55.914065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:55.970302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:55.971366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:55.971859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:55.972344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:55.987863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:55.990702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:56.015879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:56.016892 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:29:56.017827 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:56.018472 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 403/791] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:56.027541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.028655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.153897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ab5e7-5756-4839-8381-95175e6f8a8a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:56.214388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde067c-f9a8-4900-b1be-c8e84de00778 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:56.220021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:56.220662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.220958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.221226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.241063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:56.249496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:56.250571 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:56.251407 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 389/792] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:29:56.253221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.261622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:56.262569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.263079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.263517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.264642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:56.265053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:56.266875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:56.289680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:56.291023 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 404/793] 10.222.0.78 () {56 vars in 1135 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:56.292206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.315706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:56.421699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3843e0-0060-402b-9128-26aeec0e1a9c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:56.433593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136da2a-3ed7-4909-9dd4-97a2c8291026 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:56.484627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:56.485362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.485646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.485948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.486790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:56.487100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:56.488527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac96d7-d275-444f-a101-3684f1fdf1c6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:56.489749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:56.491916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.492701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.493374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.499113 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 405/794] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:56.500639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc8703-e28f-4f9b-b372-a04d23f6a8f6 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.501111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc8703-e28f-4f9b-b372-a04d23f6a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.501571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc8703-e28f-4f9b-b372-a04d23f6a8f6 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.509777 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 406/795] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:56.509777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc8703-e28f-4f9b-b372-a04d23f6a8f6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.520030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:29:56.525400 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:56.528137 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 390/796] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:56.530582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.640080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:56.668531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc8703-e28f-4f9b-b372-a04d23f6a8f6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:56.669614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:56.697767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03129e0-4bc9-41b3-b049-0d5fcae416cb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:56.730842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:56.731830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.732301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.732748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.739335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:56.740281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.740561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.740836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.749913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:56.752465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:56.752916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:56.754430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-af1e31fb-8483-4ffd-8b2c-5782139a8465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:56.772721 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:56.774982 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 407/797] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:56.777334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:56.786603 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:56.787650 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:56.788557 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:56.788557 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:56.788557 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:56.794546 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 391/798] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:56.795780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.799898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:56.801147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:56.902536 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 408/799] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:29:56.903812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:56.955691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5230-3eb6-4e85-a9cf-0d7e11f7c8a0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.003397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.003640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.004331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.004453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.004724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.006068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:57.006403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.008132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.022115 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 392/800] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:57.023450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.038170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.054942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2876e-e51a-4f3d-b78a-ca9461aa6c6e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.100137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.100916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.101292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.101662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.102514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:57.102952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.104440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.117558 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 409/801] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:57.118693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.159031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d2d46-dc66-4fbb-b88d-dddff84eb20c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.216955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.217594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.217897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.218464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.219136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:57.219727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.221263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.235992 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 393/802] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:57.237026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.250392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd559d-6e44-4bd5-abc0-6ead172d8243 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.282291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.296704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.297346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.297622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.297919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.308349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.309256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.311376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:57.328465 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:57.329467 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:57.330369 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:57.330369 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:57.330369 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:57.334401 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 410/803] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:57.335790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.364008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68a3a8-1268-4438-9312-ea1a591f5f03 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.404654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.405426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.406028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.406333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.414036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.416320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:57.430560 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:57.431497 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 394/804] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:57.433086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.459415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bce759-740a-47e5-98b2-f6e3c03419dd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.496452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.497005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.497283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.497552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.498161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.499527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:57.508900 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:57.510580 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:57.511440 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 411/805] 10.222.0.78 () {56 vars in 1129 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:57.512683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.551785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.553830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d97a6d-195e-4eb0-8cb7-af950aaf26f7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.576057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.597492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.598323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.598435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.598697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.607465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.609435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:57.623567 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:57.624955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 395/806] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:57.626248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.633509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49056f6-9bbd-4157-89e6-1fcbd1b82348 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.676505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.677132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.677412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.677682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.678385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:57.678689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.680198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.697097 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 412/807] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:57.699013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.764060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec931c-5b24-464b-a80c-2a1838d63933 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.804226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.804838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.805119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.805390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.806124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:57.806437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.808511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.823816 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 396/808] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:57.824568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.832576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.837354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295504a1-b1a7-4e15-8e60-018d2637f8bd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:57.870953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:57.879451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:57.880125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:57.880399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:57.881041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:57.881787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:57.882116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:57.883606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:57.889565 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 413/809] 10.222.0.78 () {56 vars in 1124 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:57.890538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:57.975120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687be3-231a-48f5-8b0d-4510e553f7c6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.016102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.016904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.017327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.017724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.018172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0d88a-f042-45eb-bd09-26a6d2444ec0 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.018887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:58.019352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.021751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.050622 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 397/810] 10.222.0.78 () {56 vars in 1149 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:58.051492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.085996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.086646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.086921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.087195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.095980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.097421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:29:58.109801 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:58.110858 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 414/811] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:29:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:58.111925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.139874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:58.168414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:58.175339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527252f5-e1fd-41ea-affe-93f368aafc75 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.219135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.219942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.220230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.220503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/1120d09d46e5416a9257f2a40da688d5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.222738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=1120d09d46e5416a9257f2a40da688d5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.224199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.232544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b00b-716d-408d-a71d-33f0fca087ad None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.275211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.276241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.276520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.276789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.277425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:58.277775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.279289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e1a1-8a74-4157-b1f2-39e1f4829fb5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.285135 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 415/812] 10.222.0.78 () {56 vars in 1124 bytes} [Sun Aug 28 19:29:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:58.286557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98d1ca-09cf-4ef1-9b9a-223a33d694d8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.286835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98d1ca-09cf-4ef1-9b9a-223a33d694d8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.287173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98d1ca-09cf-4ef1-9b9a-223a33d694d8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.288704 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 416/813] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:29:58.289268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98d1ca-09cf-4ef1-9b9a-223a33d694d8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.332068 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 398/814] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:58 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/1120d09d46e5416a9257f2a40da688d5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:29:58.333061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.417727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:58.444242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98d1ca-09cf-4ef1-9b9a-223a33d694d8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.493978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.494999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.495444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.495874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.516625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.517998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.525101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3caf9-e050-429f-bbe4-aa643e09a906 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a8c857a4-f7eb-4cf0-a4a3-954597c95bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:58.544307 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:58.546319 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:58.548115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:58.548115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:58.548115 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:29:58.548115 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 417/815] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:58.548637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.549066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.549531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.578150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.579035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.579149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:58.579558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.579977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.580900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:58.581029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:58.581462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.583123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.609735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 399/816] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:29:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:58.611067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.641545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:58.689574 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 418/817] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:29:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:29:58.690521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.787314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:58.789012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6703d73-17a0-4491-a5a2-2b16f82d5e73 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.833928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.834604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.834883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.835165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.835851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.836928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb538f-06b0-4e81-bbd6-2621dda0d7c1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:58.837295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.882971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:58.883618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:58.883959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:58.884233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:58.885447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:58.885747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:58.887173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:58.903894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 419/818] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:58.905140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:58.981942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 400/819] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:29:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:29:58.983483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.083026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6927-d94d-42a1-befc-4c1b43e720bd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.103320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:59.125973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:59.152340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:59.153350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:59.153711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:59.155678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:59.173315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a098151-2b5a-422d-b6c4-7414b23a7bf8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.233384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:59.235340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:59.235751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:59.236150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:59.249436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:59.251856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:59.265121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:59.266657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:29:59.268302 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:59.269195 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:29:59.270110 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:59.271147 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 401/820] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:59.272169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.448073 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 420/821] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:29:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:29:59.448073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.480416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:59.551480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707308a3-2d5f-493c-92ff-f189227e2938 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.584815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:59.585829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7e758-ca22-423b-800c-12b1f02699ff None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.593841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:59.594631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:59.602317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:59.602317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] PATH_INFO: `/v3/services/network` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:59.602317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:59.602317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:59.611862 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:59.613065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 19:29:59.614339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:59.617490 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 402/822] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:29:59 2022] GET /identity/v3/services/network => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:59.618690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.640484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:59.641130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:59.641406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:59.641682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:59.642420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:59.642729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:59.644174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:59.659995 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 421/823] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:59.661061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.772724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6901-085e-4789-a34e-7b152e7530ad None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.774098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:59.791824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575fab6-aaa9-4cec-ae7a-bf0b2cd29284 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.816511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:59.817657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:59.818150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:59.818644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:59.829929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:59.830556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:59.830842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:59.831113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:59.831906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] RBAC: Adding query filter params (name=network) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:29:59.832062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:59.833459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:59.834499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:59.836225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:59.842203 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 422/824] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:29:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:29:59.843295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:29:59.854885 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:29:59.856073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:29:59.857131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:29:59.857131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:29:59.857131 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:29:59.859157 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 403/825] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:29:59.860355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:59.923784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:59.969330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495089-fdab-49c1-88be-014f22fe8b95 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:59.991239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7388b-4c4e-487f-af0e-530800eb4968 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:00.023436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:00.024973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.024973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.025385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/4898339418664af0b17fbfed27604480/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.040494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:00.048545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.048545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.048545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.048545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] RBAC: Adding query filter params (type=network) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:00.048545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:00.048545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:00.055447 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 404/826] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:29:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:00.057712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:00.058448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=4898339418664af0b17fbfed27604480, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:00.061295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:00.172282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:00.190334 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 423/827] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:29:59 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/4898339418664af0b17fbfed27604480/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:00.194597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:00.230333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c916082-0197-442e-a85b-58fceaf6294b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:00.250816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:00.329671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:00.330479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.330770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.331026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.334028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:00.334452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:00.343391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:00.389577 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 405/828] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:00.399183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:00.509638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633097f-4fa9-40c9-af3b-e7997ed0054b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:00.602617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293cba-11a7-4122-b40e-52b91ee4be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:00.603616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293cba-11a7-4122-b40e-52b91ee4be1d None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.604098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293cba-11a7-4122-b40e-52b91ee4be1d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.604567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293cba-11a7-4122-b40e-52b91ee4be1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.606014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293cba-11a7-4122-b40e-52b91ee4be1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:00.608702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293cba-11a7-4122-b40e-52b91ee4be1d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:00.678757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16286873-2d1f-4d8e-abc7-58fc983547f2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:00.738123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:00.739055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.739452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.739725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.749155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:00.751023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:00.766198 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 424/829] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:00.769247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4a293-ef22-44fa-b909-cfd922c83dd8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:00.769490 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:00.776884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:00.778869 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 406/830] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:00.780320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4a293-ef22-44fa-b909-cfd922c83dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.780896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4a293-ef22-44fa-b909-cfd922c83dd8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.783783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:00.784369 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 425/831] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:00.791974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:00.791974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:00.791974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:00.839034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:00.857641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:00.858850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:00.991583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b815-ed16-456a-a534-96e5d5bff3f4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:01.007112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:01.050615 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 426/832] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:01.054215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:01.055079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:01.055453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:01.055827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:01.056772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:01.057121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:01.058941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:01.074530 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 407/833] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:01.085284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:01.270569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09985571-e65c-4a16-86de-dd7323c767fd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:01.320654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:01.321286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:01.321594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:01.321918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:01.323569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c9cf360f24634e1aa0edb2900994d9b7) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:01.324052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:01.326664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308332-5a79-4a5a-9c5d-e82c3b8b307e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:01.342081 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 427/834] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:01 2022] GET /identity/v3/role_assignments?user.id=c9cf360f24634e1aa0edb2900994d9b7&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:01.410008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:01.580548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:01.596530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b9ca-f64d-4433-8de5-bc385bbc5f75 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:01.643217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:01.644255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:01.644717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:01.645172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:01.660970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:01.667298 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:01.668383 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:01.669296 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:01.671982 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 408/835] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:30:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:01.673018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9b4f4-82e9-4fe5-9f0d-14675c9665a2 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:01.673463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9b4f4-82e9-4fe5-9f0d-14675c9665a2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:01.673675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9b4f4-82e9-4fe5-9f0d-14675c9665a2 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:01.677910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 428/836] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:01.679651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:01.690820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:01.691273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:01.691720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:01.723032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:01.725262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:01.824853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:01.843884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa48fc8-bcbe-4447-a66a-ce24892aae1f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:01.879071 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 429/837] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:01.909479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:01.910568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:01.911072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:01.911552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:01.912444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:01.912955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:01.914606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:01.925414 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 409/838] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:01.936292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:02.201982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14013d18-ff74-43ad-9749-9e4192396d4a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:02.304454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e237-2102-446b-9824-b000168780ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:02.305501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e237-2102-446b-9824-b000168780ab None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:02.306015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e237-2102-446b-9824-b000168780ab None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:02.306536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e237-2102-446b-9824-b000168780ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:02.329967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8e237-2102-446b-9824-b000168780ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:02.332765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8e237-2102-446b-9824-b000168780ab None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:02.364662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-dec8e237-2102-446b-9824-b000168780ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:02.365342 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:02.366939 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:02.368666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:02.368666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:02.368666 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:02.368666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 430/839] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:02.377070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e237-2102-446b-9824-b000168780ab None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:02.401619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:02.436045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:02.598138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f49fa-cc0f-4538-b531-4a3431debf5f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:02.608338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e237-2102-446b-9824-b000168780ab None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:02.668607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:02.670510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:02.673971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:02.674871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:02.676220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:02.679781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:02.682181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:02.684321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:02.686198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:02.686698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:02.688552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:02.689118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:02.691664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:02.699751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:02.700830 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:02.701804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:02.710832 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 410/840] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:02.713659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:02.730686 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 431/841] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:02.732311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:02.875124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:02.898699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:02.908258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c49c-7025-4ccb-a6e6-67a2f81af6dc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:02.918978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4568-d743-4eb5-b13d-dcec1bcf3ae5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:02.952007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:02.952724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:02.953003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:02.953270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:02.954050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:02.954361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:02.955904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:02.961895 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 411/842] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:02.965171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:02.965966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:02.966189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:02.966807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:02.968674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:02.975605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:02.977147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:02.990395 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:02.991408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 19:30:02.992318 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:02.996967 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 432/843] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:30:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:02.998123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:03.096689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf5eb0-ccce-4732-80ba-d7186090fd11 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:03.114783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7ad79-8226-410d-9510-b40e442009f8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:03.137990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:03.138942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.139469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.139962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.140794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:03.141430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:03.143180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:03.149083 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 412/844] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:03.158996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:03.159720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.160090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.160501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.161714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:03.162244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:03.164588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1606c5-75af-4e06-92c7-b11dde2aa5df None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:03.202640 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 433/845] 10.222.0.78 () {56 vars in 1135 bytes} [Sun Aug 28 19:30:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:03.211363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:03.216967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:03.227623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee935-4bb8-478f-ae9b-eb07386ad22b None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.229456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee935-4bb8-478f-ae9b-eb07386ad22b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.229941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee935-4bb8-478f-ae9b-eb07386ad22b None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.237131 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 434/846] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:03.239557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.239870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.240123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.251289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:03.267524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:03.270771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:03.367309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403cba-ac5b-442d-afed-2a8892212694 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:03.367902 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 435/847] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:03.408786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c31d8-2362-4db8-af6c-3c4813c5b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:03.409309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c31d8-2362-4db8-af6c-3c4813c5b6df None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.409588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c31d8-2362-4db8-af6c-3c4813c5b6df None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.409897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c31d8-2362-4db8-af6c-3c4813c5b6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.488422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c31d8-2362-4db8-af6c-3c4813c5b6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:03.489974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c31d8-2362-4db8-af6c-3c4813c5b6df None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:03.492237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:03.612872 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 413/848] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:03.619786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:03.680728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c38038-c716-4102-812c-a820cb788b1f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.680924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c38038-c716-4102-812c-a820cb788b1f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.681178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c38038-c716-4102-812c-a820cb788b1f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.682906 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 414/849] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:03.688598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.688884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.689189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.708908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:03.710359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:03.765259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e176bda-505a-4688-acd3-3787ed721d34 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:03.805210 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 415/850] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:03.810888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:03.811815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:03.812286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:03.812557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:03.815473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:03.819044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:03.829829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:03.831841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:03.850972 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:03.852053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:03.852930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:03.852930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:03.852930 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:03.852930 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 436/851] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:03.862309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:03.897703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.028898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf4aa-81df-4630-8eea-870c038c6a03 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.031572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae5486-b99c-418a-b63a-d8d7c2f1ee51 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.074231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.075000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.075375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.075743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.076495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:04.076897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.078528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.096391 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 437/852] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:04.096391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.110544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.111484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.112509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.112509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.129340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:04.138197 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:04.139274 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:04.140104 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 416/853] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:30:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:04.141296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.170463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.230121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c51f0-c4b0-41d3-83c6-83e024ee09bc None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.268207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.275682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.276591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.276712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.276974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.277572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.285036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.285242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0ccd-da73-435e-a19d-fafbc932ce71 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:04.288553 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:04.289604 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:04.295041 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 438/854] 10.222.0.78 () {56 vars in 1132 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:04.295892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.329682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.330381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.330664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.330940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.339416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.341228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:04.355520 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:04.356754 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:04.357761 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 417/855] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:04.358397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.448764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183672-d7ff-4586-ba77-ccfb46aa4a06 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.463244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.493107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.493725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.494044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.494354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.495063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:04.495373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.496821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.508345 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 439/856] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:04.510095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.510385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eea95-c74b-4992-badd-ee676454f588 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.566960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.567571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.567849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.568123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.568785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:04.569156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.570590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.576345 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 418/857] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:04.577392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.600566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.683040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b461-b65a-4ec8-94b5-264c870610e6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.708876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d6110-d258-422b-b531-31464bfa655a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.749353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665883-ae36-4256-9706-dbc80710906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.751103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665883-ae36-4256-9706-dbc80710906b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.751103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665883-ae36-4256-9706-dbc80710906b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.751103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665883-ae36-4256-9706-dbc80710906b None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.752677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665883-ae36-4256-9706-dbc80710906b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:04.752993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665883-ae36-4256-9706-dbc80710906b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.754620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665883-ae36-4256-9706-dbc80710906b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.760532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.761370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.761805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.762337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:04.777730 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 440/858] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:04.777730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665883-ae36-4256-9706-dbc80710906b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.784217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:04.785804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:04.803130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:04.804384 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:04.805290 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:04.805290 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:04.805290 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:04.805290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 419/859] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:04.805513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:04.827514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.918549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.944182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665883-ae36-4256-9706-dbc80710906b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.981036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6f9b-e2c9-43ab-9725-5a5fcdd9b0c7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:04.998517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:04.999148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:04.999427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:04.999700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.000373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:05.000683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.002142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:05.013927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 441/860] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:05.013927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:05.039247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:05.040137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.040594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.041179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.042270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=1120d09d46e5416a9257f2a40da688d5) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:05.042796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.044492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:05.052420 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 420/861] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:04 2022] GET /identity/v3/role_assignments?user.id=1120d09d46e5416a9257f2a40da688d5&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:05.158328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:05.165663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970e906-7677-4182-8dc9-786903e05c91 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:05.211831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:05.212479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.212800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.213111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.213798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:05.214152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.215743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ea3c4-e947-4466-a557-7ad0afc74f4b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:05.236441 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 442/862] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:05.242527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:05.297467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84acb27-0e13-4505-a2d3-aa7a5cf98fee None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.298094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84acb27-0e13-4505-a2d3-aa7a5cf98fee None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.298480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84acb27-0e13-4505-a2d3-aa7a5cf98fee None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.300006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 443/863] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:05.308037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.308413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.308693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.339215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:05.342716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:05.391564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4056fd-0ec3-40c7-9177-45c46d623401 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:05.435924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:05.441264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:05.441802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.442123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.442391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.450839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.452291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:05.469876 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:05.470915 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:05.471871 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 421/865] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:30:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:05.472481 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 444/865] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:05.474149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:05.618252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c23d-90f0-4235-909c-26427c436a81 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:05.664337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:05.665396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.665978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.666455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.667381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:05.667881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.669520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:05.694791 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 422/866] 10.222.0.78 () {56 vars in 1149 bytes} [Sun Aug 28 19:30:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:05.700965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:05.778994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:05.803855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:05.824368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb06a-e352-4765-a7e9-5127f95b5b4a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:05.841976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:05.867952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:05.868579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.869409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.869766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.932052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8141caa-1559-4817-9433-9b8029263d4f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:05.941402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.942892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:05.985759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:05.987100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:05.987804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:05.988470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:05.989715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:05.992164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:06.044939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:06.072474 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 445/867] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:06.078657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:06.102254 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 423/868] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:30:05 2022] POST /identity/v3/services => generated 251 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:06.251920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbe64e-ac21-4b08-8190-c4c051a5533e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:06.325148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:06.325796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:06.326099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:06.326372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:06.338429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:06.339979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:06.357895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:06.358851 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:06.359720 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:06.359720 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:06.359720 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:06.360311 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 446/869] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:06.370803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:06.520649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ed80-4778-4d3e-bf6a-0febc64643c7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:06.533095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:06.558683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:06.559696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:06.560193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:06.560660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:06.561543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:06.562088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:06.563681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:06.578211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 424/870] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:06.588089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:06.654581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:06.757168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c21a-7dc4-4cf3-9b66-57a3147deabb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:06.823224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:06.825417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:06.826160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:06.826932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:06.840726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:06.843795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:06.867155 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:06.869752 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:06.871787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:06.875070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 447/871] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:06.885311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:07.057073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b2422-68e7-453f-a9ae-c58f47ebcb8a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:07.109176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:07.109783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.110106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.110379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.111086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:07.111391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:07.112856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d501350-b36e-488f-b5b5-49817f6084e9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:07.126697 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 425/872] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:07.135328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:07.199901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b9fe-e682-4c6e-ade6-5d15e01fe834 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.200385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b9fe-e682-4c6e-ade6-5d15e01fe834 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.200869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b9fe-e682-4c6e-ade6-5d15e01fe834 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.205336 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 426/873] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:07.214071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ba5d-1151-4b0a-ab8f-1c374b8d38a3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.214467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ba5d-1151-4b0a-ab8f-1c374b8d38a3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.214847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ba5d-1151-4b0a-ab8f-1c374b8d38a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.244800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2257ba5d-1151-4b0a-ab8f-1c374b8d38a3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:07.246687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2257ba5d-1151-4b0a-ab8f-1c374b8d38a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:07.271784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:07.280347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1862a-a64e-4a5e-8f4d-d98e7c6d6bab None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:07.297492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:07.337267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:07.338808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.339331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.339811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.340847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=4898339418664af0b17fbfed27604480) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:07.341372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:07.343218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d05ab0-8f8e-44ec-8f48-86af2c0983a1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:07.350572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 448/874] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:07 2022] GET /identity/v3/role_assignments?user.id=4898339418664af0b17fbfed27604480&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:07.388416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 427/875] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:07.629612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c683ec-193b-4f97-a707-3ad15e9ca057 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.629925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c683ec-193b-4f97-a707-3ad15e9ca057 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.630472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c683ec-193b-4f97-a707-3ad15e9ca057 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.632109 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 449/876] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:07.638082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.638400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.638766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.672735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:07.673995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:07.751972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 428/877] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:07.760006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c683ec-193b-4f97-a707-3ad15e9ca057 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:07.884816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c683ec-193b-4f97-a707-3ad15e9ca057 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:07.923762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:07.924205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:07.924384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:07.924646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:07.927824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:07.927824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:08.049408 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 450/878] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:30:07 2022] POST /identity/v3/services => generated 269 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:08.089931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:08.242992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:08.252656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8f81-7587-43c7-a38e-1df75db296e2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:08.319153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:08.319902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:08.320678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:08.320678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:08.321316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:08.323432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-2cd97072-9f35-4248-acf9-1b0a998d2711 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:08.340645 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:08.341772 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:08.343216 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 429/879] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:08.350023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:08.405346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:08.539483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0935-ac42-4cd7-a61e-97f56dc104e5 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:08.539686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0935-ac42-4cd7-a61e-97f56dc104e5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:08.539965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0935-ac42-4cd7-a61e-97f56dc104e5 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:08.546141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 430/880] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:08.547587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:08.547877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:08.548169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:08.568200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:08.569712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:08.582908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588fb6-c987-4167-b4d1-62120669e4ca None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:08.646700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:08.647330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:08.647606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:08.647877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:08.648533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:08.648847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:08.651142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:08.680075 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 451/881] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:08.680618 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 431/882] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:08.687018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:08.795550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:08.819037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21aa9-2718-440a-bd2e-3731b507e4fc None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:08.859882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:08.861056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:08.861798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:08.862448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:08.863352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:08.863880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:08.865484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:08.872910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 452/883] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:09.055101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:09.166212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:09.207387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89084-83da-495e-9068-f9f46b2c5ff6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:09.249449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:09.250130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:09.250410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:09.250678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:09.251282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:09.252676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:09.262926 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:09.265586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:09.267030 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 432/884] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:09.270573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:09.443588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7683b-fbe4-4775-aecc-19a93b69afc7 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:09.482921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:09.483602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:09.483973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:09.484310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:09.485079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:09.485475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:09.487037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:09.493093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 453/885] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:09.502303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:09.713727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8f92-c920-460f-ad3c-7292120e1d17 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:09.781883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:09.785884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:09.785884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:09.785884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:09.785884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:09.785884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:09.789884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b6d82-cb80-4f8c-a165-07de6c4d3d53 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:09.798354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 433/886] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:09.808255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:09.831333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:09.965974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5558d-0bf8-404e-ba21-e886499ccdcf None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:09.980021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201b145-44f8-4216-b602-1f769cf27107 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:09.980438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201b145-44f8-4216-b602-1f769cf27107 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:09.980856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201b145-44f8-4216-b602-1f769cf27107 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:09.983858 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 434/887] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:09.997882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e9ac-6ff6-47df-b5d2-d1f453d6d99c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:09.998111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e9ac-6ff6-47df-b5d2-d1f453d6d99c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.001886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e9ac-6ff6-47df-b5d2-d1f453d6d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.013880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:10.013880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:10.013880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.013880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.014303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] RBAC: Adding query filter params (interface=public, service_id=673c03a496954f50afcbf78f20a76925, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:10.014303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:10.017890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:10.022020 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 454/888] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:30:09 2022] GET /identity/v3/endpoints?service_id=673c03a496954f50afcbf78f20a76925&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:10.033879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:10.034116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d610e9ac-6ff6-47df-b5d2-d1f453d6d99c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:10.035863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d610e9ac-6ff6-47df-b5d2-d1f453d6d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:10.039974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:10.165028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:10.187621 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 435/889] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:10.209650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992255-96cb-409a-9fca-c9aa99d4ac67 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:10.264491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e31f0-c548-4ae6-853e-259801c641d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:10.266568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e31f0-c548-4ae6-853e-259801c641d4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:10.267435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e31f0-c548-4ae6-853e-259801c641d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.268384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e31f0-c548-4ae6-853e-259801c641d4 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.269714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e31f0-c548-4ae6-853e-259801c641d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:10.271556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e31f0-c548-4ae6-853e-259801c641d4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:10.280115 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 455/890] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:30:10 2022] GET /identity/v3/services => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:30:10.357812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502cc6-d462-4c5c-9652-d56c40898833 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:10.358492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502cc6-d462-4c5c-9652-d56c40898833 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.358974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502cc6-d462-4c5c-9652-d56c40898833 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.360948 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 436/891] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:10.367902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:10.368606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.369114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.389949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:10.391666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:10.479532 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 456/892] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:10.514215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502cc6-d462-4c5c-9652-d56c40898833 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:10.665960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502cc6-d462-4c5c-9652-d56c40898833 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:10.721896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:10.722113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:10.722364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.722724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.732499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:10.737644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:10.743214 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:10.745264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:10.746164 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 437/893] 10.222.0.78 () {56 vars in 1120 bytes} [Sun Aug 28 19:30:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:10.753378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:10.830268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:10.844049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:10.884618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f80d24-902a-41f3-8404-abd24f746914 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:10.949086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:10.949638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:10.949969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:10.950228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:10.950909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:10.951213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:10.952612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:10.970684 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 457/894] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:30:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:10.973296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.007929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82abfb0-dcee-4967-88e8-c83955527422 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.058955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.060078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.060607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.061107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.062029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.063801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:11.074731 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:11.076079 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:11.077147 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:11.085580 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 438/895] 10.222.0.78 () {56 vars in 1132 bytes} [Sun Aug 28 19:30:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:11.087233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.147389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8c94-d7db-4419-832f-8245ff9ef20e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.175811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:11.199730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:11.210259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.211338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.211820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.212849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.228677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be58f5e-8017-40d9-9f4e-dd2fb613eda0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.229197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.231069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:11.258878 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:11.260476 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:11.266787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:11.266787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:11.266787 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:11.266787 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 458/896] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:11.267039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.283301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.284397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.284951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.285444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.286478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:11.287079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.288830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.299758 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 439/897] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:11.301429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.436332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76007eb-64cd-438a-9972-fbd607d8fb16 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.468627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114c9b-7a03-4701-9d43-2c3d3c83a8e1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.498232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.499106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.499621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.500175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.500836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:11.501142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.502895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:11.503870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039523-bda2-4889-bf37-de9cfc545024 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.513791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.525799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.525799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.525799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.525799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:11.525799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.525799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.526457 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 459/898] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:11.526457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d82ac9-6e8a-480c-844b-9d9d2958d4ac None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.526457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d82ac9-6e8a-480c-844b-9d9d2958d4ac None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.526457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d82ac9-6e8a-480c-844b-9d9d2958d4ac None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.526709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 440/899] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:11.526709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.527988 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 460/900] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:11.529416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.529678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.529985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.551197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:11.552412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:11.609165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:11.665841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d026ec-cd79-463c-bfa4-a02a8c7282f6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.666144 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 461/901] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:11.667116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.714087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.714755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.715288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.715566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.726986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.729117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:11.747586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:11.748636 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:11.749588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:11.750226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 441/902] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:11.756253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.815226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06932b59-5b7f-44cd-a32f-a24ede27be0e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.833577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:11.865618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.866783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.867336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.867839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.869540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] RBAC: Adding query filter params (interface=public, service_id=3837ef085e4343fcaee47fe3c54bb77b, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:11.870643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.872439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:11.889810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 462/903] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/endpoints?service_id=3837ef085e4343fcaee47fe3c54bb77b&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:11.891880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:11.921712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585bae8-f153-4910-b270-522971bd55c7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:11.957170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:11.975209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:11.976240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:11.976782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:11.977318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:11.979199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:11.980068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:11.982517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:12.002832 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 442/904] 10.222.0.78 () {56 vars in 1149 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:12.004020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:12.052614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebedaba-738f-4c81-a109-93f0592541a6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:12.090727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:12.091344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:12.091618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:12.091884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:12.092501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:12.093891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:12.100289 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 463/905] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:30:11 2022] GET /identity/v3/services => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:30:12.101156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:12.169780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2cce2-0683-4530-be2b-1fa0ea9d467a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:12.194425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:12.223962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49242be-db30-46e2-92ff-d0c6ed499fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:12.227653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49242be-db30-46e2-92ff-d0c6ed499fb9 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:12.228680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49242be-db30-46e2-92ff-d0c6ed499fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:12.228977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49242be-db30-46e2-92ff-d0c6ed499fb9 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:12.229691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49242be-db30-46e2-92ff-d0c6ed499fb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:12.235399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49242be-db30-46e2-92ff-d0c6ed499fb9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:12.253573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:12.259952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977d53-7255-4c5a-b272-015965a5390a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:12.314194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:12.315190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:12.315631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:12.315968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:12.336224 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 443/906] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:30:12 2022] POST /identity/v3/services => generated 241 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:12.433762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:12.436822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:12.551942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b3cc-91aa-4940-89ac-bf3f9dd54d8d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:12.552828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b3cc-91aa-4940-89ac-bf3f9dd54d8d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:12.553334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b3cc-91aa-4940-89ac-bf3f9dd54d8d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:12.559425 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 444/907] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:12.568474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:12.568974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:12.569457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:12.581714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:12.593397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 464/908] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:12 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:12.595038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:12.602268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:12.605250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:12.719872 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 445/909] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:12.731988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d557a-c860-466d-96f0-0f8d689bff09 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:12.770914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:12.771733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:12.772113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:12.772513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:12.786398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:12.787871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:12.810148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:12.811947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:12.813674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:12.813674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:12.813674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:12.817328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 465/910] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:12.819046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:12.984072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:13.002275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64357d-3526-4ce8-8048-59a9919c75b5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:13.019133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:13.066882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:13.067438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:13.067715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:13.067984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:13.068639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:13.068943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:13.070940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:13.097375 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 446/911] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:13.103331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:13.106987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:13.187555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7c9d6-a743-4b2a-8f78-8785f0f160c6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:13.232818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:13.233813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:13.234387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:13.234897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:13.235787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:13.237389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:13.263007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a6f0b-d926-4349-a4d7-ef698d0e6bbe None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:13.291196 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:13.292302 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 19:30:13.293180 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:13.301790 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 466/912] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:13.308776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:13.318095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:13.319931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:13.320128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:13.320548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:13.347888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:13.353265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:13.388776 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:13.390064 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:13.392107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 447/913] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:13.403287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:13.461304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:13.650903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47d150-3edb-494f-8366-bb7f6be83fb6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:13.691957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:13.742707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:13.742936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:13.743258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:13.744397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:13.745238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:13.749339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:13.751625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:13.781631 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 467/914] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:13.792959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:13.891732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d452-696d-4cd3-9d0b-5271794a312a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:13.967920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:13.969953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:13.970460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:13.971565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:13.972484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:13.973164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:13.977281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:14.011709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 448/915] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 613 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:14.016627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:14.064120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72546b-8115-4551-b71a-64c1adeb6b10 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:14.157646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:14.159258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.161831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.162698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.164204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:14.168712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:14.171374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:14.194437 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 468/916] 10.222.0.78 () {56 vars in 1114 bytes} [Sun Aug 28 19:30:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:14.196544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:14.251129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:14.333708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071016-c478-4119-9984-bc3913b67ab5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:14.350666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:14.400109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:14.400972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.401364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.401751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.402639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] RBAC: Adding query filter params (role.id=f2e8d1a460734d178d7fc910f3e2aedf, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=4898339418664af0b17fbfed27604480) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:14.402950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:14.405122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86425a7-9e83-41ee-95d5-c66e8b2c8468 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:14.416411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 449/917] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:14 2022] GET /identity/v3/role_assignments?user.id=4898339418664af0b17fbfed27604480&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=f2e8d1a460734d178d7fc910f3e2aedf => generated 259 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:14.416411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903880-2d56-4840-afbe-5c21180d740f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.416411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903880-2d56-4840-afbe-5c21180d740f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.416411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903880-2d56-4840-afbe-5c21180d740f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.416411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 450/918] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:14.427088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55221aab-42a0-4c40-98bb-cc4cf231a936 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.427088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55221aab-42a0-4c40-98bb-cc4cf231a936 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.427088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55221aab-42a0-4c40-98bb-cc4cf231a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.456733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-55221aab-42a0-4c40-98bb-cc4cf231a936 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:14.458271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-55221aab-42a0-4c40-98bb-cc4cf231a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:14.501658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46345f35-d7a9-410d-a655-a135d7383218 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:14.585884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:14.585884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.585884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.585884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.586329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:14.593877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:14.624427 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 451/919] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:14.685069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944dad2-5744-4d3d-99b9-934141795fab None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.685069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944dad2-5744-4d3d-99b9-934141795fab None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.685069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944dad2-5744-4d3d-99b9-934141795fab None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.685069 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 452/920] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:14.690889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:14.691255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:14.691495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:14.728789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:14.730349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:14.740032 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 469/921] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:14.855397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:14.871781 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 453/922] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:14.960501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.187535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:15.195841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b893d9-a560-42c5-8649-888e7940358e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:15.202578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.276009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:15.277171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:15.277735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:15.278063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:15.278669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:15.280330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:15.289650 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:15.291053 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:15.291962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 470/923] 10.222.0.78 () {56 vars in 1132 bytes} [Sun Aug 28 19:30:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:15.299579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.411923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8b37-8050-4fe4-a266-fb0b0755217c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:15.467427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:15.469080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:15.469812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:15.470535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:15.471856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:15.475031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:15.486233 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:15.487456 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:15.488414 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:15.496614 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 454/924] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:15.498149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.517734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8725bb-e1db-4246-b715-9502868876f5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:15.558555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:15.559683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:15.560174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:15.560860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:15.561897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:15.562450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:15.564089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:15.567894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:15.572631 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 471/925] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:15.580711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.617496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:15.617723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b85f-cac6-431d-8461-fa45e6d9458b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:15.660748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:15.661404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:15.661685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:15.661993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:15.662813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:15.663128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:15.664664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:15.676126 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 455/926] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:15.678086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.725602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14a673-9438-4151-b3bb-5ad04f0dace3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:15.774464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:15.776355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:15.776918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:15.777455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:15.778418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:15.778943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:15.781111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:15.797952 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 472/927] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:15.799226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.818499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b12b5-7024-44cd-8cae-9dd1b0c0d18f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:15.851766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:15.866497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:15.866869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:15.867153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:15.867428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:15.868069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:15.868943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:15.870468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:15.881878 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 456/928] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:15.884222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:15.952169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:15.969974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f7fd-fdd8-46e1-aa78-902b634297a9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:16.021267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:16.021593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:16.021956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:16.022232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:16.024195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:16.025756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:16.085988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3dda-bec3-46ed-b9a4-ea44f28ee842 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:16.145548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:16.146363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:16.146545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:16.146792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:16.147514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] RBAC: Adding query filter params (interface=public, service_id=6076eb513f9c43c1a11eccf5959c29b3, region_id=RegionOne) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:16.147958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:16.149221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f51c1-b592-4537-a8a3-80b102098c8b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:16.157160 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 473/929] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:16.163503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 457/930] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:30:15 2022] GET /identity/v3/endpoints?service_id=6076eb513f9c43c1a11eccf5959c29b3&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:16.167888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:16.320002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18500d2e-003d-4eda-b497-89de73cad443 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:16.367416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e71ed1-27d2-4a79-806b-ad54f201117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:16.368061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71ed1-27d2-4a79-806b-ad54f201117e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:16.368380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71ed1-27d2-4a79-806b-ad54f201117e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:16.368660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71ed1-27d2-4a79-806b-ad54f201117e None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:16.369289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e71ed1-27d2-4a79-806b-ad54f201117e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:16.370730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e71ed1-27d2-4a79-806b-ad54f201117e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:16.382199 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 474/931] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:30:16 2022] GET /identity/v3/services => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:30:16.790188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051447-dc3a-4ab5-9c3a-04fa9b33ffd9 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:16.790867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051447-dc3a-4ab5-9c3a-04fa9b33ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:16.790867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051447-dc3a-4ab5-9c3a-04fa9b33ffd9 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:16.792334 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 458/932] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:16.798114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3daaf-82d3-49d8-8fd4-a22d421dddde None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:16.798611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3daaf-82d3-49d8-8fd4-a22d421dddde None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:16.798686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3daaf-82d3-49d8-8fd4-a22d421dddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:16.825336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-28e3daaf-82d3-49d8-8fd4-a22d421dddde None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:16.826602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-28e3daaf-82d3-49d8-8fd4-a22d421dddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:16.867102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:16.908756 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 475/933] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:17.190270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32829-c9f9-47b3-b7f3-6f345feba965 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:17.190748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32829-c9f9-47b3-b7f3-6f345feba965 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:17.191112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32829-c9f9-47b3-b7f3-6f345feba965 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:17.193108 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 459/934] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:17.199593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:17.199895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:17.200154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:17.219987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:17.221211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:17.265415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32829-c9f9-47b3-b7f3-6f345feba965 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:17.300940 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 476/935] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:17.342684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:17.409590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32829-c9f9-47b3-b7f3-6f345feba965 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:17.457713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:17.458324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:17.458632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:17.459001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:17.474131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:17.480366 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:17.481381 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:17.482249 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.485588 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 460/936] 10.222.0.78 () {56 vars in 1120 bytes} [Sun Aug 28 19:30:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:17.489470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:17.593308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:17.620563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:17.635318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb89615-d269-4840-a947-d63ed5ad48bf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:17.680457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:17.681155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:17.681422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:17.681693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:17.682417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:17.682721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:17.684862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:17.697247 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 477/937] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:30:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:17.702178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:17.770920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8b3b-40d7-47db-b34b-f203bc2b1e0e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:17.784173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:17.818542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:17.819524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:17.819814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:17.820141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:17.822322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:17.825059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:17.830249 n-d-854121-7 devstack@keystone.service[82299]: WARNING keystone.server.flask.common [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 19:30:17.845871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63a02d-0aef-4894-abb3-6246071baa16 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:17.882295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:17.889841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:17.890543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:17.890971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:17.891419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:17.898686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.sql.core [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 19:30:17.898686 n-d-854121-7 devstack@keystone.service[82299]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 19:30:17.898686 n-d-854121-7 devstack@keystone.service[82299]: [parameters: {'id': '0b10fdc22ee147d987f62b2348b811a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 19:30:17.898686 n-d-854121-7 devstack@keystone.service[82299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 19:30:17.908826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b10fdc22ee147d987f62b2348b811a9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b10fdc22ee147d987f62b2348b811a9. Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:30:17.909880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 19:30:17.910679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application yield resource Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise self.value Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application session.commit() Aug 28 19:30:17.911631 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.flush() Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application compat.raise_( Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 19:30:17.912504 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 19:30:17.914019 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:30:17.916146 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [parameters: {'id': '0b10fdc22ee147d987f62b2348b811a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:17.917027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:17.919789 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b10fdc22ee147d987f62b2348b811a9. Aug 28 19:30:17.922518 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:17.923650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:17.923793 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 461/938] 10.222.0.78 () {60 vars in 1140 bytes} [Sun Aug 28 19:30:17 2022] POST /identity/v3/projects => generated 262 bytes in 301 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:17.927056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:17.937216 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:17.938371 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:17.939238 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:17.939238 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:17.939238 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:17.944312 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 478/939] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:17.945553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:18.087726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f77f8-afd0-4a02-947f-9c185845ddd2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:18.103594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f7042-71db-4597-9452-dbc3d8730191 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:18.130861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:18.131513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.131841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.132152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.141165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:18.145283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:18.155906 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:18.157955 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:18.159732 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 462/940] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:18.163437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:18.180723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:18.182967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.183788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.185397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.187446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:18.188725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:18.192541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:18.215184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:18.218306 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 479/941] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:18.228304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:18.296406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:18.335302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b824a-42f8-4784-bf4f-f7b1c7547977 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:18.368946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc535094-42e1-4bfd-b342-965ac5269a88 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:18.375695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:18.376938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.377465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.378002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.378927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:18.379461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:18.381414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee6e54-e1eb-4ab9-b3e8-f7e0a2b993e8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:18.406138 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 463/942] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:18.421947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:18.423086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.423693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.424192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.434910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:18.437018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:18.454067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:18.455105 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:18.456175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:18.460398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066f74-a114-48e9-b921-be1d8ac52cf9 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.461085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066f74-a114-48e9-b921-be1d8ac52cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.461607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066f74-a114-48e9-b921-be1d8ac52cf9 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.463291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 480/943] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:30:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:18.464683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 464/944] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:18.470014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:18.472057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.472659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.473658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.516263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:18.520496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:18.650010 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 465/945] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:18.650203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d0cde-778d-4836-a623-fd9a800fc6bb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:18.652737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:18.711426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:18.712571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.712852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.713127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.714105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:18.714351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:18.716347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d91353-201a-4fcd-a27d-35720c5167e8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:18.736984 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 481/946] 10.222.0.78 () {56 vars in 1149 bytes} [Sun Aug 28 19:30:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:18.742289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:18.779151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:18.861077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b2c1-c6a4-4481-8d0b-06d4eb774cca None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.861579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b2c1-c6a4-4481-8d0b-06d4eb774cca None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.861654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b2c1-c6a4-4481-8d0b-06d4eb774cca None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.863437 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 482/947] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:18.869044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.869452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.869659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.893410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:18.894918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:18.919232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4063e-0b01-4263-9a80-0ec243f2f5bd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:18.974704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:18.975778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:18.976148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:18.976483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:18.991955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:18.994163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.012973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 483/948] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:19.014565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:19.017785 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:19.019339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:19.020780 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:19.020780 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:19.020780 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:19.023100 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 466/949] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:19.026740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.131145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:19.139910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:19.142928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036d8b4-d6d0-4f3e-8c37-c0ca9fbcb664 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.186595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b06f9-b01e-48ef-a818-4bef03002276 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.201883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.201883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.201883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.201883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.202367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.205885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:19.213749 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:19.214926 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:19.216063 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 484/950] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:19.221667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.232662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.233295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.233575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.233864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.234512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:19.234826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.236818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.258723 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 467/951] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:19.260345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.377911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3ec0-f063-4378-a814-cdaa00df0202 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.391693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d635fcf-2b62-4e66-9172-3404e374ee62 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.427172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.427391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:19.428327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.428769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.429048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.429686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:19.430171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.432444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.436497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.441372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.441372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.441372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.441894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 485/952] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:19.444077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.448870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.450884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:19.470257 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:19.471519 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:19.477982 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:19.481975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:19.489828 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 468/953] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:19.489828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.639363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc890-f29e-438a-ba89-284eb44e8671 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.679475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de2f3-8274-427d-94f6-5dca0e2f71d4 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.695935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.697106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.697711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.698331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.699266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.701747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:19.714912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:19.723493 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:19.724594 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 486/954] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:19.725595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.768777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.770654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.771109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.771535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.772670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:19.773065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.774766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.789903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 469/955] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:19.789903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.846895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:19.875236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975aac5-0f46-40ce-9796-04e60ffc6e73 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:19.894506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:19.927790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:19.928679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:19.929612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:19.929612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:19.930341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:19.931422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:19.933037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:19.948128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 487/956] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:19.955371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:19.967299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d3e3-c6fb-4e17-ad12-ea16ecdf2880 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:20.022354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:20.023244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.023657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.024068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.024933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:20.025405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:20.028079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:20.033904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 470/957] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:20.043941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:20.097960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444f213-f88b-412a-9936-611fa1b8ebd4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:20.148757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7af4be-874e-4c55-a777-38b7f8e37366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:20.150090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af4be-874e-4c55-a777-38b7f8e37366 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.150639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af4be-874e-4c55-a777-38b7f8e37366 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.151200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af4be-874e-4c55-a777-38b7f8e37366 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/4898339418664af0b17fbfed27604480/roles/f2e8d1a460734d178d7fc910f3e2aedf` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.154878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7af4be-874e-4c55-a777-38b7f8e37366 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=4898339418664af0b17fbfed27604480, role_id=f2e8d1a460734d178d7fc910f3e2aedf)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:20.157121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7af4be-874e-4c55-a777-38b7f8e37366 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:20.193234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab85c6-310a-4471-a864-fc11c56bb5dc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:20.215626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:20.240288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:20.240906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.241271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.241443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.242110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:20.242417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:20.244377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:20.251337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 471/958] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:20.257910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:20.300920 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 488/959] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:30:19 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/4898339418664af0b17fbfed27604480/roles/f2e8d1a460734d178d7fc910f3e2aedf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:20.413356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919722-3c63-4207-b3f3-705148615f28 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:20.464982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c9a52-f8f4-43f6-901c-17450fa78093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:20.466037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c9a52-f8f4-43f6-901c-17450fa78093 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.466520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c9a52-f8f4-43f6-901c-17450fa78093 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.466964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c9a52-f8f4-43f6-901c-17450fa78093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.467834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c9a52-f8f4-43f6-901c-17450fa78093 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:20.469460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c9a52-f8f4-43f6-901c-17450fa78093 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:20.584472 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 472/960] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:30:20.678381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3410cc-651f-4680-b570-343ac0b3814c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.678657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3410cc-651f-4680-b570-343ac0b3814c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.678936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3410cc-651f-4680-b570-343ac0b3814c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.680679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 489/961] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:20.686949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.687250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.687510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.707546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:20.708936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:20.754798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:20.812725 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 473/962] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:21.098302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3410cc-651f-4680-b570-343ac0b3814c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:21.101310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:21.229334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3410cc-651f-4680-b570-343ac0b3814c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:21.267212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:21.268073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:21.268534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:21.268955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:21.269747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:21.271357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:21.274288 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.server.flask.common [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 19:30:21.335504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.sql.core [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 19:30:21.335504 n-d-854121-7 devstack@keystone.service[82298]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 19:30:21.335504 n-d-854121-7 devstack@keystone.service[82298]: [parameters: {'user_id': '3ea8fc8c5d2c42199a3a896be14ecbac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 19:30:21.335504 n-d-854121-7 devstack@keystone.service[82298]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82298) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result.read() Aug 28 19:30:21.352148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:30:21.353641 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application yield resource Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise self.value Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application session.commit() Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 19:30:21.355226 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.session.flush() Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application compat.raise_( Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 19:30:21.357067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:30:21.360931 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result.read() Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:30:21.365073 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [parameters: {'user_id': '3ea8fc8c5d2c42199a3a896be14ecbac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:21.369368 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 19:30:21.374514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:21.378428 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 490/963] 10.222.0.78 () {60 vars in 1131 bytes} [Sun Aug 28 19:30:21 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:21.380450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:21.549772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198e25-36bc-431c-87fb-629110b1bf09 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:21.593947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:21.595551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:21.596229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:21.596732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:21.611251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:21.613259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-2f3c3fb3-ecac-45b5-af5e-306cf700459b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:21.627960 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:21.628997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 19:30:21.630254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:21.633055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 474/964] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:30:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:21.645459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:21.725742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:21.768405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ee75-d84b-416b-ba0d-50b6ea4247e1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:21.814705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:21.815449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:21.815737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:21.816024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:21.816979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:21.817500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:21.819527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd82ca-c46a-43f4-9904-22aed888a42c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:21.867624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 491/965] 10.222.0.78 () {56 vars in 1101 bytes} [Sun Aug 28 19:30:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:22.068158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3bf3-ec77-4ad4-bea6-bff103e952f0 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.068648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3bf3-ec77-4ad4-bea6-bff103e952f0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.069128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3bf3-ec77-4ad4-bea6-bff103e952f0 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.082263 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 475/966] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:22.082478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063cc0-7d9e-46d4-b165-af5fb74d59cb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.082478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063cc0-7d9e-46d4-b165-af5fb74d59cb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.082478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063cc0-7d9e-46d4-b165-af5fb74d59cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.115037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-da063cc0-7d9e-46d4-b165-af5fb74d59cb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:22.116621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-da063cc0-7d9e-46d4-b165-af5fb74d59cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:22.221643 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 492/967] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:22.505627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3bf3-ec77-4ad4-bea6-bff103e952f0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:22.508387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94edc-ac22-484c-b69d-6ed5f81e4561 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.509250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94edc-ac22-484c-b69d-6ed5f81e4561 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.509486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94edc-ac22-484c-b69d-6ed5f81e4561 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.510933 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 493/968] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:22.516981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fa46b-6cd7-4e5b-989c-5b214c1be32c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.517368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fa46b-6cd7-4e5b-989c-5b214c1be32c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.517522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fa46b-6cd7-4e5b-989c-5b214c1be32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.551107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-010fa46b-6cd7-4e5b-989c-5b214c1be32c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:22.553067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-010fa46b-6cd7-4e5b-989c-5b214c1be32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:22.553791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:22.636584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:22.670680 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 494/969] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:22.692079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3bf3-ec77-4ad4-bea6-bff103e952f0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:22.749408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7f19-19c9-4ef9-8a83-535541679e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:22.750378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7f19-19c9-4ef9-8a83-535541679e85 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.750660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7f19-19c9-4ef9-8a83-535541679e85 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.751082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7f19-19c9-4ef9-8a83-535541679e85 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.753598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7f19-19c9-4ef9-8a83-535541679e85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:22.754043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7f19-19c9-4ef9-8a83-535541679e85 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:22.840713 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 476/970] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:30:22 2022] POST /identity/v3/services => generated 242 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:22.889136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfbcfb-5393-4b70-83f9-cadfb68a4047 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.889486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfbcfb-5393-4b70-83f9-cadfb68a4047 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.889755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfbcfb-5393-4b70-83f9-cadfb68a4047 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.891662 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 495/971] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:22.898161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:22.898504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:22.898732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:22.920144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:22.921420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:22.948301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfbcfb-5393-4b70-83f9-cadfb68a4047 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.036740 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 477/972] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:23.115041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfbcfb-5393-4b70-83f9-cadfb68a4047 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.163511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.164541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.164541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.164875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.185058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:23.194876 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:23.196753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:23.199067 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:23.201989 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 496/973] 10.222.0.78 () {56 vars in 1120 bytes} [Sun Aug 28 19:30:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:23.202537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.214963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:23.318361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.339275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa59b2-c69d-4ed3-91d1-259cfd39c817 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.376980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:23.388822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.389495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.390130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.390130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.390818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:23.391201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:23.393110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:23.403084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 478/974] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:23.409947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.458598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f419-3d69-4937-b438-a5dd34a4a871 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.492141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:23.505612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.506489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.506734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.510372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.510372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:23.510372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:23.521743 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:23.523891 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:23.526123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 497/975] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:23.532780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.555818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f01f44-27be-4bcb-a219-3e160e62025f None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.615233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.616183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.616609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.617216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.634608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:23.636046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:23.654730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:23.656140 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:23.657392 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:23.657392 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:23.657392 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:23.661505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 479/976] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:23.662460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.690101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab431a3-1afd-4c23-bbc1-5c8f78625bbb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.699808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:23.739836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.740829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.741238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.741686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.742584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:23.742956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:23.744702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:23.754056 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 498/977] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:23.757997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.805172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ba6f-1853-4de6-a1a9-bc3448c9dfa6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.844088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:23.863724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.864807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.865320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.865798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.867132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:23.867694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:23.870490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:23.903228 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 480/978] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:23.903788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5935b9c-aab1-4371-b81b-266e23eea3bd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:23.904672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:23.954868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:23.955499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:23.955781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:23.956124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:23.956775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:23.957088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:23.958555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:23.964885 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 499/979] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:23.974550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:24.038680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:24.061487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c515-e48a-468e-8323-6cff83ef5670 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:24.112193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:24.112826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.113238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.113516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:24.123198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:24.124808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:24.138299 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:24.139572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 19:30:24.140725 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:24.141525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31746-1e7a-4c4b-96ff-463856e5f80b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:24.144411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 481/980] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:24.145395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:24.194865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:24.195724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.196129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.196492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:24.197456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=6076eb513f9c43c1a11eccf5959c29b3, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:24.197930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:24.199434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:24.206604 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 500/981] 10.222.0.78 () {56 vars in 1249 bytes} [Sun Aug 28 19:30:23 2022] GET /identity/v3/endpoints?service_id=6076eb513f9c43c1a11eccf5959c29b3&interface=admin®ion_id=RegionOne => generated 193 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:24.213293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:24.220666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:24.316210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b324a-0194-49c3-9d80-1ab41d72dd40 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:24.360273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:24.363010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:24.363666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.363944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.364217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:24.364993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:24.365298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:24.367108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:24.374874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c1fdd-bb01-4248-8ee3-fa9d8a4468b8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:24.398818 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 482/982] 10.222.0.78 () {56 vars in 1149 bytes} [Sun Aug 28 19:30:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:24.405459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:24.436556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:24.437817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.438138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.438445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:24.439394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:24.441737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:24.459014 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 501/983] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:30:24 2022] GET /identity/v3/services => generated 1727 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:30:24.618966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:24.625678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3953a8-b6ec-40b9-a9a3-f86bfb296b22 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:24.673807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcf25a-c6d4-4987-9123-5222b7f36d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:24.674390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcf25a-c6d4-4987-9123-5222b7f36d56 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.674697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcf25a-c6d4-4987-9123-5222b7f36d56 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.674925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcf25a-c6d4-4987-9123-5222b7f36d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:24.760708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcf25a-c6d4-4987-9123-5222b7f36d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:24.762103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcf25a-c6d4-4987-9123-5222b7f36d56 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:24.892445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:24.903449 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 483/984] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:24 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 19:30:24.905202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:24.973801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059890-39f2-430c-82e3-71e7697a6149 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.974133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059890-39f2-430c-82e3-71e7697a6149 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.974396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059890-39f2-430c-82e3-71e7697a6149 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:24.975795 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 484/985] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:24.982141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:24.982548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:24.982713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.002651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:25.003949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:25.060667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0c92-98c0-43e7-8789-ec658f82b704 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:25.097923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 485/986] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:25.116817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:25.117616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:25.118747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:25.118985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.133720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:25.135507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:25.152643 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:25.153683 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:25.159654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:25.159654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:25.159654 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:25.159654 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 502/987] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:25.161837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:25.314047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12aa22-318a-4d13-baed-4fd132f89fe6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:25.367564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:25.374704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:25.375334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:25.375619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:25.375903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.376550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:25.376853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:25.378445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:25.396641 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 486/988] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:25.398076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:25.423759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:25.445637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:25.526347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a930-b2d5-43d2-8016-c8fe343dd685 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:25.592004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ad6b8-c0b4-4367-b614-d19f7b13c2bb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:25.607664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:25.608839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:25.609463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:25.610029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.627714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:25.630881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:25.654655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:25.656300 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:25.657697 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:25.659799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:25.661143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:25.661734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:25.662367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] PATH_INFO: `/v3/services/compute` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.663130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:25.664898 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 503/989] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:25.665206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:25.666523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:25.677204 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:25.678336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:25.679216 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:25.686556 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 487/990] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:25.688316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:25.787286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:25.791135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:25.827446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb134e7-0765-4b30-ad15-2f206cabb1df None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:25.867521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1d08-c699-400f-b10e-91189532ff1c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:25.875793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:25.876420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:25.876697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:25.876968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.877661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:25.877997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:25.879697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:25.897915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 504/991] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:25.905128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:25.927889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:25.928767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:25.928767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:25.929060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:25.929683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:25.930024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:25.931780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:25.940872 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 488/992] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:25.946748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:26.063480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d271f-0fb4-49b8-935f-36e043633a73 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:26.092039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285660-3477-4dad-97dd-d7a63a2023b8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:26.114119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:26.115192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:26.115777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:26.116368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:26.117331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] RBAC: Adding query filter params (role.id=f2e8d1a460734d178d7fc910f3e2aedf, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=4898339418664af0b17fbfed27604480) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:26.117765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:26.119353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:26.121714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:26.129677 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 505/993] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/role_assignments?user.id=4898339418664af0b17fbfed27604480&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=f2e8d1a460734d178d7fc910f3e2aedf => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:26.144557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:26.170737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:26.171562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:26.171981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:26.172435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:26.173274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] RBAC: Adding query filter params (type=compute) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:26.173703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:26.175356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:26.187152 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 489/994] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:26.188871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:26.372172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fffb-5c1b-4cbb-818c-ee71186d41fd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:26.434070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:26.435043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:26.437316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:26.437316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:26.437316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] RBAC: Adding query filter params (interface=public, service_id=8ec6104769334c59a45d43d2bb5e5984, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:26.437316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:26.439693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02387955-5058-4fbb-b25e-067391b5410c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:26.449331 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 506/995] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:30:26 2022] GET /identity/v3/endpoints?service_id=8ec6104769334c59a45d43d2bb5e5984&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:26.455240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:26.653009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085dfe-f4f8-4432-9096-261db894525b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:26.667620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807db5-54b4-4316-b88e-efa474c6ab6c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:26.668116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807db5-54b4-4316-b88e-efa474c6ab6c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:26.668371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807db5-54b4-4316-b88e-efa474c6ab6c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:26.669741 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 507/996] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:26.676186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:26.676569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:26.676870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:26.705756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:26.707053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:26.726027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:26.726708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:26.727049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:26.727955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:26.729104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:26.731811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:26.753889 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 490/997] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:30:26 2022] GET /identity/v3/services => generated 1727 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:30:26.825640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:26.852766 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 508/998] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:27.355090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:27.447943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:27.525529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561991-2b9a-42ea-bc41-eb397d71f222 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:27.574071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:27.574781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:27.575055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:27.575392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:27.575989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:27.577616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:27.588892 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:27.594316 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:27.595210 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 491/999] 10.222.0.78 () {56 vars in 1126 bytes} [Sun Aug 28 19:30:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:27.596604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:27.713931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48dd3-9261-454b-b74c-4cc0b36f0619 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:27.756208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:27.756829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:27.757110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:27.757386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:27.758086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:27.758950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:27.760405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:27.766057 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 509/1000] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:27.771770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:27.917151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41933f01-676b-4fcd-bf02-bbb5479ad7e9 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:27.947946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:28.000310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:28.000876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.001133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.001404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.002081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:28.002391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:28.003788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a680c-3c02-48cb-a43f-86de4cc28a32 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:28.010266 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 492/1001] 10.222.0.78 () {56 vars in 1122 bytes} [Sun Aug 28 19:30:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:28.015985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:28.101897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:28.165558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77af71-c8f6-47a5-aed7-64c67331975d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:28.231942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:28.232925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.233415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.233935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.235192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:28.237807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:28.339605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293156-a801-4073-8633-40478c2bc46c None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.340056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293156-a801-4073-8633-40478c2bc46c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.340529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293156-a801-4073-8633-40478c2bc46c None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.342303 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 493/1002] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:28.349697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625f34-55a6-4ae3-9c3f-eeb3d247fb8f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.350124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625f34-55a6-4ae3-9c3f-eeb3d247fb8f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.350404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625f34-55a6-4ae3-9c3f-eeb3d247fb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.368224 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 510/1003] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:30:28.380261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a8625f34-55a6-4ae3-9c3f-eeb3d247fb8f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:28.381981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a8625f34-55a6-4ae3-9c3f-eeb3d247fb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:28.511463 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 494/1004] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:28.786603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:28.851829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f1749-cf0b-4a68-8419-5c331397a906 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.852411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f1749-cf0b-4a68-8419-5c331397a906 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.852411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f1749-cf0b-4a68-8419-5c331397a906 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.853778 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 495/1005] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:28.859162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.859471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.859756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.882558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:28.884693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:28.913910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854325a0-1efb-4018-b5f9-05d848281317 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:28.935510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:28.965743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:28.967555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:28.968306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:28.968759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] PATH_INFO: `/v3/services/image` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:28.970584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:28.972634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:28.975291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 496/1006] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:28.988361 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:28.993948 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:28.994805 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 511/1007] 10.222.0.78 () {56 vars in 1105 bytes} [Sun Aug 28 19:30:28 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:28.998812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:29.040558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:29.144733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc043c-7bc8-4955-b891-c86c18c75535 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:29.206176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:29.207753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:29.208553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:29.209551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:29.210962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] RBAC: Adding query filter params (name=image) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:29.212372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:29.215181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:29.225784 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 497/1008] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:29.234481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:29.290329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:29.419809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b5644-8e02-43e8-8a09-4f47fd2830bc None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:29.484257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:29.494476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:29.500977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:29.500977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:29.500977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:29.500977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] RBAC: Adding query filter params (type=image) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:29.500977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:29.501370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146d86f-5f6d-4e4f-ab3c-2e73ada0309c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:29.501450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:29.517927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 512/1009] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:29.550089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:29.553882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:29.553882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:29.553882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] PATH_INFO: `/v3/services/compute` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:29.553882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:29.553882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:29.564823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:29.567150 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:29.569073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 498/1010] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:29.592560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:29.678160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:29.778981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb993a-f70c-4624-a2d0-ecdd0875796a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:29.824712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:29.826175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:29.826607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:29.827025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:29.828056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:29.828513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:29.830051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:29.837103 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 513/1011] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:29.843432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:29.978885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9963-5cfd-4639-bc3a-d9422e20f87d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:30.024557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:30.025417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:30.025831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:30.026284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:30.027088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:30.027526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:30.029123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0ee65-03bd-461d-ba5e-17e00a7c59fe None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:30.035282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 499/1012] 10.222.0.78 () {56 vars in 1112 bytes} [Sun Aug 28 19:30:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:30.041397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:30.176936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a7f5-a897-46ce-99ad-b76eda9ed907 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:30.190488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:30.228972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8d70-9828-4ab7-9c7a-7fa9995c521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:30.229502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8d70-9828-4ab7-9c7a-7fa9995c521c None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:30.229820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8d70-9828-4ab7-9c7a-7fa9995c521c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:30.230271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8d70-9828-4ab7-9c7a-7fa9995c521c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:30.231441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c8d70-9828-4ab7-9c7a-7fa9995c521c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:30.235460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c8d70-9828-4ab7-9c7a-7fa9995c521c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:30.345587 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 514/1013] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:30.550334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffe389-6f9b-49d3-969f-74dc7bae357e None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:30.550744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffe389-6f9b-49d3-969f-74dc7bae357e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:30.551031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffe389-6f9b-49d3-969f-74dc7bae357e None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:30.552698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 500/1014] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:30.559522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:30.559812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:30.560181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:30.582255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:30.583784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:30.725706 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 515/1015] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:30 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:31.108690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffe389-6f9b-49d3-969f-74dc7bae357e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:31.156677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:31.275994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffe389-6f9b-49d3-969f-74dc7bae357e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:31.319487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99273-461c-4b22-9451-32da3b2950db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:31.320185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99273-461c-4b22-9451-32da3b2950db None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:31.320529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99273-461c-4b22-9451-32da3b2950db None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:31.320875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99273-461c-4b22-9451-32da3b2950db None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:31.322410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99273-461c-4b22-9451-32da3b2950db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:31.324066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99273-461c-4b22-9451-32da3b2950db None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:31.332710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 501/1016] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:31.335197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:31.501972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:31.517479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4f250-4ede-4e36-ac35-fbbed479f3db None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:31.581882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b3c44-850c-49de-8095-81918f6da45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:31.581882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b3c44-850c-49de-8095-81918f6da45f None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:31.581882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b3c44-850c-49de-8095-81918f6da45f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:31.581882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b3c44-850c-49de-8095-81918f6da45f None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:31.582299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b3c44-850c-49de-8095-81918f6da45f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:31.585116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b3c44-850c-49de-8095-81918f6da45f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:31.762960 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 516/1017] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:30:31 2022] POST /identity/v3/projects => generated 311 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:30:31.834318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a30c5-b9a2-45d1-8779-fd312b77d17b None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:31.834670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a30c5-b9a2-45d1-8779-fd312b77d17b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:31.834872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a30c5-b9a2-45d1-8779-fd312b77d17b None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:31.837203 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 502/1018] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:31.843304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17516f1-3f71-4def-ae99-4c59c64924b0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:31.843635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17516f1-3f71-4def-ae99-4c59c64924b0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:31.843857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17516f1-3f71-4def-ae99-4c59c64924b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:31.868033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b17516f1-3f71-4def-ae99-4c59c64924b0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:31.870305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b17516f1-3f71-4def-ae99-4c59c64924b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:31.993879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 517/1019] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:31 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:32.324905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a30c5-b9a2-45d1-8779-fd312b77d17b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:32.455709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:32.468759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a30c5-b9a2-45d1-8779-fd312b77d17b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:32.511045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0ba0-b13d-4fee-8efd-b7a49fc3422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:32.512051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0ba0-b13d-4fee-8efd-b7a49fc3422b None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:32.512565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0ba0-b13d-4fee-8efd-b7a49fc3422b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:32.513070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0ba0-b13d-4fee-8efd-b7a49fc3422b None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:32.514008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0ba0-b13d-4fee-8efd-b7a49fc3422b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:32.515639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0ba0-b13d-4fee-8efd-b7a49fc3422b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:32.649321 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 503/1020] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:30:32 2022] POST /identity/v3/services => generated 242 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:32.728245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503ef3-6795-4c97-a18b-5dba97ca2917 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:32.729320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503ef3-6795-4c97-a18b-5dba97ca2917 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:32.729814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503ef3-6795-4c97-a18b-5dba97ca2917 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:32.731989 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 518/1021] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:32.738173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:32.741267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:32.741267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:32.759395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:32.760968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:32.866878 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 504/1022] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:33.181466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503ef3-6795-4c97-a18b-5dba97ca2917 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:33.286497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:33.327948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503ef3-6795-4c97-a18b-5dba97ca2917 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:33.390188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:33.391602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:33.392444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:33.393413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:33.414466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:33.424556 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:33.425732 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:33.426629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 519/1023] 10.222.0.78 () {56 vars in 1120 bytes} [Sun Aug 28 19:30:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:33.431959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:33.551927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:33.583671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054fee7-27ad-4aec-bcea-2b9922d1b07f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:33.650173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:33.651198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:33.651718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:33.652199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:33.653152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:33.653702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:33.655448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146ff4-b6c3-4769-9c10-fd358d2f4ad9 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:33.669714 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 505/1024] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:30:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:33.675694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:33.894686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b859-a83d-4b14-839b-0f9136933031 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:33.954020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a461-f437-4f71-9c93-312d3dae15b5 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:33.955181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a461-f437-4f71-9c93-312d3dae15b5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:33.955796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a461-f437-4f71-9c93-312d3dae15b5 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:33.957948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:33.958441 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 506/1025] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:33.964112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:33.964813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:33.965583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:33.965738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:33.966440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:33.966801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:33.967030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:33.980815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:33.987425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:33.996811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:33.999444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:34.003601 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:34.006285 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:34.008468 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:34.008468 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:34.008468 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:34.008468 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 520/1026] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:34.021244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:34.158386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 507/1027] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:34.205586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81d48c-be07-458e-a952-afd203a1fc36 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:34.247585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:34.248218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:34.248495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:34.248769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:34.249435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:34.249740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:34.251187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:34.273175 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 521/1028] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:34.273431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:34.361562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:34.415254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11b5da-452c-48b9-afca-03a00e9377c0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:34.477517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:34.478261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:34.478484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:34.478786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:34.482505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:34.489953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:34.491608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:34.507677 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:34.509289 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:34.510342 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 508/1029] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:30:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:34.515934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:34.583532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:34.677634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88de40f-0ac9-4b61-9fc6-a64808691b49 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:34.678667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a1cc8-c9e7-47f8-8552-499b30e00034 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:34.722617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:34.734169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:34.734938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:34.739508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:34.739508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:34.739508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:34.739508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:34.739508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:34.740009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:34.740009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:34.740009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:34.740684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:34.742037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:34.743616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:34.745771 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 522/1030] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:34.751945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:34.779050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 509/1031] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:30:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:34.780434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:34.883745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786bad6-0b22-4d35-b742-855274e39795 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:34.901163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:34.931667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:34.932189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:34.932541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:34.932850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:34.933533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:34.935061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:34.974764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69136d-e951-4f11-a03d-420db07398f5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:35.024426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3adbf1-7d80-49e0-a858-e3c2b028ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:35.025156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adbf1-7d80-49e0-a858-e3c2b028ed8b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:35.025460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adbf1-7d80-49e0-a858-e3c2b028ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:35.025726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adbf1-7d80-49e0-a858-e3c2b028ed8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:35.102308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 523/1032] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:30:34 2022] POST /identity/v3/users => generated 285 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:35.111675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:35.135049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3adbf1-7d80-49e0-a858-e3c2b028ed8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:35.136691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3adbf1-7d80-49e0-a858-e3c2b028ed8b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:35.316882 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 510/1033] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:35.327850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:35.374021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c822f-6d1a-451b-8398-a9e85273032f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:35.374297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c822f-6d1a-451b-8398-a9e85273032f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:35.374642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c822f-6d1a-451b-8398-a9e85273032f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:35.376738 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 511/1034] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:35.388158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:35.388158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:35.388558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:35.426553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:35.429375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:35.540721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660281-f1a3-4761-9cc2-b3f03e2bc419 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:35.561883 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 512/1035] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:35.596608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:35.597206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:35.597492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:35.597763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:35.612668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:35.614499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:35.633432 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:35.634510 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:35.635392 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:35.635392 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:35.635392 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:35.635392 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 524/1036] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:35.649908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:35.677681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:35.806290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05827011-a724-4fa1-8e34-94c12fa76064 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:35.875377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:35.876309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:35.876799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:35.877271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:35.878642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:35.879445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:35.881904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:35.905170 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 513/1037] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:35.906077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:35.914093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:35.939398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:36.060584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:36.066019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c149-8c22-4761-ab90-00b2dac23b71 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.099109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07cec2-0f4b-4abc-bafb-b10fd646d4b5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.120373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.121046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.121335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.121607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.122266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.123889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:36.137871 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:36.138895 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:36.143175 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 525/1038] 10.222.0.78 () {56 vars in 1105 bytes} [Sun Aug 28 19:30:35 2022] GET /identity/v3/services/image => generated 86 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:36.145309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:36.154701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.155444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.155762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.156055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.164505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.166218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:36.180658 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:36.182784 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:36.184115 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 514/1039] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:36.188530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:36.274920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:36.300918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc908e-9070-424d-87ea-bf1308c0d7a5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.345507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54282-d8f4-4b09-8158-241ada25a2e5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.352623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.353584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.353921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.354292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.355033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] RBAC: Adding query filter params (name=image) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:36.355462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.358940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.367474 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 526/1040] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:36.374491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:36.396574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.397175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.397455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.397727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.399140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:36.399434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.400902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.406619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:36.428947 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 515/1041] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:36.436371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:36.549754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1571-f232-4841-85c9-6d88e3e8d210 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.604818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.604818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.604818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.604818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.605294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] RBAC: Adding query filter params (type=image) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:36.605294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.605294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.611381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2ae9c-8b0d-485c-b141-77dd3e486cbc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.614515 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 527/1042] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:36.620188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:36.644516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:36.669829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.670479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.670763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.671126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.672129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] RBAC: Adding query filter params (role.id=f2e8d1a460734d178d7fc910f3e2aedf, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c9cf360f24634e1aa0edb2900994d9b7) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:36.672451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.674032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.683411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 516/1043] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:36 2022] GET /identity/v3/role_assignments?user.id=c9cf360f24634e1aa0edb2900994d9b7&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=f2e8d1a460734d178d7fc910f3e2aedf => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:36.825578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ca196-d374-46a0-be9d-53058070fb7a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:36.873731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba474-064c-4209-9b5d-122615450793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:36.874467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba474-064c-4209-9b5d-122615450793 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:36.874752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba474-064c-4209-9b5d-122615450793 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:36.875027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba474-064c-4209-9b5d-122615450793 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:36.875759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba474-064c-4209-9b5d-122615450793 None admin] RBAC: Adding query filter params (interface=public, service_id=6be7ebceff0a4f09be102f3e2c5c0c36, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:36.876073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba474-064c-4209-9b5d-122615450793 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:36.877487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba474-064c-4209-9b5d-122615450793 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:36.889979 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 528/1044] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:30:36 2022] GET /identity/v3/endpoints?service_id=6be7ebceff0a4f09be102f3e2c5c0c36&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:36.894218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:37.005520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:37.065599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1bc79-c8cc-4a10-8d02-c7569e28a8bf None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:37.108643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ab374-d648-4a6f-a32c-afb280acfa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:37.109682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ab374-d648-4a6f-a32c-afb280acfa1c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:37.110194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ab374-d648-4a6f-a32c-afb280acfa1c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:37.110720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ab374-d648-4a6f-a32c-afb280acfa1c None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:37.111470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ab374-d648-4a6f-a32c-afb280acfa1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:37.112948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ab374-d648-4a6f-a32c-afb280acfa1c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:37.130352 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 517/1045] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:30:36 2022] GET /identity/v3/services => generated 1957 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:30:37.690380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e2ac-9780-4e0d-91fa-3e0fb06543a5 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:37.690935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e2ac-9780-4e0d-91fa-3e0fb06543a5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:37.690935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e2ac-9780-4e0d-91fa-3e0fb06543a5 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:37.692844 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 529/1046] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:37.701684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:37.702388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:37.702699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:37.730751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:37.732408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:37.827988 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 518/1047] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:38.220801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e2ac-9780-4e0d-91fa-3e0fb06543a5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:38.375125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:38.423853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e2ac-9780-4e0d-91fa-3e0fb06543a5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:38.476709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:38.477394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:38.477746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:38.478122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:38.493682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:38.499283 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:38.500396 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:38.501621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:38.510205 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 530/1048] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:38.514052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:38.638473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:38.720621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b31a-ec93-4e28-86a5-7878b75bab23 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:38.765672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:38.766257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:38.766532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:38.766995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:38.767919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:38.768394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:38.770156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:38.782129 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 519/1049] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:38.790186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.011768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449ac1-888b-48ee-9bec-ca87f63651bd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.055372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207705-38de-4ea0-aed9-6725c8bb381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.056515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207705-38de-4ea0-aed9-6725c8bb381d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.057106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207705-38de-4ea0-aed9-6725c8bb381d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.057624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207705-38de-4ea0-aed9-6725c8bb381d None admin] PATH_INFO: `/v3/users/b97ee27e34614309b8e2eb27632603ca` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.062265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:39.076619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207705-38de-4ea0-aed9-6725c8bb381d None admin] RBAC: Authorizing `identity:get_user(user_id=b97ee27e34614309b8e2eb27632603ca)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.086541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207705-38de-4ea0-aed9-6725c8bb381d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.086541 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 531/1050] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:38 2022] GET /identity/v3/users/b97ee27e34614309b8e2eb27632603ca => generated 285 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:39.095761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.278326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544a96-78de-421c-a106-98967a0845d0 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.279248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544a96-78de-421c-a106-98967a0845d0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.279828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544a96-78de-421c-a106-98967a0845d0 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.280155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7efd5a-3354-4e3c-a680-b3b4e7e7045c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.286873 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 532/1051] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:39.288579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49115c-d144-4d2e-ad37-ae93f5c2850a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.289155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49115c-d144-4d2e-ad37-ae93f5c2850a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.289650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49115c-d144-4d2e-ad37-ae93f5c2850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.303113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:39.316828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cd49115c-d144-4d2e-ad37-ae93f5c2850a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:39.316828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cd49115c-d144-4d2e-ad37-ae93f5c2850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:39.341892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.343631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.344866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.345569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.435410 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 533/1052] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:39.436788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743a9d-c031-4509-94af-d4b3aede3d57 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.437290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743a9d-c031-4509-94af-d4b3aede3d57 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.437761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743a9d-c031-4509-94af-d4b3aede3d57 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.443648 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 534/1053] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:39.449128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.449440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.450770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.483271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:39.484764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:39.537781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.540946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.597250 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 535/1054] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:39.694325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 520/1055] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:39.705045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.722698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.746680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:39.859698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:39.869582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7312e-a4f1-455d-9f4e-61cc00908b62 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.940956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.942054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.942554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.943086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.946487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9525e-19c5-4ab4-9002-f2b6165870a6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.963806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:39.973161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:39.974253 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:39.975105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:39.979159 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 521/1056] 10.222.0.78 () {56 vars in 1120 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:39.986788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.008264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.010223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.011311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.011767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.013562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] RBAC: Authorizing `identity:get_project(project_id=611c461a75d24fb1b91c0e536ebbd3e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.015621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.018411 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 536/1057] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2 => generated 311 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:40.027167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.147254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:40.171294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412860-71bb-4c62-a4db-2e8230aa96b9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:40.177169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41242-8d73-4901-8be3-4bd82f73c246 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:40.206937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:40.226804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.228124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.228699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.229273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.230755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2, user.id=b97ee27e34614309b8e2eb27632603ca) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:40.231331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.234413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.235318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.236333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.236805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.237284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.238333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:40.238954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.241341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.245495 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 537/1058] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/role_assignments?user.id=b97ee27e34614309b8e2eb27632603ca&scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:40.251645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.266669 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 522/1059] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:40.272566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.483584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cac5d3-a104-41e9-97f5-35beb6646502 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:40.490449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a03a-0888-4c7a-b7b2-762255d50ace None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:40.540108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.541037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.541466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.542108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] PATH_INFO: `/v3/services/image` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.543442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.544762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.545648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.546153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.546624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.547375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.557542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:40.564711 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:40.566045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:40.567288 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 538/1060] 10.222.0.78 () {56 vars in 1105 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/services/image => generated 86 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:40.571693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.573658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.573781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:40.613009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:40.614363 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:40.615714 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:40.615714 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:40.615714 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:40.615714 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 523/1061] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:40.620792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.655465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:40.778426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065eed5-bebe-4a6e-a533-e1d40ad5cc6b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:40.834410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.835353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.835809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.836821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.837697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] RBAC: Adding query filter params (name=image) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:40.838093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.839673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.846042 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 539/1062] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:40.852289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:40.857048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ee96-09b6-4ad0-819b-fdaba7b5f888 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:40.930430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:40.931491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:40.931792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:40.932047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:40.932722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:40.933091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:40.934731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:40.951007 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 524/1063] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:40.956834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:41.048310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb619cb-e3c4-4861-a695-9f6ac72fd612 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:41.053221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:41.085407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:41.125067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:41.125876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:41.126443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:41.126710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:41.128903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] RBAC: Adding query filter params (type=image) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:41.129829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:41.131699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:41.147167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 540/1064] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:41.148410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:41.161151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0c5a-9542-40e4-978f-d56f50e7562e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:41.228299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:41.229510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:41.230167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:41.230739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:41.246268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:41.248518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:41.273056 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:41.274243 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:30:41.275347 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:41.276017 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 525/1065] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:30:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:41.285218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:41.322211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014848c-c653-46a9-b4e2-6300b7e0411a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:41.398846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:41.399901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:41.400169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:41.400428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:41.401657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:41.402563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:41.449883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933ec70-c1d2-4e20-910f-36ed220f6700 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:41.462656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:41.490513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:41.491163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:41.491545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:41.491720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:41.493040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:41.493351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:41.494914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:41.524522 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 526/1066] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:30:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:41.526633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:41.536775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 541/1067] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:41.731151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358960b-20a8-4d79-973f-a45697a92742 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:41.789660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:41.790333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:41.790614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:41.790886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:41.804232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:41.806339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:41.827080 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:41.828123 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:41.829200 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:41.829200 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:41.829200 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:41.829200 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 527/1068] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:41.837667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:41.904059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:42.018920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c78c4c-5504-45dc-b34e-92de8e676726 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:42.066874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:42.067569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:42.067858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:42.068023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:42.068710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:42.069016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:42.070466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:42.084570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 542/1069] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:42.090505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:42.113728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:42.221351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99082e-ae12-47a3-85e8-a0da9afb11bc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:42.265798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:42.266598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:42.267269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:42.267269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:42.276410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:42.281895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-bb136984-ad66-43fb-a229-a1ad11abea7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:42.292647 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:42.293597 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:42.294884 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 528/1070] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:42.303026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:42.358458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590dfe-11d0-44de-ba90-9c396edd772c None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:42.358962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590dfe-11d0-44de-ba90-9c396edd772c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:42.359447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590dfe-11d0-44de-ba90-9c396edd772c None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:42.363541 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 529/1071] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:42.368080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:42.368435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:42.368733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:42.390369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:42.391748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:42.505348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:42.517586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f61fed-c0c1-47bd-9352-4cf52520dd61 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:42.523884 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 530/1072] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:42.587062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:42.587745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:42.588030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:42.588294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:42.589115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:42.589423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:42.590996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:42.606718 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 543/1073] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:42.617217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:42.628183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:42.762366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc8237-261e-4a54-9761-fa480969fb7e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:42.828921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:42.829695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:42.830143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:42.830416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c9cf360f24634e1aa0edb2900994d9b7/roles/f2e8d1a460734d178d7fc910f3e2aedf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:42.833066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=c9cf360f24634e1aa0edb2900994d9b7, role_id=f2e8d1a460734d178d7fc910f3e2aedf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:42.834712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:42.903197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:42.917925 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 531/1074] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:30:42 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c9cf360f24634e1aa0edb2900994d9b7/roles/f2e8d1a460734d178d7fc910f3e2aedf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:43.044967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d62e0-d139-4db6-b3a0-6c4c0e5780f3 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:43.092956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:43.096380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.096380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.096380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.110920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:43.116912 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:43.118762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:43.120737 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 544/1075] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:43.126847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:43.244641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:43.287445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5394e6-194a-46c0-acb5-af8585d2a31a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:43.337237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:43.337765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.338064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.338338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.339014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:43.339370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:43.340699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:43.356301 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 532/1076] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:43.362418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:43.380916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:43.495180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5c443-df45-45d2-a146-ee97588e008c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:43.539427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cd30-139c-4742-b8bb-fd47ca00d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:43.540239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cd30-139c-4742-b8bb-fd47ca00d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.540663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cd30-139c-4742-b8bb-fd47ca00d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.541065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cd30-139c-4742-b8bb-fd47ca00d6c2 None admin] PATH_INFO: `/v3/users/b97ee27e34614309b8e2eb27632603ca` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.542629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cd30-139c-4742-b8bb-fd47ca00d6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=b97ee27e34614309b8e2eb27632603ca)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:43.544320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cd30-139c-4742-b8bb-fd47ca00d6c2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:43.546550 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 545/1077] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:43 2022] GET /identity/v3/users/b97ee27e34614309b8e2eb27632603ca => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:43.553070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:43.699143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e993-13ee-4cf0-909a-5e64b6102953 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:43.699765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314d6e-e768-4716-9eb6-ecd8694e1421 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.700055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314d6e-e768-4716-9eb6-ecd8694e1421 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.700340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314d6e-e768-4716-9eb6-ecd8694e1421 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.701918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 546/1078] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:43.707712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.707989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.708298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.729229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:43.730514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:43.746750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:43.756231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:43.756903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.757203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.757493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.763054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] RBAC: Authorizing `identity:get_project(project_id=611c461a75d24fb1b91c0e536ebbd3e2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:43.763054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:43.763054 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 533/1079] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:30:43 2022] GET /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2 => generated 311 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:43.771542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:43.838128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 547/1080] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:30:43.926294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d37ea-a9ea-48cd-91ec-093fa46d93ad None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:43.977072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:43.977747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:43.978065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:43.978402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2/users/b97ee27e34614309b8e2eb27632603ca/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:43.980403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] RBAC: Authorizing `identity:create_grant(project_id=611c461a75d24fb1b91c0e536ebbd3e2, user_id=b97ee27e34614309b8e2eb27632603ca, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:43.982088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.082728 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 534/1081] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:30:43 2022] PUT /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2/users/b97ee27e34614309b8e2eb27632603ca/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:30:44.124603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.151766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:44.316982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c4891-be24-4345-a8a6-8e530e5ad073 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.384956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.385574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.385870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.386147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.517151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.520084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.554646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:44.675758 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 548/1082] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:44.681993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.753749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:44.831698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff09c-c451-4235-a354-800b99301f56 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.876309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.876956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.877236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.877518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.890242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.891711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-98bb5a4c-4470-4323-8a64-5995150f962b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:44.908207 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:44.909264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:44.910228 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:44.910228 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:44.910228 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:44.914046 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 535/1083] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:44.916972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:45.053669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e951c-6092-4b00-a91d-538f213987a9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:45.072646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:45.098946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:45.099545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:45.099852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:45.100119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:45.100750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:45.101063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:45.103006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e1a7-27ba-40e4-a9de-272857a43fe5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:45.125901 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 549/1084] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:45.135312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b787780-e0ec-435e-a558-2cc07dc3b2c5 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:45.135751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b787780-e0ec-435e-a558-2cc07dc3b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:45.136082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b787780-e0ec-435e-a558-2cc07dc3b2c5 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:45.138334 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 536/1085] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:45.147410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:45.147895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:45.148797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:45.184811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:45.187035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:45.292669 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 550/1086] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:45.693814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b787780-e0ec-435e-a558-2cc07dc3b2c5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:45.822624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b787780-e0ec-435e-a558-2cc07dc3b2c5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:45.834096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:45.872775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:45.873876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:45.874517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:45.874983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:45.895691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:45.905461 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:45.906823 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 19:30:45.907964 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:45.908606 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 537/1087] 10.222.0.78 () {56 vars in 1120 bytes} [Sun Aug 28 19:30:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:45.914680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:46.035712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ff7df-4e26-4186-a89f-17574ab2e4cc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:46.038337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:46.096875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:46.097489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.097769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.098099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.098945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:46.099134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:46.100509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:46.116260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 551/1088] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:30:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:46.123149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:46.247244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f69a0-85e4-4092-855d-6c48a3ea93bb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:46.285136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:46.285559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.285912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.286131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.299522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:46.301032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8ded9d9a-8bd1-425e-9f2c-4a13d7c19050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:46.317353 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:46.318705 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:46.319586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:46.319586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:46.319586 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:46.319586 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 538/1089] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:46.325994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:46.336615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16efc2-8758-4f04-8b66-99d8cc40c935 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.337000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16efc2-8758-4f04-8b66-99d8cc40c935 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.337280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16efc2-8758-4f04-8b66-99d8cc40c935 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.338936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 539/1090] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:30:46.345698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.346208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.346699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.369230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:46.370519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:46.389995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:46.466371 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 540/1091] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:46.481591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055492c9-70de-417e-9bdf-d7e02b2a60a8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:46.538757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81318097-5234-4daf-953e-32878d37058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:46.541625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81318097-5234-4daf-953e-32878d37058d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.541625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81318097-5234-4daf-953e-32878d37058d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.541625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81318097-5234-4daf-953e-32878d37058d None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.541985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81318097-5234-4daf-953e-32878d37058d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:46.542545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81318097-5234-4daf-953e-32878d37058d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:46.545268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81318097-5234-4daf-953e-32878d37058d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:46.568741 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 552/1092] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:46.575367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:46.706707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a2a47-6a00-41bf-8ab1-2387857a7185 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:46.742086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81318097-5234-4daf-953e-32878d37058d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:46.748227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:46.748867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.749148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.749498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.759561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:46.761045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:46.777796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:30:46.778420 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:46.779868 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 19:30:46.782755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:46.784801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 541/1093] 10.222.0.78 () {56 vars in 1093 bytes} [Sun Aug 28 19:30:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:46.785571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:46.807336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:46.883181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81318097-5234-4daf-953e-32878d37058d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:46.923676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:46.924307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.924586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.924855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.937791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:30:46.942731 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:46.943765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:30:46.946963 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 553/1094] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:46.950935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5568-d5d4-4d05-8944-53add3cd6f3b None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:46.952511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.000592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.001212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.001494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.001760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.002539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:47.002848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.004607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.027207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 542/1095] 10.222.0.78 () {56 vars in 1133 bytes} [Sun Aug 28 19:30:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:47.034130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.078692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:47.108246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17231e7a-fdbc-4b99-82e2-1160e030c350 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:47.135473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:47.162535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.163422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.163869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.164301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.165423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:47.165923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.168498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.181974 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 554/1096] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:47.189397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.194112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70844e83-2176-4b67-a3a9-7744209ce0fb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:47.245367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.245843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.246156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.246432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.326833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.328682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.345381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1125-4657-4eab-8b82-b8e4062833e2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:47.397838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.399069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.399365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.399682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] PATH_INFO: `/v3/users/b97ee27e34614309b8e2eb27632603ca` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.400964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] RBAC: Authorizing `identity:get_user(user_id=b97ee27e34614309b8e2eb27632603ca)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.402506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.404179 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 555/1097] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/users/b97ee27e34614309b8e2eb27632603ca => generated 285 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:47.412632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.429164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:47.434327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:47.483690 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 543/1098] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 19:30:47.489906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.534682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b832a-eedb-49d5-abcc-dc9ee47d3adb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:47.578322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.579136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.579433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.579885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.629531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b070a8-f9e1-4090-abaf-5f2022bd480a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:47.670280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.670910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.671187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.671322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.671463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.674166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.683613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.685091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.703037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:30:47.703664 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:47.705932 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:30:47.707496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:30:47.707496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:30:47.707496 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:47.707496 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 544/1099] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:30:47.710867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.752242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:47.830377 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 556/1100] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:47.836822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.880799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf74cd-e332-4919-933a-83d5038260b2 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:47.923279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:47.924450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:47.924927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:47.925374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:47.926600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:47.927117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:47.928967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:47.949918 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 545/1101] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:47.953551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:47.976451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98390-be25-42ad-8d5f-ca6d369c3e5b None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:48.000880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:48.033119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:48.033984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:48.034266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:48.034547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:48.035872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] RBAC: Authorizing `identity:get_project(project_id=611c461a75d24fb1b91c0e536ebbd3e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:48.037479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:48.039910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 557/1102] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:48.047035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:48.080466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:48.102765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea72012-de47-42ad-b3ab-3268e55f5cac None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:48.153060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:48.153949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:48.154443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:48.154796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:48.166012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:48.167906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:30:48.182521 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:30:48.184562 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:30:48.186668 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:30:48.190282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 546/1103] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:30:48.193042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:48.199788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847564d-4aea-40fd-8bac-0d830dfd5baa None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:48.259941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:48.260871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:48.261312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:48.261749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:48.262709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2, user.id=b97ee27e34614309b8e2eb27632603ca) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:48.263212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:48.265740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:48.289885 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 558/1104] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:48 2022] GET /identity/v3/role_assignments?user.id=b97ee27e34614309b8e2eb27632603ca&scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:48.351085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1327-c4b9-4fb6-8802-bc75bf900053 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:48.401066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:48.402163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:48.402661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:48.403189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:48.404596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:48.405148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:48.408004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868fdda-f08e-4602-b566-e99f0f2fed1a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:48.421517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:48.425897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 547/1105] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:30:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:48.433041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:48.489225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:48.584362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f231b-aa86-4f02-ab54-139425a7ea6c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:48.656521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:48.657406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:48.657909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:48.658386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:48.659733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] RBAC: Adding query filter params (role.id=f2e8d1a460734d178d7fc910f3e2aedf, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c9cf360f24634e1aa0edb2900994d9b7) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:48.660271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:48.663074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e51d87-5029-4b9b-a7fb-2a6b594a65d0 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:48.685897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 559/1106] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:48 2022] GET /identity/v3/role_assignments?user.id=c9cf360f24634e1aa0edb2900994d9b7&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=f2e8d1a460734d178d7fc910f3e2aedf => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:30:50.423704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce781e-6738-42a0-a435-66b7c02d00ac None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:50.424468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce781e-6738-42a0-a435-66b7c02d00ac None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:50.424468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce781e-6738-42a0-a435-66b7c02d00ac None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:50.425603 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 548/1107] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:50.431473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:50.431974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:50.432123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:50.451489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:50.452695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:50.529433 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 560/1108] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:50.806850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce781e-6738-42a0-a435-66b7c02d00ac None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:50.944065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce781e-6738-42a0-a435-66b7c02d00ac None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:50.985045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec737477-2dc3-4203-8cec-b380edbac90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:50.985690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec737477-2dc3-4203-8cec-b380edbac90e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:50.986004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec737477-2dc3-4203-8cec-b380edbac90e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:50.986275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec737477-2dc3-4203-8cec-b380edbac90e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:50.987517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec737477-2dc3-4203-8cec-b380edbac90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:50.988983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec737477-2dc3-4203-8cec-b380edbac90e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:50.990717 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 549/1109] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:30:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:50.998004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:51.046713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:51.114988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d592e9-c004-4eb7-8094-24666580f670 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:51.158045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f9f2f-3b15-4fc8-a50b-c6563e97a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:51.158656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f9f2f-3b15-4fc8-a50b-c6563e97a3f2 None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:51.158930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f9f2f-3b15-4fc8-a50b-c6563e97a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:51.159496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f9f2f-3b15-4fc8-a50b-c6563e97a3f2 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:51.160168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f9f2f-3b15-4fc8-a50b-c6563e97a3f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:51.161599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f9f2f-3b15-4fc8-a50b-c6563e97a3f2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:51.378141 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 561/1110] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:30:50 2022] POST /identity/v3/users => generated 286 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:30:53.418855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743dbc-609c-44c4-af10-47374c9b0a45 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:53.419633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743dbc-609c-44c4-af10-47374c9b0a45 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:53.419633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743dbc-609c-44c4-af10-47374c9b0a45 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:53.420792 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 550/1111] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:53.428490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:53.429968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:53.430126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:53.461162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:53.463357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:53.589761 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 562/1112] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:53.867380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743dbc-609c-44c4-af10-47374c9b0a45 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:53.944103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:53.987453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743dbc-609c-44c4-af10-47374c9b0a45 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:54.031601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:54.032534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:54.032943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:54.033416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] PATH_INFO: `/v3/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:54.035678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] RBAC: Authorizing `identity:get_role(role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:54.037687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:54.040535 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 551/1113] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:53 2022] GET /identity/v3/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:54.046818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:54.076921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:54.154439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1db26-8bac-4e6b-852a-fa2d1c3863c7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:54.193956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:54.194692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:54.195013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:54.195333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] PATH_INFO: `/v3/users/b6f8ed93574e4b9ab9cccfc60db3cbc8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:54.211822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f8ed93574e4b9ab9cccfc60db3cbc8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:54.213295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:54.215089 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 563/1114] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:54 2022] GET /identity/v3/users/b6f8ed93574e4b9ab9cccfc60db3cbc8 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:54.221430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:54.347122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb18d76-b2cc-4780-a548-450d2aabc241 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:54.393556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:54.394326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:54.394648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:54.394962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:54.400671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:54.472147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:54.473534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:54.592283 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 552/1115] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:30:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:30:54.602411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:54.698989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:54.716540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf50be-15e7-474c-9429-6d75076b9a23 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:54.756521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28141e6-2640-418b-9601-7fd79103eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:54.757579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28141e6-2640-418b-9601-7fd79103eb5c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:54.757885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28141e6-2640-418b-9601-7fd79103eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:54.758160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28141e6-2640-418b-9601-7fd79103eb5c None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:54.759349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28141e6-2640-418b-9601-7fd79103eb5c None admin] RBAC: Authorizing `identity:get_project(project_id=611c461a75d24fb1b91c0e536ebbd3e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:54.760775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28141e6-2640-418b-9601-7fd79103eb5c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:54.762574 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 564/1116] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:30:54 2022] GET /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:54.770392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:54.820427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:54.894676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489e12-d0ea-4c4b-9219-b1f3cfa1b4ea None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:54.931460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:54.932063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:54.932342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:54.932613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:54.933344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] RBAC: Adding query filter params (role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2, user.id=b6f8ed93574e4b9ab9cccfc60db3cbc8) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:54.933655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:54.935145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b30a10-b0a8-4511-9ea3-725cbd2fadf0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:54.941272 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 553/1117] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:30:54 2022] GET /identity/v3/role_assignments?user.id=b6f8ed93574e4b9ab9cccfc60db3cbc8&scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:56.886656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885836b0-d372-4354-bfc9-0d4cd7055a5c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:56.887188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885836b0-d372-4354-bfc9-0d4cd7055a5c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:56.887188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885836b0-d372-4354-bfc9-0d4cd7055a5c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:56.888554 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 565/1118] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:30:56.894402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:56.894929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:56.894929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:56.913613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:56.914859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:56.993505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 554/1119] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:30:57.266835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885836b0-d372-4354-bfc9-0d4cd7055a5c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:57.387105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885836b0-d372-4354-bfc9-0d4cd7055a5c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:57.426299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:57.426934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:57.427236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:57.427536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] PATH_INFO: `/v3/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:57.428962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] RBAC: Authorizing `identity:get_role(role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:57.430406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:57.431753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 566/1120] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:57 2022] GET /identity/v3/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:57.437605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:57.467803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:57.544605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3e778-f9f1-4d12-9410-977c0d7efb6c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:57.579496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:57.580130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:57.580412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:57.580682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] PATH_INFO: `/v3/users/b6f8ed93574e4b9ab9cccfc60db3cbc8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:57.581873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f8ed93574e4b9ab9cccfc60db3cbc8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:57.583312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:57.585657 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 555/1121] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:30:57 2022] GET /identity/v3/users/b6f8ed93574e4b9ab9cccfc60db3cbc8 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:57.591415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:57.614937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:57.693921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c750e-ea2c-46b1-8975-7035c29fe9b1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:57.729061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92097f2e-ed0c-4664-a5a8-5abf8ccba3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:57.729755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92097f2e-ed0c-4664-a5a8-5abf8ccba3f8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:57.730063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92097f2e-ed0c-4664-a5a8-5abf8ccba3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:57.730342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92097f2e-ed0c-4664-a5a8-5abf8ccba3f8 None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:57.731480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92097f2e-ed0c-4664-a5a8-5abf8ccba3f8 None admin] RBAC: Authorizing `identity:get_project(project_id=611c461a75d24fb1b91c0e536ebbd3e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:57.732907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92097f2e-ed0c-4664-a5a8-5abf8ccba3f8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:57.734606 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 567/1122] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:30:57 2022] GET /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:57.740888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:57.855831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:57.860066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86390f2-b10d-4791-b9d7-8eb11d2e9bf7 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:57.903446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d9eae-1874-4ed5-868a-52cee87adf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:57.905220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d9eae-1874-4ed5-868a-52cee87adf4d None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:57.905507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d9eae-1874-4ed5-868a-52cee87adf4d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:57.905786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d9eae-1874-4ed5-868a-52cee87adf4d None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2/users/b6f8ed93574e4b9ab9cccfc60db3cbc8/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:57.908299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d9eae-1874-4ed5-868a-52cee87adf4d None admin] RBAC: Authorizing `identity:create_grant(project_id=611c461a75d24fb1b91c0e536ebbd3e2, user_id=b6f8ed93574e4b9ab9cccfc60db3cbc8, role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:57.909772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d9eae-1874-4ed5-868a-52cee87adf4d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:58.009537 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 556/1123] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:30:57 2022] PUT /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2/users/b6f8ed93574e4b9ab9cccfc60db3cbc8/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:59.991521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a360b-87df-44a2-ba72-ca28f39ec344 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:59.993709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a360b-87df-44a2-ba72-ca28f39ec344 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:59.994040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a360b-87df-44a2-ba72-ca28f39ec344 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:59.996049 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 568/1124] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:30:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:00.001749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:00.002280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:00.002386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:00.021161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:00.022445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:00.098046 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 557/1125] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:00.372244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a360b-87df-44a2-ba72-ca28f39ec344 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:00.480133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:00.493168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a360b-87df-44a2-ba72-ca28f39ec344 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:00.535347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:00.535978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:00.536257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:00.536528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] PATH_INFO: `/v3/roles/949117e2e28f4d60a8ffcaf82643f7b5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:00.539060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] RBAC: Authorizing `identity:get_role(role_id=949117e2e28f4d60a8ffcaf82643f7b5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:00.540420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:00.541751 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 569/1126] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:00 2022] GET /identity/v3/roles/949117e2e28f4d60a8ffcaf82643f7b5 => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:00.547682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:00.675982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:00.695692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181910b-533c-4dc3-a8cc-8d765fcc0f25 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:00.750608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:00.751667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:00.752161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:00.752648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] PATH_INFO: `/v3/users/b6f8ed93574e4b9ab9cccfc60db3cbc8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:00.755106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] RBAC: Authorizing `identity:get_user(user_id=b6f8ed93574e4b9ab9cccfc60db3cbc8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:00.758288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:00.760004 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 558/1127] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:00 2022] GET /identity/v3/users/b6f8ed93574e4b9ab9cccfc60db3cbc8 => generated 286 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:00.766388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:00.890126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52099d-27c3-4d1e-9eb1-15a8a1e7e73a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:00.930259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:00.930796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:00.931078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:00.931349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:00.961154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:01.016004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:01.017583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:01.137869 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 570/1128] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:31:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:31:01.144913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:01.293562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42a26-6f24-44d2-a0bc-82f6a961c8bb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:01.334351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e023-6219-48d2-abae-6b0dfa63040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:01.335542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e023-6219-48d2-abae-6b0dfa63040e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:01.335817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e023-6219-48d2-abae-6b0dfa63040e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:01.336086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e023-6219-48d2-abae-6b0dfa63040e None admin] PATH_INFO: `/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:01.337333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e023-6219-48d2-abae-6b0dfa63040e None admin] RBAC: Authorizing `identity:get_project(project_id=611c461a75d24fb1b91c0e536ebbd3e2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:01.338848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e023-6219-48d2-abae-6b0dfa63040e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:01.340527 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 559/1129] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:01 2022] GET /identity/v3/projects/611c461a75d24fb1b91c0e536ebbd3e2 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:01.347204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:01.428119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:01.493969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca0233-78ce-4b3d-8ac1-d413c01ed28f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:01.537560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:01.538296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:01.538624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:01.538945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:01.539745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] RBAC: Adding query filter params (role.id=949117e2e28f4d60a8ffcaf82643f7b5, scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2, user.id=b6f8ed93574e4b9ab9cccfc60db3cbc8) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:01.540092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:01.541608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f19bdd-2d74-48bf-af36-f69a6be94c1b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:01.548499 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 571/1130] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:31:01 2022] GET /identity/v3/role_assignments?user.id=b6f8ed93574e4b9ab9cccfc60db3cbc8&scope.project.id=611c461a75d24fb1b91c0e536ebbd3e2&role.id=949117e2e28f4d60a8ffcaf82643f7b5 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:31:03.572832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577184a5-e67e-4780-a5b6-8d508bbbe1ff None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:03.573610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577184a5-e67e-4780-a5b6-8d508bbbe1ff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:03.573610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577184a5-e67e-4780-a5b6-8d508bbbe1ff None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:03.574853 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 560/1131] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:03.581115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:03.581629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:03.581739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:03.603287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:03.604586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:03.684411 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 572/1132] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:03.989251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577184a5-e67e-4780-a5b6-8d508bbbe1ff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:04.024711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:04.122253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577184a5-e67e-4780-a5b6-8d508bbbe1ff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:04.161814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7e71-e0da-4964-ae5e-5811759bcc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:04.162484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7e71-e0da-4964-ae5e-5811759bcc91 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:04.162926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7e71-e0da-4964-ae5e-5811759bcc91 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:04.163205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7e71-e0da-4964-ae5e-5811759bcc91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:04.164453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7e71-e0da-4964-ae5e-5811759bcc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:04.165950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7e71-e0da-4964-ae5e-5811759bcc91 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:04.167674 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 561/1133] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:31:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:04.174074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:04.232560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:04.297323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0872941-67bc-45d5-9c8a-5f0ebf4214bd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:04.335835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafe9a3-9f48-4cb5-b5b2-dfeea71ec7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:04.336418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe9a3-9f48-4cb5-b5b2-dfeea71ec7ee None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:04.336701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe9a3-9f48-4cb5-b5b2-dfeea71ec7ee None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:04.337002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe9a3-9f48-4cb5-b5b2-dfeea71ec7ee None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:04.337663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafe9a3-9f48-4cb5-b5b2-dfeea71ec7ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:04.339130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafe9a3-9f48-4cb5-b5b2-dfeea71ec7ee None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:04.443910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 573/1134] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:31:04 2022] POST /identity/v3/projects => generated 311 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:31:06.389515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45e23-743c-4c9d-b2df-5b549f2ce2b5 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:06.390119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45e23-743c-4c9d-b2df-5b549f2ce2b5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:06.390119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45e23-743c-4c9d-b2df-5b549f2ce2b5 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:06.391462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 562/1135] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:06.398214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:06.398779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:06.398779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:06.417930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:06.419262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:06.489588 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 574/1136] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:06.762088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a45e23-743c-4c9d-b2df-5b549f2ce2b5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:06.855242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:06.867106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a45e23-743c-4c9d-b2df-5b549f2ce2b5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:06.902647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df036-7802-47cb-8e7d-748b39c277e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:06.903278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df036-7802-47cb-8e7d-748b39c277e8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:06.903556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df036-7802-47cb-8e7d-748b39c277e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:06.903830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df036-7802-47cb-8e7d-748b39c277e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:06.904969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df036-7802-47cb-8e7d-748b39c277e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:06.906449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df036-7802-47cb-8e7d-748b39c277e8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:06.908034 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 563/1137] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:31:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:06.915423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:06.946216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:07.016434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e792-e0ff-40ba-95b0-7ff93aa9c636 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:07.050228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5bdfa-d2f8-4ffe-85ae-d90e7184c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:07.050781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5bdfa-d2f8-4ffe-85ae-d90e7184c39d None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:07.051063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5bdfa-d2f8-4ffe-85ae-d90e7184c39d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:07.051335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5bdfa-d2f8-4ffe-85ae-d90e7184c39d None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:07.051997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5bdfa-d2f8-4ffe-85ae-d90e7184c39d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:07.054047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5bdfa-d2f8-4ffe-85ae-d90e7184c39d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:07.174493 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 575/1138] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:31:06 2022] POST /identity/v3/users => generated 286 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:31:09.164690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81fd9d-6d7e-4e8c-9242-da387b7cc9c6 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:09.165338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81fd9d-6d7e-4e8c-9242-da387b7cc9c6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:09.165338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81fd9d-6d7e-4e8c-9242-da387b7cc9c6 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:09.166737 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 564/1139] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:09.172259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:09.172767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:09.172901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:09.192723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:09.194071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:09.267723 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 576/1140] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:09.538220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81fd9d-6d7e-4e8c-9242-da387b7cc9c6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:09.641396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81fd9d-6d7e-4e8c-9242-da387b7cc9c6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:09.676073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:09.676709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:09.676992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:09.677267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:09.688276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:31:09.693072 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:09.694820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:31:09.695727 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 565/1141] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:09.701064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:09.719272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:09.802709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c252-a13a-436e-a81b-da9d468fed1c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:09.837584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:09.838218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:09.838500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:09.838773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:09.839442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:09.839749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:09.841116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:09.849252 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 577/1142] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:31:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:09.855720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:09.879088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:09.959500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21adf74-8b56-4f94-b751-5b043ad778ab None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:09.995874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:09.996535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:09.996776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:09.997049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] PATH_INFO: `/v3/users/064cbbaf0b7a4dc88c08ab5735950bcd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:10.010960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] RBAC: Authorizing `identity:get_user(user_id=064cbbaf0b7a4dc88c08ab5735950bcd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:10.012399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:10.014074 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 566/1143] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:09 2022] GET /identity/v3/users/064cbbaf0b7a4dc88c08ab5735950bcd => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:10.020124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:10.119739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:10.141111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992256f8-c323-421c-b1e1-44eeb4f0994e None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:10.177203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:10.178005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:10.178109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:10.178863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:10.249265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:10.250717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:10.331523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:10.354091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 578/1144] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:31:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:31:10.359618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:10.439414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:10.460362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28bbaf-5690-4ce4-aa9b-4ae59ef4f1eb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:10.494621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4497894-9d7d-4724-a7ea-df8cba9f8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:10.495237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4497894-9d7d-4724-a7ea-df8cba9f8e74 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:10.495517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4497894-9d7d-4724-a7ea-df8cba9f8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:10.495789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4497894-9d7d-4724-a7ea-df8cba9f8e74 None admin] PATH_INFO: `/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:10.496904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4497894-9d7d-4724-a7ea-df8cba9f8e74 None admin] RBAC: Authorizing `identity:get_project(project_id=4d7b529b6a75435ab6aa15fcc537ee3e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:10.498367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4497894-9d7d-4724-a7ea-df8cba9f8e74 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:10.499998 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 567/1145] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:10 2022] GET /identity/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:10.507140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:10.604128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72725241-b8a7-4af1-860f-bfe19c388421 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:10.637918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:10.638513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:10.638793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:10.639068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:10.639821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=4d7b529b6a75435ab6aa15fcc537ee3e, user.id=064cbbaf0b7a4dc88c08ab5735950bcd) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:10.640144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:10.641516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db354618-9727-4242-bf04-22985aa098c4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:10.647570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 579/1146] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:31:10 2022] GET /identity/v3/role_assignments?user.id=064cbbaf0b7a4dc88c08ab5735950bcd&scope.project.id=4d7b529b6a75435ab6aa15fcc537ee3e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:12.518943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840e93-e959-420e-bd20-2722b0c94603 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:12.519456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840e93-e959-420e-bd20-2722b0c94603 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:12.519570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840e93-e959-420e-bd20-2722b0c94603 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:12.520853 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 568/1147] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:12.526377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569e9f-335f-4669-a663-d66d19271970 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:12.526799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569e9f-335f-4669-a663-d66d19271970 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:12.526931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569e9f-335f-4669-a663-d66d19271970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:12.544759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-41569e9f-335f-4669-a663-d66d19271970 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:12.545989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-41569e9f-335f-4669-a663-d66d19271970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:12.587355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:12.614654 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 580/1148] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:12.890072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3840e93-e959-420e-bd20-2722b0c94603 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:12.992030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3840e93-e959-420e-bd20-2722b0c94603 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:13.027594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:13.028222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:13.028505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:13.028781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:13.039176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:31:13.043989 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:13.045130 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:31:13.046199 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 569/1149] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:13.051544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569e9f-335f-4669-a663-d66d19271970 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:13.154123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569e9f-335f-4669-a663-d66d19271970 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:13.188519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:13.189131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:13.189412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:13.189685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:13.190383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:13.190687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:13.192066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:13.201310 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 581/1150] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:13.207360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:13.217977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:13.310752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cca12e-b6ca-417d-90ad-1eee7072f9e0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:13.345481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:13.346124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:13.346405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:13.346677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] PATH_INFO: `/v3/users/064cbbaf0b7a4dc88c08ab5735950bcd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:13.347807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] RBAC: Authorizing `identity:get_user(user_id=064cbbaf0b7a4dc88c08ab5735950bcd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:13.349272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:13.350943 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 570/1151] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:13 2022] GET /identity/v3/users/064cbbaf0b7a4dc88c08ab5735950bcd => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:13.357885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:13.394253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:13.459696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940bbf4-448d-413d-9a56-dba91ece2734 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:13.492514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb13f-de67-4161-8298-036534e85e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:13.493129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb13f-de67-4161-8298-036534e85e93 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:13.493411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb13f-de67-4161-8298-036534e85e93 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:13.493683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb13f-de67-4161-8298-036534e85e93 None admin] PATH_INFO: `/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:13.494846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb13f-de67-4161-8298-036534e85e93 None admin] RBAC: Authorizing `identity:get_project(project_id=4d7b529b6a75435ab6aa15fcc537ee3e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:13.496276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb13f-de67-4161-8298-036534e85e93 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:13.497937 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 582/1152] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:13 2022] GET /identity/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:13.504370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:13.580669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:13.606592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190ee8-ac12-4de5-a528-3c1a937597d3 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:13.643763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecdb64-c98b-4a70-91cb-841b2ad7efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:13.644410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecdb64-c98b-4a70-91cb-841b2ad7efcb None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:13.644686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecdb64-c98b-4a70-91cb-841b2ad7efcb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:13.644954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecdb64-c98b-4a70-91cb-841b2ad7efcb None admin] PATH_INFO: `/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e/users/064cbbaf0b7a4dc88c08ab5735950bcd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:13.647059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecdb64-c98b-4a70-91cb-841b2ad7efcb None admin] RBAC: Authorizing `identity:create_grant(project_id=4d7b529b6a75435ab6aa15fcc537ee3e, user_id=064cbbaf0b7a4dc88c08ab5735950bcd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:13.648480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecdb64-c98b-4a70-91cb-841b2ad7efcb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:13.757327 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 571/1153] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:31:13 2022] PUT /identity/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e/users/064cbbaf0b7a4dc88c08ab5735950bcd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:31:15.638715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18544-2b57-4b34-ab36-e6c3a5b6d1e4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:15.639222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18544-2b57-4b34-ab36-e6c3a5b6d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:15.639222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18544-2b57-4b34-ab36-e6c3a5b6d1e4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:15.640511 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 583/1154] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:15.645980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:15.646407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:15.646524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:15.666396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:15.667647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:15.742453 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 572/1155] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:16.015714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18544-2b57-4b34-ab36-e6c3a5b6d1e4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:16.122623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18544-2b57-4b34-ab36-e6c3a5b6d1e4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:16.124971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:16.157923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:16.158563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:16.158835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:16.159108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:16.170520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:31:16.176751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:16.184041 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:31:16.185056 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 584/1156] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:16.185943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:16.249455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:16.287588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb0a3e-10d3-405d-b87e-8cc8e064bc1e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:16.326408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:16.327024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:16.327302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:16.327573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:16.328247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:16.328549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:16.329941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:16.340466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 573/1157] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:16.347026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:16.466638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5a64-e2b8-4268-8f9f-2c22d8bad4fe None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:16.503513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:16.504140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:16.504416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:16.504687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] PATH_INFO: `/v3/users/064cbbaf0b7a4dc88c08ab5735950bcd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:16.505879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] RBAC: Authorizing `identity:get_user(user_id=064cbbaf0b7a4dc88c08ab5735950bcd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:16.507864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:16.509474 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 585/1158] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:16 2022] GET /identity/v3/users/064cbbaf0b7a4dc88c08ab5735950bcd => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:16.515776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:16.626571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1999146-2f01-48b9-8726-6620a10319f5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:16.653790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:16.662995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:16.663613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:16.663887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:16.664160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:16.735001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:16.736471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:16.844372 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 574/1159] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:31:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 19:31:16.850991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:16.889869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:16.966831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a868cb-13c8-4364-9acf-e3cb61416f2c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:17.004081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948afbf4-41d5-408c-908d-f702d1c9bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:17.004701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afbf4-41d5-408c-908d-f702d1c9bed5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:17.004978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afbf4-41d5-408c-908d-f702d1c9bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:17.005246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afbf4-41d5-408c-908d-f702d1c9bed5 None admin] PATH_INFO: `/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:17.007123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948afbf4-41d5-408c-908d-f702d1c9bed5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d7b529b6a75435ab6aa15fcc537ee3e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:17.008521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948afbf4-41d5-408c-908d-f702d1c9bed5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:17.010191 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 586/1160] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:16 2022] GET /identity/v3/projects/4d7b529b6a75435ab6aa15fcc537ee3e => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:17.016535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:17.043204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:17.117803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895a28-732f-47c3-a1ca-ea8002ccbff5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:17.153704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:17.154272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:17.154530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:17.154829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:17.155557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=4d7b529b6a75435ab6aa15fcc537ee3e, user.id=064cbbaf0b7a4dc88c08ab5735950bcd) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:17.155867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:17.157300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53151952-0168-42f3-8c8e-04d35e4e01fb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:17.163416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 575/1161] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:31:17 2022] GET /identity/v3/role_assignments?user.id=064cbbaf0b7a4dc88c08ab5735950bcd&scope.project.id=4d7b529b6a75435ab6aa15fcc537ee3e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:31:19.089232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd814-064d-4a72-a45a-9aa22bb0e007 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:19.089787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd814-064d-4a72-a45a-9aa22bb0e007 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:19.089787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd814-064d-4a72-a45a-9aa22bb0e007 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:19.091126 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 587/1162] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:19.096373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:19.096832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:19.096962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:19.116665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:19.117889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:19.188189 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 576/1163] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:19.457554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd814-064d-4a72-a45a-9aa22bb0e007 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:19.558529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:19.562515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd814-064d-4a72-a45a-9aa22bb0e007 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:19.598717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:19.599332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:19.599609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:19.599880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:19.669950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:19.671342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:19.768197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:19.771896 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 588/1164] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:31:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:31:19.778418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:19.799676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:19.882483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a06b-479d-43fb-91a5-ae77c71a04ea None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:19.918692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:19.919327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:19.919608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:19.919860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:19.927283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:19.929167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-04e8bfca-aa8b-4ea8-a6fd-1f6195760d7e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:19.942284 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:19.943542 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:31:19.944554 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 577/1165] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:31:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:19.950802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:20.078108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5490f-62df-4ba1-80bd-a7e27ff9609d None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:20.115495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:20.116179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:20.116380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:20.116653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:20.117302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:20.117610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:20.118996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7c826-8219-4bc0-8267-1a842853d3e1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:20.126331 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 589/1166] 10.222.0.78 () {56 vars in 1115 bytes} [Sun Aug 28 19:31:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:31:22.074341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c273df6-80fa-4d06-ae4e-7a7584ff644d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:22.074896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c273df6-80fa-4d06-ae4e-7a7584ff644d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:22.074896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c273df6-80fa-4d06-ae4e-7a7584ff644d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:22.076226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 578/1167] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:22.081679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e147d-e71d-47a5-b9a6-7b10039aaf6f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:22.082150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e147d-e71d-47a5-b9a6-7b10039aaf6f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:22.082239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e147d-e71d-47a5-b9a6-7b10039aaf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:22.101675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-657e147d-e71d-47a5-b9a6-7b10039aaf6f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:22.102960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-657e147d-e71d-47a5-b9a6-7b10039aaf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:22.164649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:22.174159 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 590/1168] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:31:22.455399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c273df6-80fa-4d06-ae4e-7a7584ff644d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:22.542074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:22.563070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c273df6-80fa-4d06-ae4e-7a7584ff644d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:22.598568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b6e7-11ce-498c-a669-2cc20274eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:22.599177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b6e7-11ce-498c-a669-2cc20274eda3 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:22.599454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b6e7-11ce-498c-a669-2cc20274eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:22.599721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b6e7-11ce-498c-a669-2cc20274eda3 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:22.600937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73b6e7-11ce-498c-a669-2cc20274eda3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:22.602332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73b6e7-11ce-498c-a669-2cc20274eda3 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:22.718629 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 579/1169] 10.222.0.78 () {60 vars in 1138 bytes} [Sun Aug 28 19:31:22 2022] POST /identity/v3/domains => generated 267 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:31:24.642547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a808-15ef-42ea-bacb-b2ffd6482841 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:24.643123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a808-15ef-42ea-bacb-b2ffd6482841 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:24.643123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a808-15ef-42ea-bacb-b2ffd6482841 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:24.644358 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 591/1170] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:24.650373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:24.650822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:24.650929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:24.669447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:24.670685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:24.738937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 580/1171] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:25.009596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218a808-15ef-42ea-bacb-b2ffd6482841 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:25.110060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218a808-15ef-42ea-bacb-b2ffd6482841 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:25.144757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3522d-6abe-4e4d-8e5e-12218cfa11e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:25.145376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3522d-6abe-4e4d-8e5e-12218cfa11e6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:25.145650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3522d-6abe-4e4d-8e5e-12218cfa11e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:25.145950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3522d-6abe-4e4d-8e5e-12218cfa11e6 None admin] PATH_INFO: `/v3/domains/bec4c3954ba44cada1755ca71b6af7b2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:25.156881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3522d-6abe-4e4d-8e5e-12218cfa11e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bec4c3954ba44cada1755ca71b6af7b2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:25.158352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3522d-6abe-4e4d-8e5e-12218cfa11e6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:25.159989 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 592/1172] 10.222.0.78 () {56 vars in 1183 bytes} [Sun Aug 28 19:31:25 2022] GET /identity/v3/domains/bec4c3954ba44cada1755ca71b6af7b2 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:25.166727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:25.236288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:25.266895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275297-31fd-4aaa-8245-bf73cda9d683 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:25.302056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a4832-3655-4b6d-baaf-b0652e82d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:25.302656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a4832-3655-4b6d-baaf-b0652e82d152 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:25.302993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a4832-3655-4b6d-baaf-b0652e82d152 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:25.303320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a4832-3655-4b6d-baaf-b0652e82d152 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:25.304184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a4832-3655-4b6d-baaf-b0652e82d152 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:25.306368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a4832-3655-4b6d-baaf-b0652e82d152 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:25.421832 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 581/1173] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:31:25 2022] POST /identity/v3/projects => generated 361 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:31:27.376066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be10263-13bd-4148-80e7-7cf866efe231 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:27.376586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be10263-13bd-4148-80e7-7cf866efe231 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:27.376586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be10263-13bd-4148-80e7-7cf866efe231 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:27.378247 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 593/1174] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:27.383507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:27.384021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:27.384131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:27.403855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:27.405047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:27.472345 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 582/1175] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:27.737348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be10263-13bd-4148-80e7-7cf866efe231 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:27.793562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:27.841192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be10263-13bd-4148-80e7-7cf866efe231 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:27.874962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973528-ff98-47dd-8c2b-03410075cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:27.875587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973528-ff98-47dd-8c2b-03410075cf34 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:27.875866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973528-ff98-47dd-8c2b-03410075cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:27.876138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973528-ff98-47dd-8c2b-03410075cf34 None admin] PATH_INFO: `/v3/domains/bec4c3954ba44cada1755ca71b6af7b2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:27.877270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1973528-ff98-47dd-8c2b-03410075cf34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bec4c3954ba44cada1755ca71b6af7b2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:27.878978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1973528-ff98-47dd-8c2b-03410075cf34 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:27.880563 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 594/1176] 10.222.0.78 () {56 vars in 1183 bytes} [Sun Aug 28 19:31:27 2022] GET /identity/v3/domains/bec4c3954ba44cada1755ca71b6af7b2 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:27.887043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:27.938963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:27.986080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fbf9-9b76-4734-90b1-7897db60a6ff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:28.021127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556612ed-18eb-4e1a-8230-1abe6a4832a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:28.022305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556612ed-18eb-4e1a-8230-1abe6a4832a6 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:28.022591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556612ed-18eb-4e1a-8230-1abe6a4832a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:28.022858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556612ed-18eb-4e1a-8230-1abe6a4832a6 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:28.023634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556612ed-18eb-4e1a-8230-1abe6a4832a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:28.025678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556612ed-18eb-4e1a-8230-1abe6a4832a6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:28.125417 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 583/1177] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:31:27 2022] POST /identity/v3/users => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:31:30.084900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356358-59a3-45f8-904f-532563164d32 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:30.085454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356358-59a3-45f8-904f-532563164d32 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:30.085454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356358-59a3-45f8-904f-532563164d32 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:30.086840 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 595/1178] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:30.092286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:30.092727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:30.092826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:30.111366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:30.112553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:30.181123 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 584/1179] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:30.451072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356358-59a3-45f8-904f-532563164d32 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:30.553611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356358-59a3-45f8-904f-532563164d32 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:30.576106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:30.587316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:30.592277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:30.592277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:30.592277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:30.599303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:31:30.604243 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:30.605386 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:31:30.606659 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 596/1180] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:31:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:30.611563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:30.652669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:30.714390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f815c4-10b7-419d-9bbe-3bf69105d848 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:30.748720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:30.749321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:30.749594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:30.749885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:30.750544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:30.750850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:30.752209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:30.761409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 585/1181] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:30.767280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:30.868119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e4e0-c025-40ce-bf60-8c2f0c25fa8c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:30.902824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:30.903444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:30.903723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:30.903996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] PATH_INFO: `/v3/users/96cb8a56cf524ebe99024c488809d64e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:30.917160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] RBAC: Authorizing `identity:get_user(user_id=96cb8a56cf524ebe99024c488809d64e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:30.918623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:30.920269 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 597/1182] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:30 2022] GET /identity/v3/users/96cb8a56cf524ebe99024c488809d64e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:30.926330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:31.030678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:31.033581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a82fa-460a-4d12-ae18-26b588b9de68 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:31.069062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:31.069729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:31.069973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:31.070250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:31.145143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:31.147104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:31.243295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:31.247057 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 586/1183] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:31:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:31:31.253536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:31.295979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:31.354045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853bb42-39c3-4afc-96db-08bc71bd5ccb None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:31.392641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01aec9-2fa9-4d8b-aaef-cd4f42c74bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:31.393288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01aec9-2fa9-4d8b-aaef-cd4f42c74bc2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:31.393572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01aec9-2fa9-4d8b-aaef-cd4f42c74bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:31.393875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01aec9-2fa9-4d8b-aaef-cd4f42c74bc2 None admin] PATH_INFO: `/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:31.395124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01aec9-2fa9-4d8b-aaef-cd4f42c74bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=15e8e37a4b8b4db3a8a405fd1cd2a55c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:31.397137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01aec9-2fa9-4d8b-aaef-cd4f42c74bc2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:31.398792 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 598/1184] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:31 2022] GET /identity/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:31.404957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:31.509287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc00f30-a0f9-4ee5-8c68-17e8c927111e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:31.543531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:31.544123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:31.544403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:31.544675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:31.545395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=15e8e37a4b8b4db3a8a405fd1cd2a55c, user.id=96cb8a56cf524ebe99024c488809d64e) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:31.545707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:31.547164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b39fc-1d86-42d5-9c98-ef168bf8a147 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:31.552609 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 587/1185] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:31:31 2022] GET /identity/v3/role_assignments?user.id=96cb8a56cf524ebe99024c488809d64e&scope.project.id=15e8e37a4b8b4db3a8a405fd1cd2a55c&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:33.461770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7357fc-cb06-4f39-8891-2dfafebb6e43 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:33.462349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7357fc-cb06-4f39-8891-2dfafebb6e43 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:33.462349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7357fc-cb06-4f39-8891-2dfafebb6e43 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:33.463700 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 599/1186] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:33.468857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:33.469291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:33.469390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:33.487334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:33.488518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:33.548771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:33.556796 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 588/1187] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:33.838467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7357fc-cb06-4f39-8891-2dfafebb6e43 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:33.940071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7357fc-cb06-4f39-8891-2dfafebb6e43 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:33.949830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:33.974524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:33.975319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:33.975500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:33.976056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:33.986645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:31:33.991509 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:33.992640 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:31:33.993655 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 600/1188] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:31:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:33.998825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:34.099719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3644-8efe-44fa-bbd2-39dd99ce6974 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:34.134895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:34.135496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:34.135778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:34.136050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:34.136708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:34.137016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:34.138422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:34.147337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 589/1189] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:34.153270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:34.254967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ecca8-7e93-4254-8165-aa2f86252f3f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:34.289978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:34.290601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:34.290879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:34.291149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] PATH_INFO: `/v3/users/96cb8a56cf524ebe99024c488809d64e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:34.292300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] RBAC: Authorizing `identity:get_user(user_id=96cb8a56cf524ebe99024c488809d64e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:34.293721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:34.295383 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 601/1190] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:34 2022] GET /identity/v3/users/96cb8a56cf524ebe99024c488809d64e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:31:34.301320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:34.374650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:34.421585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50054d-5f82-4217-93c3-8869263a3e2c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:34.455831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82268ca-da39-4917-b94c-ae6913a9a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:34.456441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82268ca-da39-4917-b94c-ae6913a9a634 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:34.456715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82268ca-da39-4917-b94c-ae6913a9a634 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:34.457039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82268ca-da39-4917-b94c-ae6913a9a634 None admin] PATH_INFO: `/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:34.458299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82268ca-da39-4917-b94c-ae6913a9a634 None admin] RBAC: Authorizing `identity:get_project(project_id=15e8e37a4b8b4db3a8a405fd1cd2a55c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:34.460056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82268ca-da39-4917-b94c-ae6913a9a634 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:34.462360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 590/1191] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:34 2022] GET /identity/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:34.467915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:34.504489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:34.568532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5c886-9194-4fba-9550-bb8a1cdee58c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:34.603187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b233c-17a7-40e4-a5db-b09085df3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:34.603752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b233c-17a7-40e4-a5db-b09085df3c47 None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:34.604026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b233c-17a7-40e4-a5db-b09085df3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:34.604298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b233c-17a7-40e4-a5db-b09085df3c47 None admin] PATH_INFO: `/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c/users/96cb8a56cf524ebe99024c488809d64e/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:34.606982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b233c-17a7-40e4-a5db-b09085df3c47 None admin] RBAC: Authorizing `identity:create_grant(project_id=15e8e37a4b8b4db3a8a405fd1cd2a55c, user_id=96cb8a56cf524ebe99024c488809d64e, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:34.608589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b233c-17a7-40e4-a5db-b09085df3c47 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:34.738906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 602/1192] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:31:34 2022] PUT /identity/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c/users/96cb8a56cf524ebe99024c488809d64e/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:31:36.651012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828efe92-884c-44d3-a267-687679744eb6 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:36.651522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828efe92-884c-44d3-a267-687679744eb6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:36.651522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828efe92-884c-44d3-a267-687679744eb6 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:36.652828 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 591/1193] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:31:36.658287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:36.658721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:36.658889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:36.677142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:36.678897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:36.746890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 603/1194] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:31:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:31:37.020828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828efe92-884c-44d3-a267-687679744eb6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:37.136970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828efe92-884c-44d3-a267-687679744eb6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:37.161037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:37.172573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:37.173205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:37.173484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:37.173757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:37.184741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:31:37.189569 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:31:37.190703 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:31:37.191553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 592/1195] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:31:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:31:37.196859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:37.224164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:37.305682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d730bc-440c-49e5-a070-d6234b10573d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:37.340665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:37.341269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:37.341550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:37.341826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:37.342524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:37.342836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:37.344202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:37.353589 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 604/1196] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:31:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:37.358837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:37.467365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe6ac2-3420-4045-9b72-be046a3c55b1 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:37.504690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:37.505318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:37.505599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:37.506449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] PATH_INFO: `/v3/users/96cb8a56cf524ebe99024c488809d64e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:37.507587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] RBAC: Authorizing `identity:get_user(user_id=96cb8a56cf524ebe99024c488809d64e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:37.509022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:37.510688 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 593/1197] 10.222.0.78 () {56 vars in 1177 bytes} [Sun Aug 28 19:31:37 2022] GET /identity/v3/users/96cb8a56cf524ebe99024c488809d64e => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:37.516628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:37.603506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:37.616575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5107b-e219-4c6d-aa26-701b479ffae8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:37.651154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:37.651757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:37.652036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:37.652308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:37.720869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:37.722357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:37.808253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:37.821519 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 605/1198] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:31:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:31:37.827513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:37.880630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:37.929289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35505ea-b08e-41bd-979e-e406cb8e8651 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:37.963553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9372c4e-af68-40f7-a6d4-534208889b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:37.964175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9372c4e-af68-40f7-a6d4-534208889b05 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:37.964454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9372c4e-af68-40f7-a6d4-534208889b05 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:37.964727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9372c4e-af68-40f7-a6d4-534208889b05 None admin] PATH_INFO: `/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:37.965890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9372c4e-af68-40f7-a6d4-534208889b05 None admin] RBAC: Authorizing `identity:get_project(project_id=15e8e37a4b8b4db3a8a405fd1cd2a55c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:37.967317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9372c4e-af68-40f7-a6d4-534208889b05 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:37.968942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 594/1199] 10.222.0.78 () {56 vars in 1186 bytes} [Sun Aug 28 19:31:37 2022] GET /identity/v3/projects/15e8e37a4b8b4db3a8a405fd1cd2a55c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:37.975623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:38.075035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f30387-3b27-4ab7-9968-edb682fcf054 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:38.108179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:38.108765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:38.109037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:38.109409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:38.110300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=15e8e37a4b8b4db3a8a405fd1cd2a55c, user.id=96cb8a56cf524ebe99024c488809d64e) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:31:38.110606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:38.112022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6815c25-d4b3-4b22-aa7f-21b7173823b2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:38.118398 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 606/1200] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:31:37 2022] GET /identity/v3/role_assignments?user.id=96cb8a56cf524ebe99024c488809d64e&scope.project.id=15e8e37a4b8b4db3a8a405fd1cd2a55c&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:31:47.959150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=40 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:48.115199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=74 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:59.575294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0208c-4598-4eca-8063-323cff53c9fb None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:59.575871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0208c-4598-4eca-8063-323cff53c9fb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:59.575871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0208c-4598-4eca-8063-323cff53c9fb None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:59.577288 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 595/1201] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:32:59.583151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:59.587283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:59.587283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:59.602636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:59.603888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:59.673214 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 607/1202] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:32:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:32:59.949096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0208c-4598-4eca-8063-323cff53c9fb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:00.059888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0208c-4598-4eca-8063-323cff53c9fb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:00.097184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:00.097807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:00.098119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:00.098390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:00.109167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:00.110676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:00.124920 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:00.126509 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:00.127817 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:00.127817 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:00.127817 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:00.127817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 596/1203] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:00.133298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:00.244640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c824b-7dab-4d56-9392-9310aa7d1966 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:00.276044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:00.282351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:00.282965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:00.283293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:00.283518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:00.284172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:00.284475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:00.285957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18308ade-8275-451d-a48c-2d1feb39008e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:00.298747 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 608/1204] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:00.304878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:00.366895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:00.420649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7294-87fa-4a5d-8824-8126070e2a51 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:00.455260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3a095-602c-439c-b3cd-cf11cb366d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:00.458756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3a095-602c-439c-b3cd-cf11cb366d45 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:00.458756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3a095-602c-439c-b3cd-cf11cb366d45 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:00.458756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3a095-602c-439c-b3cd-cf11cb366d45 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:00.458756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3a095-602c-439c-b3cd-cf11cb366d45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:00.458756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3a095-602c-439c-b3cd-cf11cb366d45 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:00.606268 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 597/1205] 10.222.0.78 () {60 vars in 1132 bytes} [Sun Aug 28 19:33:00 2022] POST /identity/v3/users => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:02.648171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba33bd-b4c6-4956-824f-f1fe37dd7892 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:02.648761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba33bd-b4c6-4956-824f-f1fe37dd7892 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:02.648761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba33bd-b4c6-4956-824f-f1fe37dd7892 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:02.650100 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 609/1206] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:02.656754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:02.659047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:02.659047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:02.679762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:02.681539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:02.782320 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 598/1207] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:03.062074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba33bd-b4c6-4956-824f-f1fe37dd7892 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:03.179057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba33bd-b4c6-4956-824f-f1fe37dd7892 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:03.221385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:03.222058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:03.222341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:03.222642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:03.235973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:33:03.241678 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:03.243820 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:03.245702 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 610/1208] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:33:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:03.254548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:03.302042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:03.372152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b780bb9-6ae9-4a76-aa93-e8c1291970f3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:03.419964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:03.420713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:03.420992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:03.421263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:03.422004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:03.422316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:03.423760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:03.435050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 599/1209] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:33:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:03.441328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:03.504176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:03.562722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de0644-c1c5-43de-b27a-2f3618107097 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:03.606478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:03.607057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:03.607337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:03.607608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:03.622213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:03.623721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:03.639798 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:03.651831 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:03.652762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:03.652762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:03.652762 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:03.652762 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 611/1210] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:03.653011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:03.761865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:03.765075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381357-b456-4826-a397-01b39659dc52 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:03.802268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:03.802871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:03.803151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:03.803428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:03.804144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:03.804448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:03.805836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:03.819554 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 600/1211] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:03.825530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:03.945938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca6de-a5fc-4561-b5df-2704abaeb81f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:03.947601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:03.982874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:03.983514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:03.983789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:03.984060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:03.992601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:03.994291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:33:04.007632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:04.009049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:04.010489 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 612/1212] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:04.015154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:04.122098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82effa3f-8b7e-4523-9e07-38f0097778d8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:04.158703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:04.158964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:04.159074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:04.159332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:04.160102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:04.160439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:04.161906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:04.181402 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 601/1213] 10.222.0.78 () {56 vars in 1143 bytes} [Sun Aug 28 19:33:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:04.187481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:04.297806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5162b1-1d26-4733-9133-3ebe9e74bfa9 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:04.335389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:04.336051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:04.336276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:04.336548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:04.373769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:04.415758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:04.417380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:04.534926 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 613/1214] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:33:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:33:04.541722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:04.562097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:04.648473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e738b1-b3a3-405d-a1d4-7d28379c4921 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:04.685510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:04.686182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:04.686472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:04.686745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:04.697916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:04.699391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:04.715971 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:04.717321 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:04.725145 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:04.725145 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:04.725145 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:04.725145 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 602/1215] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:04.725456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:04.785864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:04.825630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbe0c-8c55-47a1-ba58-50ac959ac597 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:04.861472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:04.862122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:04.862409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:04.862684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:04.863348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:04.864245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:04.865630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:04.878611 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 614/1216] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:04.884795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:04.957663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:04.990464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627a8b-9ffe-40ff-a0e2-7078db36a88e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:05.028294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:05.029059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:05.029385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:05.029695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:05.037421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:05.038881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:33:05.050908 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:05.051895 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:05.052820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 603/1217] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:05.058074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:05.175115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a120c92-6e97-4aca-b071-57e4246f99d4 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:05.202217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:05.214920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:05.215523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:05.215794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:05.216064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:05.216773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:05.217081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:05.218672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3998b72-a53d-4056-a55c-a3fc7616a526 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:05.232573 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 615/1218] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:05.238873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:05.354839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c253f1b-a551-46d5-aa27-b80ecb3fdaed None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:05.388782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:05.395878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:05.396481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:05.396759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:05.397033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:05.397843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c56d2d2a803e41b894ab6417646db98d) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:05.398355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:05.399877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bce4f5-a1d2-4906-a704-af178d9521ed None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:05.406174 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 604/1219] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:33:05 2022] GET /identity/v3/role_assignments?user.id=c56d2d2a803e41b894ab6417646db98d&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:07.324578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7136682-343d-499a-957a-90b2d696d711 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:07.325162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7136682-343d-499a-957a-90b2d696d711 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:07.325162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7136682-343d-499a-957a-90b2d696d711 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:07.326551 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 616/1220] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:07.331930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:07.332872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:07.336184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:07.357520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:07.358822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:07.436177 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 605/1221] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:33:07.703541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7136682-343d-499a-957a-90b2d696d711 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:07.805407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7136682-343d-499a-957a-90b2d696d711 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:07.840006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:07.840966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:07.840966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:07.841350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:07.851439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:33:07.856272 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:07.857362 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:07.858257 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 617/1222] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:07.864059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:07.970380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33480665-f71d-4bc1-9e82-7360e522f4c8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:07.994303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:08.005885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.012978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.012978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.012978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.012978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] RBAC: Adding query filter params (name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:08.012978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.012978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.017566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 606/1223] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:33:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:08.023435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.067770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:08.123878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67104c4d-3c6b-4725-a0e0-69ef63deff76 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.158197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.158819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.159101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.159371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.169258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.172130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:08.190621 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:08.192338 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:08.193222 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:08.193222 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:08.193222 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:08.193222 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 618/1224] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:08.199694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.310642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6e51-50ea-4580-8d48-3466fd717934 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.345111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.345811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.345992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.346269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.346943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:08.347296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.349217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.363247 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 607/1225] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:08.369663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.466585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:08.473872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d592fce-c6cc-4825-a16a-05fbe272e33c None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.508850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.509646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.509966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.510331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.520731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.522260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:33:08.534821 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:08.543799 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:08.544769 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 619/1226] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:33:08.545475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.590747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:08.651425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f143f1-a572-472f-a3c2-8e79fcef99bb None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.688639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.689293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.689570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.689839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.690633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:08.690937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.692495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.712234 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 608/1227] 10.222.0.78 () {56 vars in 1143 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:08.718344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.830056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4ce3-493e-40fe-8724-713e25b7bd68 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.864413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.864946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.865221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.865486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.876550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.878071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:08.892423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:08.893592 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:08.895268 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:08.895268 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:08.895268 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:08.895268 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 620/1228] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:08.900322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.004873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aca6e-d6f0-492c-8160-05bb30765d49 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.007364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:09.039689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.040295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.040558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.040826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.041456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:09.041789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.043153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.054631 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 609/1229] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:09.060510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.072705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:09.165066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19764ad7-9cdb-47fa-8e4d-44a21512a68a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.203953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.204593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.204873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.205142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.212874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.215274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:33:09.225544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:09.226632 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:09.227756 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 621/1230] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:09.232784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.333665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df1a9-abbb-43ba-9221-c45fe12a3278 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.370447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.371116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.371302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.371605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.372247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:09.372550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.373990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b954de2-2c11-4e81-b47f-958de50edd77 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.386941 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 610/1231] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:09.393552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.463067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:09.496797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a605-00c5-4376-9da1-7db232ded985 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.531140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31f2e9-3fb6-431a-adbe-3392df2a647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.531766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31f2e9-3fb6-431a-adbe-3392df2a647b None admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.532049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31f2e9-3fb6-431a-adbe-3392df2a647b None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.532319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31f2e9-3fb6-431a-adbe-3392df2a647b None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c56d2d2a803e41b894ab6417646db98d/roles/ce0a7b36e3bf4a6fab5094ebfda769ea` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.547416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31f2e9-3fb6-431a-adbe-3392df2a647b None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=c56d2d2a803e41b894ab6417646db98d, role_id=ce0a7b36e3bf4a6fab5094ebfda769ea)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.549480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31f2e9-3fb6-431a-adbe-3392df2a647b None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.702313 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 622/1232] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:33:09 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c56d2d2a803e41b894ab6417646db98d/roles/ce0a7b36e3bf4a6fab5094ebfda769ea => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:11.627445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3960-2d1a-498f-bac6-0a6888c948d0 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.628059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3960-2d1a-498f-bac6-0a6888c948d0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.628059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3960-2d1a-498f-bac6-0a6888c948d0 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.629879 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 611/1233] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:11.635488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.635964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.636074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.654152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:11.655360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:11.724022 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 623/1234] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:33:11.993416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3960-2d1a-498f-bac6-0a6888c948d0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.019987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.096822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3960-2d1a-498f-bac6-0a6888c948d0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.131828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.132451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.132732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.133006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.143060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:33:12.147860 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:12.149095 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:12.150285 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 612/1235] 10.222.0.78 () {56 vars in 1102 bytes} [Sun Aug 28 19:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:12.155015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.204878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.264730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1cec-bdea-43cf-b442-ed8358ed79f2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.304723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.305332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.305662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.305992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.306671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] RBAC: Adding query filter params (name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:12.307200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.308954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.318423 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 624/1236] 10.222.0.78 () {56 vars in 1103 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:12.324409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.416176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.432527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f776595-75fd-425f-9254-155f265c9162 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.466859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.467495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.467773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.468048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.478927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.480389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:12.496478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:12.498480 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:12.500211 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:12.500211 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:12.500211 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:12.500211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 613/1237] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:12.504359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.610502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71142-cd17-41ae-b3b4-e203642abc25 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.620309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.649446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.650162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.650162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.650162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.650689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:12.650988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.652338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.665375 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 625/1238] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:12.671224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.773304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50253b55-2560-474b-92a0-e5595930dacf None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.807491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.808181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.808459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.808731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.811657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.817582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.819081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:33:12.830657 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:12.832009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:12.833808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 614/1239] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:33:12.838363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.960660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a513d18-717c-4913-829c-bc8559a9d0ad None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.996583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.997198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.997682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.997998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.998766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:12.999077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.000757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.020232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 626/1240] 10.222.0.78 () {56 vars in 1143 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:13.026153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.129770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966374-7e0e-4785-98fc-35eb5026d783 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.166276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.166879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.167163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.167440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.230255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.236689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.238698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.339399 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 615/1241] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:33:13.345424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.381452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.464853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ef1e2-13a8-423c-8e2a-a27ea691bd21 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.510933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.511509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.511789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.512115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.523535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.526913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:13.541984 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:13.544136 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:13.546420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:13.546420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:13.546420 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:13.546420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 627/1242] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:13.551815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.650182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.656013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9389d9-a654-437a-8a3b-cf3e3aa87d1d None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.697326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.698039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.698233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.698503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.699165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:13.699486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.700836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.715203 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 616/1243] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:13.721457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.808936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.831663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5392c7-d0bb-48db-abd1-3f848a3459e6 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.867206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.867829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.868108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.868376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.875453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.877200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:33:13.890070 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:13.891514 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:13.892409 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 628/1244] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:13.897426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:14.003234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8ee89-1091-4833-8d2b-ad353027d755 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:14.039656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:14.040212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:14.040494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:14.040771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:14.041463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:14.041774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:14.043332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130641f2-5196-44e0-9b35-27d0def79c9e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:14.056759 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 617/1245] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:14.063677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:14.170792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2db2-094c-4d05-b19b-d7bff6557bd8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:14.210507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:14.211116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:14.211389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:14.211662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:14.212393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] RBAC: Adding query filter params (role.id=ce0a7b36e3bf4a6fab5094ebfda769ea, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c56d2d2a803e41b894ab6417646db98d) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:14.212703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:14.214147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2ca2-8f4e-4f98-8a68-c51b2638a29c None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:14.220399 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 629/1246] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:33:14 2022] GET /identity/v3/role_assignments?user.id=c56d2d2a803e41b894ab6417646db98d&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=ce0a7b36e3bf4a6fab5094ebfda769ea => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:16.244705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5e40-22eb-4879-b8e4-b75e187f1b94 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.244705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5e40-22eb-4879-b8e4-b75e187f1b94 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.244705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5e40-22eb-4879-b8e4-b75e187f1b94 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.249067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 618/1247] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:16.252320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.256750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.256750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.259773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:16.273894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:16.275142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:16.356293 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 630/1248] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:33:16.628430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5e40-22eb-4879-b8e4-b75e187f1b94 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.648720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:16.740531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5e40-22eb-4879-b8e4-b75e187f1b94 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.781766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.782436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.782712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.782988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.795457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:33:16.800476 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:16.801735 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:16.802887 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 619/1249] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:33:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:16.808083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.916475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2cec3-9ba7-4bfc-b56c-44dcd1f38400 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.961502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:16.969447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.970164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.970628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.970912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.973798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:16.974162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.976124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.987200 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 631/1250] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:16.994960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.109231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.139345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fabcc-c3da-47c7-b5d9-b32ed03d0524 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.179743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.180257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.180570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.180809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.192809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.194335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:17.210526 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:17.211740 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:17.212638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:17.212638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:17.212638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:17.212638 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 620/1251] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:17.217918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.326809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f747c-2804-40c1-b357-92cb9b4e8aa2 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.362772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.364136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.364373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.364646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.365296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:17.365602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.367005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.380012 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 632/1252] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:17.386031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.492939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918fbcd-da35-41d0-b06b-120945970248 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.519753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.529062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.529743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.530058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.530355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] PATH_INFO: `/v3/users/placement` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.540046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.541499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:33:17.553686 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:17.558730 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:17.559927 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 621/1253] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:17.560909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.627500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.678595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54f8fe-6f17-464f-af9a-88566a29c175 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.721090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.721690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.722017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.722291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.723649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:17.723953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.725387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.744216 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 633/1254] 10.222.0.78 () {56 vars in 1143 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:17.750195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.860298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72f2d-bc3c-4b94-8327-a7de48b9d76c None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.897681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.898313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.898594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.898867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.955772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.968833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.970323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.075050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 622/1255] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:33:18.081127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.188139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77396e64-05cc-45fa-be34-8d314ea91407 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.204406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.228975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.229608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.229919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.230198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.242640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.244149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:18.260660 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:18.261839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:18.262768 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:18.262768 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:18.262768 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:18.262768 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 634/1256] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:18.268226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.383473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.396808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c465f5-515f-4ce2-b20d-4427a0f0c5d5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.440239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.440867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.441168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.441438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.442204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:18.442510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.444334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.458360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 623/1257] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:18.464574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.579535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b310-e98d-4d02-b79b-f849b5389c75 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.617194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.617757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.618069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.618345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.626085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.627613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:33:18.640379 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:18.641515 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:18.646977 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 635/1258] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:18.648745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.766706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489229b0-3fce-4493-b189-a62d0ef9c076 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.802214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.802855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.803144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.803414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.804101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:18.804408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.805836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53dc1-886a-4267-a73c-f3051f88fd7b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.818773 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 624/1259] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:18.825237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.853989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.932373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b1c1-dab3-4b5e-a3f3-7ffb6966ae3a None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.973820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.974635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.974915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.975187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.975919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c56d2d2a803e41b894ab6417646db98d) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:18.976231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.977669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792cc5-829f-4c7f-a0d4-e1fa67a34699 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.986715 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 636/1260] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/role_assignments?user.id=c56d2d2a803e41b894ab6417646db98d&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:20.908898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff061-4eb0-4bcc-83f8-66ea4dd0c82b None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.909429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff061-4eb0-4bcc-83f8-66ea4dd0c82b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.909547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff061-4eb0-4bcc-83f8-66ea4dd0c82b None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.910897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 625/1261] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:20.916699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.917225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.917321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.936600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:20.937818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:21.016173 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 637/1262] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:21.292635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aff061-4eb0-4bcc-83f8-66ea4dd0c82b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.311721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:21.412702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aff061-4eb0-4bcc-83f8-66ea4dd0c82b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.451702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.452348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.452624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.452933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.464135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:33:21.468985 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:21.470742 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:21.472973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 626/1263] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:33:21.478558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.497728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:21.604389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a1bd-58ef-42d3-88ff-13dafcecd458 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.643628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.644876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.645158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.645432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.646220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:21.646525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.647915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.657797 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 638/1264] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:33:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:21.665339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.778079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:21.824300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba75b6-950b-44d2-9340-7252d70e2aa8 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.861297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.861843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.862153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.862427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.873426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.874911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:21.890371 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:21.891525 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:21.892622 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:21.892622 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:21.892622 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:21.894024 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 627/1265] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:21.898022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.988421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:22.013190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a124-45e6-4b81-b55c-7e955dc2d035 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.052288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.052985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.053245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.053514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.054213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:22.054517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.055929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.069192 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 639/1266] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:22.075031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.183483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3361d4-f760-471b-82d6-a56fcffc7d19 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.204284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:22.218137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.218758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.219036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.219346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.227092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.228554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:33:22.240582 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:22.241712 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:22.242950 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 628/1267] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:22.247677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.353591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92899dd-1f33-4715-bbe1-724c068eeec1 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.389871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.390572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.390789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.391039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.391822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:22.392126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.393680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.403792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:22.414620 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 640/1268] 10.222.0.78 () {56 vars in 1143 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:22.419480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.526634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3fa36-f7a5-45d7-ae33-f83abb816be5 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.562064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.562680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.562992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.563266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.573884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.575362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:22.589372 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:22.590665 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:22.591918 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:22.591918 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:22.591918 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:22.594025 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 629/1269] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:22.596442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.698932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb12d-fecc-4d59-b923-0fd8605e6c41 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.736456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.737087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.737362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.737628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.738880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:22.739182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.740587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.752478 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 641/1270] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:22.758690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.793484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:22.868866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b59a1-a135-4fcc-a5ce-9cd7ddef32fa None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.903445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.904095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.904372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.904647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.912475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.914014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:33:22.928009 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:22.928996 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:22.929911 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 630/1271] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:22.935287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.994263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:23.037812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5605d06-76fa-44e9-b6b3-aa01f628129f None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.071989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.072594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.072872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.073146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.073833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:23.074177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.075593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7263ae-fe42-4a93-8f92-8b8093a437bc None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.087986 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 642/1272] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:23.094205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.192339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:23.201372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8321d9-17a7-4260-90df-e007028d49fc None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.236808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485690f6-d6cc-4a0d-9e74-b81a62061645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.237456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485690f6-d6cc-4a0d-9e74-b81a62061645 None admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.237739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485690f6-d6cc-4a0d-9e74-b81a62061645 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.238071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485690f6-d6cc-4a0d-9e74-b81a62061645 None admin] PATH_INFO: `/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c56d2d2a803e41b894ab6417646db98d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.239971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485690f6-d6cc-4a0d-9e74-b81a62061645 None admin] RBAC: Authorizing `identity:create_grant(project_id=e688fcd3bf3b411b8d462d92e13c068e, user_id=c56d2d2a803e41b894ab6417646db98d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.241416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485690f6-d6cc-4a0d-9e74-b81a62061645 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.337368 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 631/1273] 10.222.0.78 () {58 vars in 1439 bytes} [Sun Aug 28 19:33:23 2022] PUT /identity/v3/projects/e688fcd3bf3b411b8d462d92e13c068e/users/c56d2d2a803e41b894ab6417646db98d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:25.318503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd62d-e6e9-4698-b24e-81930cdd6c7e None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:25.319066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd62d-e6e9-4698-b24e-81930cdd6c7e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:25.319505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd62d-e6e9-4698-b24e-81930cdd6c7e None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:25.322092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 643/1274] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:25.327674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:25.328144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:25.328270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:25.348139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:25.349353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:25.425076 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 632/1275] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:25.718783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd62d-e6e9-4698-b24e-81930cdd6c7e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:25.833692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd62d-e6e9-4698-b24e-81930cdd6c7e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:25.853064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:25.870620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:25.871290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:25.871614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:25.871984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:25.883840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 19:33:25.888575 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:25.889555 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:25.895451 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 644/1276] 10.222.0.78 () {56 vars in 1096 bytes} [Sun Aug 28 19:33:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:25.896344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:25.982450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:26.002134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891183b-7344-4434-b217-d76a19ed2b7d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.038325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.038924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.039206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.039478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.040139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:26.040448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.041831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.050718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 633/1277] 10.222.0.78 () {56 vars in 1099 bytes} [Sun Aug 28 19:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:26.056538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.161088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb19b7-c339-44ef-84a5-77b579618025 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.203489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.204130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.204410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.204688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.222815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.224310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:26.241157 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:26.242385 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:26.243705 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:26.243705 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:26.243705 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:26.243705 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 645/1278] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:26.248799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.362023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512199d-f1bd-47a0-83a9-8591fd0eec95 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.404340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.404946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.405229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.405513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.406193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:26.406505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.407879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.421517 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 634/1279] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:26.428411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.461224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:26.538917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641d34-e36b-4f1b-acce-a117abc481e8 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.577402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.578082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.578358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.578623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.588923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.590433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:33:26.604045 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:26.605308 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:26.606359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 646/1280] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:33:26.611857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.616524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:26.712945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95f82-b8d0-4804-9f04-ebc51a26bfa6 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.747696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.748301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.748575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.748842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.749563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:26.749892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.751575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.770943 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 635/1281] 10.222.0.78 () {56 vars in 1143 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:26.777268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.876026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:26.885801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bc63c-0753-4fce-9eb4-0b9a39e08c68 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.920624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.921271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.921554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.921825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.991784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.993603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.088629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:27.099467 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 647/1282] 10.222.0.78 () {58 vars in 1282 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 19:33:27.105880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.171690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:27.212189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bb631-4451-41b4-b5b7-9245ef5947d0 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.247598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.248229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.248509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.248780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.260150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.262055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:33:27.279267 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:27.280602 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 19:33:27.281523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:27.281523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 19:33:27.281523 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:27.281523 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 636/1283] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:27.287011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.411263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96df282-5f68-472f-b90e-250e327bbd72 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.454877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.455699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.455699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.455898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.456538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:27.456834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.458224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.469991 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 648/1284] 10.222.0.78 () {56 vars in 1109 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:27.476202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.587294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8991a-0f37-47ee-b8eb-68e158b2e991 None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.602173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:27.623086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.623707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.624031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.624253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.631970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.633386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 19:33:27.644717 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:27.645827 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 19:33:27.647016 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 637/1285] 10.222.0.78 () {56 vars in 1111 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:27.652433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.706348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:27.767166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c770-c00a-4848-851f-94a96f1591de None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.802010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.802593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.802869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.803137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.803826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:27.804187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.805533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95937-8833-40e6-a17a-f17afe635244 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.818160 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 649/1286] 10.222.0.78 () {56 vars in 1148 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:27.824497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.932999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e136-ee1d-44ee-8dea-d615a3abe58a None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.969391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.969937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.970210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.970483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.971212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] RBAC: Adding query filter params (role.id=5f91ad37e210416db6e993bd952ab9e3, scope.project.id=e688fcd3bf3b411b8d462d92e13c068e, user.id=c56d2d2a803e41b894ab6417646db98d) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:27.971518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.973501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402516-44e3-4cdd-ba4a-3ab164ba4b4b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.980262 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 638/1287] 10.222.0.78 () {56 vars in 1374 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/role_assignments?user.id=c56d2d2a803e41b894ab6417646db98d&scope.project.id=e688fcd3bf3b411b8d462d92e13c068e&role.id=5f91ad37e210416db6e993bd952ab9e3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:29.976040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874674-b316-48b2-b26e-941c4b61d7bc None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:29.976696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874674-b316-48b2-b26e-941c4b61d7bc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:29.976696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874674-b316-48b2-b26e-941c4b61d7bc None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:29.977980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 650/1288] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:29.983639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:29.984091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:29.984177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.003822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:30.005073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:30.037520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:30.076257 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 639/1289] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:30.347416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78874674-b316-48b2-b26e-941c4b61d7bc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.471711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78874674-b316-48b2-b26e-941c4b61d7bc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.488284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:30.522968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.523614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.523898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.524172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.524761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.526537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:30.537381 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:30.540579 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:30.541590 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 651/1290] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:30.544971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.649274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67b55-8db5-4500-9cc7-cc03e5eff386 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.688797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.689400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.689679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.689983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.690610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] RBAC: Adding query filter params (name=placement) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:30.691487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.692842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486691f1-bbb1-45c2-811a-78cd878dd29d None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.697734 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 640/1291] 10.222.0.78 () {56 vars in 1116 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:30.704208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.815465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bc3c-d403-4c3b-920f-47781de7a738 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.851422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.852028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.852460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.852589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.853337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:30.853575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.855042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389e1e-6f62-403d-8c34-523a95bda8e1 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.860168 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 652/1292] 10.222.0.78 () {56 vars in 1116 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:32.811555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7527c2-3c73-4fea-bca8-1d6894323a42 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:32.812127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7527c2-3c73-4fea-bca8-1d6894323a42 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:32.812127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7527c2-3c73-4fea-bca8-1d6894323a42 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:32.813743 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 641/1293] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:32.819355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c2c3-a9a4-450f-b8ea-feb84e08d1d8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:32.820585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c2c3-a9a4-450f-b8ea-feb84e08d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:32.820585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c2c3-a9a4-450f-b8ea-feb84e08d1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:32.838918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a593c2c3-a9a4-450f-b8ea-feb84e08d1d8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:32.840126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a593c2c3-a9a4-450f-b8ea-feb84e08d1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:32.872172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:32.912545 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 653/1294] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:33.183181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7527c2-3c73-4fea-bca8-1d6894323a42 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:33.228931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:33.324314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7527c2-3c73-4fea-bca8-1d6894323a42 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:33.371054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733363c4-5cad-4ad7-ac03-b2542eb561c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:33.371977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733363c4-5cad-4ad7-ac03-b2542eb561c4 None admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:33.372435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733363c4-5cad-4ad7-ac03-b2542eb561c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:33.372895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733363c4-5cad-4ad7-ac03-b2542eb561c4 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:33.373712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733363c4-5cad-4ad7-ac03-b2542eb561c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:33.375905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733363c4-5cad-4ad7-ac03-b2542eb561c4 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:33.479999 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 642/1295] 10.222.0.78 () {60 vars in 1141 bytes} [Sun Aug 28 19:33:33 2022] POST /identity/v3/services => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:35.519832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5459-717e-4c27-ac4b-ed20f49874dd None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:35.520367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5459-717e-4c27-ac4b-ed20f49874dd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:35.520455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5459-717e-4c27-ac4b-ed20f49874dd None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:35.521975 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 654/1296] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:35.527759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:35.528363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:35.528363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:35.549163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:35.551046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:35.640590 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 643/1297] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:35.925512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5459-717e-4c27-ac4b-ed20f49874dd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:36.031105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5459-717e-4c27-ac4b-ed20f49874dd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:36.068618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:36.069258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:36.069538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:36.069815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:36.070431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:36.071813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:36.082724 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:36.084107 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:36.085278 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 655/1298] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:33:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:36.090706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:36.111819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:36.204322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d86f5-2648-4f8a-acca-6a3922799d73 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:36.242516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:36.243132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:36.243483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:36.243759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:36.244420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:36.244707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:36.246171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:36.253226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 644/1299] 10.222.0.78 () {56 vars in 1116 bytes} [Sun Aug 28 19:33:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:36.259594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:36.293699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:36.373158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e610a-c073-4b14-b93c-3014257440c5 None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:36.411457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:36.412074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:36.412355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:36.412626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:36.413342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] RBAC: Adding query filter params (interface=public, service_id=eb6cf3fbfb214dbc8d324acb94519ad8, region_id=RegionOne) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:36.413649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:36.415550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8c9ec-846f-47cc-bd5d-48904e04c19e None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:36.421563 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 656/1300] 10.222.0.78 () {56 vars in 1251 bytes} [Sun Aug 28 19:33:36 2022] GET /identity/v3/endpoints?service_id=eb6cf3fbfb214dbc8d324acb94519ad8&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:36.427507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:36.514253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:36.535193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fea9a-9f77-4643-b781-bd9744744b8e None admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:36.571431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3449fc3-e93e-487a-a0d4-386c355c603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:36.572064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449fc3-e93e-487a-a0d4-386c355c603b None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:36.572347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449fc3-e93e-487a-a0d4-386c355c603b None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:36.572615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449fc3-e93e-487a-a0d4-386c355c603b None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:36.573242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3449fc3-e93e-487a-a0d4-386c355c603b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:36.574774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3449fc3-e93e-487a-a0d4-386c355c603b None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:36.584017 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 645/1301] 10.222.0.78 () {56 vars in 1087 bytes} [Sun Aug 28 19:33:36 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:38.611173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9897cb-d5bb-4a0f-a3fb-19f6a8f0137c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.611701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9897cb-d5bb-4a0f-a3fb-19f6a8f0137c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.611701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9897cb-d5bb-4a0f-a3fb-19f6a8f0137c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.613547 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 657/1302] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:33:38.619283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.619861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.619861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.638620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:38.639847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.715658 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 646/1303] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:33:38.984657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9897cb-d5bb-4a0f-a3fb-19f6a8f0137c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.091390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:39.098680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9897cb-d5bb-4a0f-a3fb-19f6a8f0137c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.134904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.135939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.136570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.136846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] PATH_INFO: `/v3/services/placement` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.137475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.138906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:39.148543 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:39.149778 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 19:33:39.150954 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 658/1304] 10.222.0.78 () {56 vars in 1117 bytes} [Sun Aug 28 19:33:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:33:39.158721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.257588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:39.282720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e3a8-d666-4986-bec7-63ba2065560a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.320204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.320809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.321091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.321356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.322023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:39.322336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.323730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c52d-434d-4892-9b45-34a3cfa53493 None admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.329331 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 647/1305] 10.222.0.78 () {56 vars in 1116 bytes} [Sun Aug 28 19:33:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:39.335126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.442489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4608-6b6c-42e6-aef1-b11055c34fdd None admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.478669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87ca3c-5fd4-4221-b53a-8f0cee39687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.479280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87ca3c-5fd4-4221-b53a-8f0cee39687a None admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.479614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87ca3c-5fd4-4221-b53a-8f0cee39687a None admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.479883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87ca3c-5fd4-4221-b53a-8f0cee39687a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.480564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87ca3c-5fd4-4221-b53a-8f0cee39687a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.481963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87ca3c-5fd4-4221-b53a-8f0cee39687a None admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.611128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 659/1306] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:49.330641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=30 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:49.606454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:55.367070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143b75-19d4-4208-a5ac-a7840c6d2ef7 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:55.368495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143b75-19d4-4208-a5ac-a7840c6d2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:55.369782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143b75-19d4-4208-a5ac-a7840c6d2ef7 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:55.375355 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 648/1307] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:41:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:41:55.379042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004661-8789-4225-aa6a-9bccbc03fcd0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:55.379522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004661-8789-4225-aa6a-9bccbc03fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:55.379686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004661-8789-4225-aa6a-9bccbc03fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:55.486238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-44004661-8789-4225-aa6a-9bccbc03fcd0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:55.487588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-44004661-8789-4225-aa6a-9bccbc03fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:55.641334 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 660/1308] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:55.946864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faafca1-2f61-4cc0-9f36-ace3bbcd835f None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:55.947243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faafca1-2f61-4cc0-9f36-ace3bbcd835f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:55.947915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faafca1-2f61-4cc0-9f36-ace3bbcd835f None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:55.950978 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 649/1309] 10.222.0.78 () {54 vars in 965 bytes} [Sun Aug 28 19:41:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:41:55.957780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa453-54b1-4ab0-aadd-95011e7fc53b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:55.958843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa453-54b1-4ab0-aadd-95011e7fc53b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:55.959046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa453-54b1-4ab0-aadd-95011e7fc53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:56.052929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d10aa453-54b1-4ab0-aadd-95011e7fc53b None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:56.054175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d10aa453-54b1-4ab0-aadd-95011e7fc53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:56.080021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:56.153150 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 661/1310] 10.222.0.78 () {58 vars in 1062 bytes} [Sun Aug 28 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:56.162706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faafca1-2f61-4cc0-9f36-ace3bbcd835f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:56.172285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7faafca1-2f61-4cc0-9f36-ace3bbcd835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:56.312669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faafca1-2f61-4cc0-9f36-ace3bbcd835f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:56.423619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:56.424689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:56.424689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:56.424982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:56.426972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:56.489460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:56.554589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:56.556606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4016607-355d-47e4-96fc-11753420bdda service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:56.581364 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 650/1311] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:58.963421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fea00-1007-4781-b42f-a8be417d0217 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:58.963960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fea00-1007-4781-b42f-a8be417d0217 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:58.963960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fea00-1007-4781-b42f-a8be417d0217 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:58.965335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 662/1312] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:41:58.971625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400be93-6e37-426c-ae3e-625777dec4d3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:58.972116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400be93-6e37-426c-ae3e-625777dec4d3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:58.972232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400be93-6e37-426c-ae3e-625777dec4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:59.062089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3400be93-6e37-426c-ae3e-625777dec4d3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:59.063312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3400be93-6e37-426c-ae3e-625777dec4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:59.181241 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 651/1313] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:41:59.485824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fea00-1007-4781-b42f-a8be417d0217 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:59.487408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c69fea00-1007-4781-b42f-a8be417d0217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:59.614481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fea00-1007-4781-b42f-a8be417d0217 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:59.695843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:59.699078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:59.699707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:59.699988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:59.700262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:59.701964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:59.858739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:59.860467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79682f20-0adc-4f74-bf88-6ef0d2ca590b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:59.883163 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 663/1314] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:02.592632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ead368-6550-4f79-affc-41f220e404fd None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:02.593202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ead368-6550-4f79-affc-41f220e404fd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:02.593202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ead368-6550-4f79-affc-41f220e404fd None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:02.594558 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 652/1315] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:02.600432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febd82-3056-47e4-83bb-6c8f0987f802 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:02.600922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febd82-3056-47e4-83bb-6c8f0987f802 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:02.601047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febd82-3056-47e4-83bb-6c8f0987f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:02.670911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e8febd82-3056-47e4-83bb-6c8f0987f802 None None] MFA Rules not processed for user `5f1b6d22b0144e1f97b5ee9f7857fec8`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:02.672064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e8febd82-3056-47e4-83bb-6c8f0987f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:02.724888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:02.772723 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 664/1316] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:03.057532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ead368-6550-4f79-affc-41f220e404fd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:03.058720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64ead368-6550-4f79-affc-41f220e404fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:03.070241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:03.165592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ead368-6550-4f79-affc-41f220e404fd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:03.244086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:03.244702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:03.245093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:03.245255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:03.246888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:03.314837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:03.363646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:03.365113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0679778-5ead-43ca-8cd0-126ff0db865e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:03.386249 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 653/1317] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:06.294127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f4b41-6b88-4666-a003-37a74aa1f7a4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:06.294674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f4b41-6b88-4666-a003-37a74aa1f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:06.294674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f4b41-6b88-4666-a003-37a74aa1f7a4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:06.296027 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 665/1318] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:06.301683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf5db-ae80-4e8b-905f-378904f67d51 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:06.302281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf5db-ae80-4e8b-905f-378904f67d51 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:06.302281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf5db-ae80-4e8b-905f-378904f67d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:06.379690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48daf5db-ae80-4e8b-905f-378904f67d51 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:06.380923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48daf5db-ae80-4e8b-905f-378904f67d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:06.497440 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 654/1319] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:06.783401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f4b41-6b88-4666-a003-37a74aa1f7a4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:06.785079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e37f4b41-6b88-4666-a003-37a74aa1f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:06.889454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f4b41-6b88-4666-a003-37a74aa1f7a4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:06.962354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:06.963012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:06.963321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:06.963594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:06.965199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:06.972811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:07.076660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:07.078121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47197f-bcdf-4fd7-9bdd-6d35edbd1167 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:07.096529 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 666/1320] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:10.043201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22a984-81d3-40d4-933b-229f981d4651 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:10.043771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22a984-81d3-40d4-933b-229f981d4651 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:10.043911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22a984-81d3-40d4-933b-229f981d4651 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:10.045279 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 655/1321] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:42:10.051693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7016-9030-4794-bdfe-bdfae216e200 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:10.052406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7016-9030-4794-bdfe-bdfae216e200 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:10.052406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7016-9030-4794-bdfe-bdfae216e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:10.137113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f3af7016-9030-4794-bdfe-bdfae216e200 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:10.138898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f3af7016-9030-4794-bdfe-bdfae216e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:10.212536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:10.287219 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 667/1322] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:10.591518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22a984-81d3-40d4-933b-229f981d4651 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:10.594138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4a22a984-81d3-40d4-933b-229f981d4651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:10.619879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:10.736061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22a984-81d3-40d4-933b-229f981d4651 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:10.833682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:10.834331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:10.834613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:10.834883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:10.836758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:10.919626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:10.958745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:10.960202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970251b-9f35-4e0d-87ed-fb693fd126bc service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:10.979846 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 656/1323] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:13.029119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130012b-ed97-4375-bc11-371ad71fdde0 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:13.029652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130012b-ed97-4375-bc11-371ad71fdde0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:13.029652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130012b-ed97-4375-bc11-371ad71fdde0 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:13.031117 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 668/1324] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:13.036810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa321a-161b-41cc-a618-3621bca2fc98 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:13.037285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa321a-161b-41cc-a618-3621bca2fc98 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:13.037487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa321a-161b-41cc-a618-3621bca2fc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:13.108813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7efa321a-161b-41cc-a618-3621bca2fc98 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:13.110301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7efa321a-161b-41cc-a618-3621bca2fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:13.246501 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 657/1325] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:13.535706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130012b-ed97-4375-bc11-371ad71fdde0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:13.541032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9130012b-ed97-4375-bc11-371ad71fdde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:13.660063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130012b-ed97-4375-bc11-371ad71fdde0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:13.741840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:13.742487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:13.742766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:13.743041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:13.750062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:13.768334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:13.875807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:13.877536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a56f-f343-416c-8fe6-d04f875dfeff service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:13.904317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 669/1326] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:15.965308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a22f4-5ddf-4246-96bf-028464447529 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:15.965882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a22f4-5ddf-4246-96bf-028464447529 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:15.965980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a22f4-5ddf-4246-96bf-028464447529 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:15.967323 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 658/1327] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:15.972946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352301c0-8c08-4a0e-9cf4-1079d5d67fe3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:15.973393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352301c0-8c08-4a0e-9cf4-1079d5d67fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:15.973482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352301c0-8c08-4a0e-9cf4-1079d5d67fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:16.060892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-352301c0-8c08-4a0e-9cf4-1079d5d67fe3 None None] MFA Rules not processed for user `5f1b6d22b0144e1f97b5ee9f7857fec8`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:16.062169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-352301c0-8c08-4a0e-9cf4-1079d5d67fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:16.135684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:16.171621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 670/1328] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:16.466134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a22f4-5ddf-4246-96bf-028464447529 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:16.468156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-991a22f4-5ddf-4246-96bf-028464447529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:16.521834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:16.620917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a22f4-5ddf-4246-96bf-028464447529 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:16.724204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:16.724709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:16.724987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:16.725259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:16.727224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:16.827154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:16.878319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:16.880140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5a18c-dda4-4f22-85aa-2a9acbb84fec service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:16.902715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 659/1329] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:19.452617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6ac57-576f-4ac3-8eac-8652f2819e1b None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:19.453139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6ac57-576f-4ac3-8eac-8652f2819e1b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:19.453249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6ac57-576f-4ac3-8eac-8652f2819e1b None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:19.454572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 671/1330] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:19.459933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423a8fa-a485-486a-a978-74ee932d905e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:19.460354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423a8fa-a485-486a-a978-74ee932d905e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:19.460496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423a8fa-a485-486a-a978-74ee932d905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:19.538926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b423a8fa-a485-486a-a978-74ee932d905e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:19.540805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b423a8fa-a485-486a-a978-74ee932d905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:19.644097 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 660/1331] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:19.931654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6ac57-576f-4ac3-8eac-8652f2819e1b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:19.933194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fcd6ac57-576f-4ac3-8eac-8652f2819e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:20.050888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6ac57-576f-4ac3-8eac-8652f2819e1b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:20.136103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:20.136712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:20.136985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:20.137251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:20.138948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:20.177289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:20.291911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:20.294599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00974c9-6749-4366-9bec-e451a8287ffc service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:20.323462 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 672/1332] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:22.341136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191e73b-8c1e-42e2-b348-97e80677bba6 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:22.341951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191e73b-8c1e-42e2-b348-97e80677bba6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:22.341951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191e73b-8c1e-42e2-b348-97e80677bba6 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:22.343105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 661/1333] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:42:22.348672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83d0a-5f5e-4cfd-9358-c5f8b5514f26 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:22.349247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83d0a-5f5e-4cfd-9358-c5f8b5514f26 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:22.349247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83d0a-5f5e-4cfd-9358-c5f8b5514f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:22.422584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7fa83d0a-5f5e-4cfd-9358-c5f8b5514f26 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:22.423823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7fa83d0a-5f5e-4cfd-9358-c5f8b5514f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:22.507076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:22.532806 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 673/1334] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:22.820291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191e73b-8c1e-42e2-b348-97e80677bba6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:22.822859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f191e73b-8c1e-42e2-b348-97e80677bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:22.868222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:22.942344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191e73b-8c1e-42e2-b348-97e80677bba6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:23.023964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:23.025160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:23.025440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:23.025710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:23.027371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:23.118527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:23.145637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:23.147127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9017a37-e2a8-4680-b2c2-2d56f76d9a3a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:23.165794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 662/1335] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:25.827991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2a558-b09a-4971-97ce-55e070285699 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:25.828591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2a558-b09a-4971-97ce-55e070285699 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:25.828591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2a558-b09a-4971-97ce-55e070285699 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:25.829942 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 674/1336] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:25.835221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c8f0-75dc-4c6a-923f-f8fb552d7b29 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:25.835672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c8f0-75dc-4c6a-923f-f8fb552d7b29 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:25.835882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c8f0-75dc-4c6a-923f-f8fb552d7b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:25.915097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7199c8f0-75dc-4c6a-923f-f8fb552d7b29 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:25.916328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7199c8f0-75dc-4c6a-923f-f8fb552d7b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:26.022839 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 663/1337] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:26.314479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2a558-b09a-4971-97ce-55e070285699 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:26.321733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-18f2a558-b09a-4971-97ce-55e070285699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:26.431116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2a558-b09a-4971-97ce-55e070285699 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:26.507165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:26.507771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:26.508075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:26.508348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:26.510006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:26.547111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:26.626073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:26.627598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b436212-15c2-4d9d-b859-fa9c326de8e1 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:26.648106 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 675/1338] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:31.071166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae856b-1b2d-4f0b-958b-0baa4d0687c4 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:31.071915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae856b-1b2d-4f0b-958b-0baa4d0687c4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:31.071915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae856b-1b2d-4f0b-958b-0baa4d0687c4 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:31.073310 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 664/1339] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:31.079111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888c46-24ca-42b0-a731-367a1f4f61c8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:31.079633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888c46-24ca-42b0-a731-367a1f4f61c8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:31.079633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888c46-24ca-42b0-a731-367a1f4f61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:31.156093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-af888c46-24ca-42b0-a731-367a1f4f61c8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:31.157638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-af888c46-24ca-42b0-a731-367a1f4f61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:31.270799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:31.285076 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 676/1340] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:31.595347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae856b-1b2d-4f0b-958b-0baa4d0687c4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:31.597080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-20ae856b-1b2d-4f0b-958b-0baa4d0687c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:31.656305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:31.725408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae856b-1b2d-4f0b-958b-0baa4d0687c4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:31.819862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:31.820482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:31.820882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:31.821151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:31.823016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:31.945609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:31.978243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:31.981083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c83214-1a58-40e5-b0ec-196f203f65ba service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:32.016004 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 665/1341] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:35.195798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6648-269c-4db2-92dd-27474bcd9cf7 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:35.196367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6648-269c-4db2-92dd-27474bcd9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:35.196461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6648-269c-4db2-92dd-27474bcd9cf7 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:35.198615 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 677/1342] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:35.203421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff638-6242-4dae-9ce6-79908f0bbcb2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:35.203952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff638-6242-4dae-9ce6-79908f0bbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:35.204063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff638-6242-4dae-9ce6-79908f0bbcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:35.275227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-50cff638-6242-4dae-9ce6-79908f0bbcb2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:35.276437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-50cff638-6242-4dae-9ce6-79908f0bbcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:35.380481 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 666/1343] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:35.697021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6b02-1354-4121-a3ef-c6b7483cdff4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:35.697697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6b02-1354-4121-a3ef-c6b7483cdff4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:35.698187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6b02-1354-4121-a3ef-c6b7483cdff4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:35.700981 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 678/1344] 10.222.0.78 () {54 vars in 965 bytes} [Sun Aug 28 19:42:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:35.709074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2cc4c-9a7e-4ef1-8b80-0e075045b054 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:35.709532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2cc4c-9a7e-4ef1-8b80-0e075045b054 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:35.710032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2cc4c-9a7e-4ef1-8b80-0e075045b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:35.792935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:35.806960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-21b2cc4c-9a7e-4ef1-8b80-0e075045b054 None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:35.808213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-21b2cc4c-9a7e-4ef1-8b80-0e075045b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:35.907980 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 667/1345] 10.222.0.78 () {58 vars in 1062 bytes} [Sun Aug 28 19:42:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:42:35.917279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6b02-1354-4121-a3ef-c6b7483cdff4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:35.918872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a82c6b02-1354-4121-a3ef-c6b7483cdff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:36.063387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6b02-1354-4121-a3ef-c6b7483cdff4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:36.155336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:36.155943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:36.156226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:36.156549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:36.158165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:36.219800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:36.296488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:36.297992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028332eb-1f6b-479c-b164-7028f9e62d90 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:36.317832 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 679/1346] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:41.725133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0525-fe91-43b6-8ee5-3f24e8a34428 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:41.725757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0525-fe91-43b6-8ee5-3f24e8a34428 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:41.725757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0525-fe91-43b6-8ee5-3f24e8a34428 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:41.727624 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 668/1347] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:41.733717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701f9d-ee6b-4af5-adef-d530cd7a7b06 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:41.734499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701f9d-ee6b-4af5-adef-d530cd7a7b06 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:41.734499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701f9d-ee6b-4af5-adef-d530cd7a7b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:41.823284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-04701f9d-ee6b-4af5-adef-d530cd7a7b06 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:41.824516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-04701f9d-ee6b-4af5-adef-d530cd7a7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:41.950409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:41.953476 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 680/1348] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:42.251782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0525-fe91-43b6-8ee5-3f24e8a34428 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:42.253336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dc0e0525-fe91-43b6-8ee5-3f24e8a34428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:42.372663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0525-fe91-43b6-8ee5-3f24e8a34428 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:42.438401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:42.474285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:42.474912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:42.475179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:42.475549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:42.477412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:42.639832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:42.642344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21891d-015d-4f59-a31f-43e58aef0526 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:42.681513 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 669/1349] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:48.448200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1432f-1e25-4d98-9dc3-b2198b6ecad4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:48.448661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1432f-1e25-4d98-9dc3-b2198b6ecad4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:48.448782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1432f-1e25-4d98-9dc3-b2198b6ecad4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:48.450329 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 681/1350] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:48.456597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444bd87-0aa8-483d-bde3-2c62edd6b172 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:48.457424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444bd87-0aa8-483d-bde3-2c62edd6b172 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:48.457886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444bd87-0aa8-483d-bde3-2c62edd6b172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:48.597382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c444bd87-0aa8-483d-bde3-2c62edd6b172 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:48.601587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c444bd87-0aa8-483d-bde3-2c62edd6b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:48.656287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:48.747507 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 670/1351] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:42:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:53.139728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0eb02-98af-478c-b78c-215e6bda726f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:53.140273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0eb02-98af-478c-b78c-215e6bda726f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:53.140273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0eb02-98af-478c-b78c-215e6bda726f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:53.141789 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 682/1352] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:53.146903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b58f2-d948-4cdb-a498-6b96997eee15 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:53.147410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b58f2-d948-4cdb-a498-6b96997eee15 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:53.148340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b58f2-d948-4cdb-a498-6b96997eee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:53.243078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6b1b58f2-d948-4cdb-a498-6b96997eee15 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:53.244676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6b1b58f2-d948-4cdb-a498-6b96997eee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:53.325547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:53.368492 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 671/1353] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:42:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:54.805017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4fed-9aad-415d-8c91-ede64a089c9c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:54.805552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4fed-9aad-415d-8c91-ede64a089c9c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:54.805552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4fed-9aad-415d-8c91-ede64a089c9c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:54.807003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 683/1354] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:54.812685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccca25-e320-439b-b232-0319069b43e4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:54.812685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccca25-e320-439b-b232-0319069b43e4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:54.813627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccca25-e320-439b-b232-0319069b43e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:54.924400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4eccca25-e320-439b-b232-0319069b43e4 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:54.925268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4eccca25-e320-439b-b232-0319069b43e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:55.052582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 672/1355] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:42:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:58.619929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98caf0-02a1-465c-9cbe-08aa5e58a053 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:58.620692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98caf0-02a1-465c-9cbe-08aa5e58a053 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:58.620692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98caf0-02a1-465c-9cbe-08aa5e58a053 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:58.621761 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 684/1356] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:58.627657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7f8b-e5b2-4735-a8c4-48d27a094b2f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:58.628248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7f8b-e5b2-4735-a8c4-48d27a094b2f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:58.628248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7f8b-e5b2-4735-a8c4-48d27a094b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:58.697157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:58.742696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c2ef7f8b-e5b2-4735-a8c4-48d27a094b2f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:58.744762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2ef7f8b-e5b2-4735-a8c4-48d27a094b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:58.916661 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 673/1357] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:59.259401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34eed-de80-47e6-8d99-f1dc89ac46d6 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:59.261902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34eed-de80-47e6-8d99-f1dc89ac46d6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:59.263068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34eed-de80-47e6-8d99-f1dc89ac46d6 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:59.266321 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 685/1358] 10.222.0.78 () {54 vars in 962 bytes} [Sun Aug 28 19:42:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:42:59.273979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c913039-0941-4a09-9085-145f450352d0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:59.275104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c913039-0941-4a09-9085-145f450352d0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:59.275689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c913039-0941-4a09-9085-145f450352d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:59.380614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4c913039-0941-4a09-9085-145f450352d0 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:59.383220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4c913039-0941-4a09-9085-145f450352d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:59.452492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:59.534683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 674/1359] 10.222.0.78 () {58 vars in 1059 bytes} [Sun Aug 28 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:59.543548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34eed-de80-47e6-8d99-f1dc89ac46d6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:59.545381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d4b34eed-de80-47e6-8d99-f1dc89ac46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:59.709266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34eed-de80-47e6-8d99-f1dc89ac46d6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:59.794193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:59.837229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:59.837836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:59.838152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:59.838422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:59.840042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:59.945994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:59.947594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26c7d8-c136-4f4a-9a26-4faa202ec3b4 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:59.969418 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 686/1360] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:02.232755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d134f-74cc-4fb5-8461-3b8622cda6aa None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:02.233348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d134f-74cc-4fb5-8461-3b8622cda6aa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:02.233348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d134f-74cc-4fb5-8461-3b8622cda6aa None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:02.235079 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 675/1361] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:02.240931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ff4e-52a2-4752-8187-593aee5e39fb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:02.241459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ff4e-52a2-4752-8187-593aee5e39fb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:02.241591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ff4e-52a2-4752-8187-593aee5e39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:02.329007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4ff1ff4e-52a2-4752-8187-593aee5e39fb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:02.330629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ff1ff4e-52a2-4752-8187-593aee5e39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:02.375896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:02.469338 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 687/1362] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:02.767480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d134f-74cc-4fb5-8461-3b8622cda6aa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:02.769132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d47d134f-74cc-4fb5-8461-3b8622cda6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:03.011810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d134f-74cc-4fb5-8461-3b8622cda6aa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:03.023665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:03.170637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:03.171905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:03.172600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:03.173114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:03.176390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:03.317730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:03.320252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8b517-8067-4607-8947-a34ba0ceb449 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:03.344053 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 676/1363] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:05.943790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1ddd-8440-46d0-9c56-995afac9ed83 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:05.944456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1ddd-8440-46d0-9c56-995afac9ed83 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:05.944661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1ddd-8440-46d0-9c56-995afac9ed83 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:05.946052 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 688/1364] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:05.955457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270489-808f-4d4d-bc3f-cb91cf1a07f4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:05.955897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270489-808f-4d4d-bc3f-cb91cf1a07f4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:05.956100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270489-808f-4d4d-bc3f-cb91cf1a07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:05.979559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:06.068157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7d270489-808f-4d4d-bc3f-cb91cf1a07f4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:06.069711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7d270489-808f-4d4d-bc3f-cb91cf1a07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:06.198729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 677/1365] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:43:06.516408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce814-55ec-4624-a953-2342549b8491 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.516714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce814-55ec-4624-a953-2342549b8491 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.516964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce814-55ec-4624-a953-2342549b8491 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.519150 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 689/1366] 10.222.0.78 () {54 vars in 962 bytes} [Sun Aug 28 19:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:43:06.526237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d38c6-e6f4-4663-a6c2-5f909e512d00 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.526527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d38c6-e6f4-4663-a6c2-5f909e512d00 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.536951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d38c6-e6f4-4663-a6c2-5f909e512d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.626612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0d6d38c6-e6f4-4663-a6c2-5f909e512d00 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:06.627441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d6d38c6-e6f4-4663-a6c2-5f909e512d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:06.684243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:06.796379 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 678/1367] 10.222.0.78 () {58 vars in 1059 bytes} [Sun Aug 28 19:43:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:06.805306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce814-55ec-4624-a953-2342549b8491 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:06.806893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-546ce814-55ec-4624-a953-2342549b8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:07.029914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce814-55ec-4624-a953-2342549b8491 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:07.055010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:07.168709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:07.170023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:07.170455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:07.170876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:07.172747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:07.300121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:07.302154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ef86b-86fc-4c24-bb5a-18b8576ef706 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:07.355906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 690/1368] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:10.299642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8ac92-993f-4e3d-8349-868fb7de90d8 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.300870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8ac92-993f-4e3d-8349-868fb7de90d8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.301465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8ac92-993f-4e3d-8349-868fb7de90d8 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.308636 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 679/1369] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:10.309978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0841d0-184f-4b0e-af7d-8e0b57cdf5b7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.313661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0841d0-184f-4b0e-af7d-8e0b57cdf5b7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.313661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0841d0-184f-4b0e-af7d-8e0b57cdf5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.352412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:10.400617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3f0841d0-184f-4b0e-af7d-8e0b57cdf5b7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:10.402403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3f0841d0-184f-4b0e-af7d-8e0b57cdf5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:10.541457 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 691/1370] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:10.877107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8ac92-993f-4e3d-8349-868fb7de90d8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.878902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31b8ac92-993f-4e3d-8349-868fb7de90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:11.052933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:11.060601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8ac92-993f-4e3d-8349-868fb7de90d8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:11.232625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:11.233761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.234143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.234498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.236491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:11.379534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:11.381870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3e0e-0b9f-47ae-a330-5358ba24d4fe service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:11.403623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:11.418411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 680/1371] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:11.778825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64571f-c9e4-47cb-b564-73c76351ead4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.779947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64571f-c9e4-47cb-b564-73c76351ead4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.780569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64571f-c9e4-47cb-b564-73c76351ead4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.788994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf64d9f-95f3-46ff-94ed-edbd423a2d68 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.789537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf64d9f-95f3-46ff-94ed-edbd423a2d68 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.789994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf64d9f-95f3-46ff-94ed-edbd423a2d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.793572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 692/1372] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:11 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:11.894604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bcf64d9f-95f3-46ff-94ed-edbd423a2d68 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:11.897993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bcf64d9f-95f3-46ff-94ed-edbd423a2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:12.051894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 681/1373] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:43:12.662064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90889255-2fb1-458a-80e0-7c00698bd459 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:12.663009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90889255-2fb1-458a-80e0-7c00698bd459 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:12.663948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90889255-2fb1-458a-80e0-7c00698bd459 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:12.664839 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 693/1374] 10.222.0.78 () {54 vars in 964 bytes} [Sun Aug 28 19:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:12.670076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656bd2-ec8f-44fd-a1f0-53885dba24d3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:12.670847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656bd2-ec8f-44fd-a1f0-53885dba24d3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:12.670847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656bd2-ec8f-44fd-a1f0-53885dba24d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:12.771260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-59656bd2-ec8f-44fd-a1f0-53885dba24d3 None None] MFA Rules not processed for user `53cb76d30b8a4dc7961464c640315123`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:12.772863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-59656bd2-ec8f-44fd-a1f0-53885dba24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:12.797243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:12.867415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 682/1375] 10.222.0.78 () {58 vars in 1061 bytes} [Sun Aug 28 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:12.875013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90889255-2fb1-458a-80e0-7c00698bd459 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:12.876551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90889255-2fb1-458a-80e0-7c00698bd459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:13.002510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90889255-2fb1-458a-80e0-7c00698bd459 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:13.014452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:13.099674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:13.100892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:13.101366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:13.101635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:13.103637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:13.257890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:13.259454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778d925-8d62-4a0e-863f-8cc9a9d8d84f service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:13.283159 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 694/1376] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:13.907354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103bcd-b433-4c78-9405-ffeae5b99d2d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:13.907354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103bcd-b433-4c78-9405-ffeae5b99d2d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:13.910001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103bcd-b433-4c78-9405-ffeae5b99d2d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:13.910001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 683/1377] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:13.917330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b255-dff8-4847-8f79-74c3b8019351 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:13.917887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b255-dff8-4847-8f79-74c3b8019351 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:13.918331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b255-dff8-4847-8f79-74c3b8019351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:13.976222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:14.003360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8115b255-dff8-4847-8f79-74c3b8019351 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:14.003596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8115b255-dff8-4847-8f79-74c3b8019351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:14.118277 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 695/1378] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:14.420876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103bcd-b433-4c78-9405-ffeae5b99d2d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:14.423030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73103bcd-b433-4c78-9405-ffeae5b99d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:14.611037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103bcd-b433-4c78-9405-ffeae5b99d2d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:14.645468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:14.752387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:14.752914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:14.753328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:14.753606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:14.755404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:14.876290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:14.877480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0753-f010-4a37-9586-780a85df700e service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:14.899296 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 684/1379] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:43:17.237940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669ad7-6127-4a8c-ae96-0af0e4d9e53c None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:17.238497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669ad7-6127-4a8c-ae96-0af0e4d9e53c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:17.238497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669ad7-6127-4a8c-ae96-0af0e4d9e53c None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:17.239856 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 696/1380] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:17.246286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759883f-c957-4aa4-b4e7-b99a6dab5ceb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:17.246751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759883f-c957-4aa4-b4e7-b99a6dab5ceb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:17.246856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759883f-c957-4aa4-b4e7-b99a6dab5ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:17.293368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:17.327656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e759883f-c957-4aa4-b4e7-b99a6dab5ceb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:17.329088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e759883f-c957-4aa4-b4e7-b99a6dab5ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:17.470008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 685/1381] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:17.802461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669ad7-6127-4a8c-ae96-0af0e4d9e53c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:17.804669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f7669ad7-6127-4a8c-ae96-0af0e4d9e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:18.005622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:18.065773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669ad7-6127-4a8c-ae96-0af0e4d9e53c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:18.223318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:18.224153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:18.224585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:18.226009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:18.227853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:18.323343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:18.344626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:18.346892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080acfa-fee1-4190-9799-90b198bf7037 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:18.377610 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 697/1382] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:43:20.694719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221282-5d7a-48d3-a2e5-d50d936625ba None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:20.695434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221282-5d7a-48d3-a2e5-d50d936625ba None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:20.695434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221282-5d7a-48d3-a2e5-d50d936625ba None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:20.702126 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 686/1383] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:20.705115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbccf-1830-480e-a8ff-ebfb62660e0f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:20.705630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbccf-1830-480e-a8ff-ebfb62660e0f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:20.705730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbccf-1830-480e-a8ff-ebfb62660e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:20.786692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6a4dbccf-1830-480e-a8ff-ebfb62660e0f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:20.788586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6a4dbccf-1830-480e-a8ff-ebfb62660e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:20.927874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 698/1384] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:43:21.227219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221282-5d7a-48d3-a2e5-d50d936625ba None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:21.227219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-41221282-5d7a-48d3-a2e5-d50d936625ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:21.363317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:21.421448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221282-5d7a-48d3-a2e5-d50d936625ba None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:21.570833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:21.571452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:21.571738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:21.572011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:21.573661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:21.657804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:21.677019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:21.679373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2f7fe-ccdd-4fbb-afe1-b4e2b5e3a413 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:21.700871 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 687/1385] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:24.313640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c5779-9de3-49b4-bdcd-55ccc12a1be4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:24.323765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c5779-9de3-49b4-bdcd-55ccc12a1be4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:24.323765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c5779-9de3-49b4-bdcd-55ccc12a1be4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:24.323765 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 699/1386] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:24.324182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e830cac-9a79-4b06-8ecf-83fa01027dc1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:24.324182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e830cac-9a79-4b06-8ecf-83fa01027dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:24.324182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e830cac-9a79-4b06-8ecf-83fa01027dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:24.426255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4e830cac-9a79-4b06-8ecf-83fa01027dc1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:24.428154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e830cac-9a79-4b06-8ecf-83fa01027dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:24.561365 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 688/1387] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:24.871645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c5779-9de3-49b4-bdcd-55ccc12a1be4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:24.873249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e03c5779-9de3-49b4-bdcd-55ccc12a1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:24.941499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:25.095958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c5779-9de3-49b4-bdcd-55ccc12a1be4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:25.250568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:25.251188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:25.251513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:25.251792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:25.253428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:25.268178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:25.379277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:25.381485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac59f4-e9fb-4e1c-94c2-b30ea2624c8d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:25.404231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 700/1388] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:27.830025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7588-3df4-4e2c-82c1-7bcd3ddc341a None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:27.830672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7588-3df4-4e2c-82c1-7bcd3ddc341a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:27.830672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7588-3df4-4e2c-82c1-7bcd3ddc341a None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:27.832108 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 689/1389] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:27.838580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9cb0-3a19-4c1f-ac97-89dc87320293 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:27.839492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9cb0-3a19-4c1f-ac97-89dc87320293 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:27.839492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9cb0-3a19-4c1f-ac97-89dc87320293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:27.947511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7c8d9cb0-3a19-4c1f-ac97-89dc87320293 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:27.950317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7c8d9cb0-3a19-4c1f-ac97-89dc87320293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:28.060493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:28.077297 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 701/1390] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:28.374215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7588-3df4-4e2c-82c1-7bcd3ddc341a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:28.375936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5c8a7588-3df4-4e2c-82c1-7bcd3ddc341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:28.439084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:28.550260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7588-3df4-4e2c-82c1-7bcd3ddc341a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:28.679298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:28.679923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:28.680206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:28.680478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:28.682232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:28.701918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:28.794133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:28.795770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b39e4-25c3-4e36-8453-cb98cfee3802 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:28.818729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 690/1391] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:29.973490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e30e-660e-47dc-ae6b-0ab534b994d8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:29.974655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e30e-660e-47dc-ae6b-0ab534b994d8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:29.974801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e30e-660e-47dc-ae6b-0ab534b994d8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:29.976254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 702/1392] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:29.982529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a710b0-4e88-4b66-bdec-78692ece8125 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:29.983105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a710b0-4e88-4b66-bdec-78692ece8125 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:29.983105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a710b0-4e88-4b66-bdec-78692ece8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:30.061494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-97a710b0-4e88-4b66-bdec-78692ece8125 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:30.063562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-97a710b0-4e88-4b66-bdec-78692ece8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:30.170171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:30.183318 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 691/1393] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:30.487306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351685-4556-476a-9af2-6f3602f108a3 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:30.487593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351685-4556-476a-9af2-6f3602f108a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:30.487871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351685-4556-476a-9af2-6f3602f108a3 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:30.489231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 703/1394] 10.222.0.78 () {54 vars in 967 bytes} [Sun Aug 28 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:30.494640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881fe0b-7505-4b10-838a-ed9b9670b362 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:30.494957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881fe0b-7505-4b10-838a-ed9b9670b362 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:30.495230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881fe0b-7505-4b10-838a-ed9b9670b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:30.591076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9881fe0b-7505-4b10-838a-ed9b9670b362 None None] MFA Rules not processed for user `2c178aac643a48d48f2707b407ffa65f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:30.600690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9881fe0b-7505-4b10-838a-ed9b9670b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:30.684820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 692/1395] 10.222.0.78 () {58 vars in 1064 bytes} [Sun Aug 28 19:43:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:30.692689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351685-4556-476a-9af2-6f3602f108a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:30.694849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-51351685-4556-476a-9af2-6f3602f108a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:30.815657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351685-4556-476a-9af2-6f3602f108a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:30.903281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:30.903972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:30.904248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:30.904515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:30.906275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:30.963668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:31.016857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6fac8-7632-4763-95ba-d326063e215e None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:31.017448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6fac8-7632-4763-95ba-d326063e215e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:31.017448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6fac8-7632-4763-95ba-d326063e215e None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:31.018666 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 693/1396] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:31.024399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c526a4-3277-458e-9262-933c74ef75ec None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:31.024687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c526a4-3277-458e-9262-933c74ef75ec None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:31.024965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c526a4-3277-458e-9262-933c74ef75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:31.042598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:31.044083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:31.067204 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 704/1397] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:31.120271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-71c526a4-3277-458e-9262-933c74ef75ec None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:31.121899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-71c526a4-3277-458e-9262-933c74ef75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:31.158194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:31.242389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 694/1398] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:43:31.549700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:31.550947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:31.660261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41e1c-9e95-4442-8843-97d89ef55bde service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:31.717263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:31.791499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:31.792050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:31.792333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:31.792638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:31.794436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:31.904066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:31.905699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127658-628d-459b-81eb-5008451eb0f2 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:31.926092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 705/1399] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:32.003263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4329-5d7e-4c35-9c5b-037becdebf9b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:32.006333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4329-5d7e-4c35-9c5b-037becdebf9b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:32.006333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4329-5d7e-4c35-9c5b-037becdebf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:32.077270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7f8a4329-5d7e-4c35-9c5b-037becdebf9b None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:32.083753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f8a4329-5d7e-4c35-9c5b-037becdebf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:32.193565 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 695/1400] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:43:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:32.247899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a05f-056c-4183-9349-4f19877c5c30 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:32.248656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a05f-056c-4183-9349-4f19877c5c30 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:32.248656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a05f-056c-4183-9349-4f19877c5c30 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:32.250030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 706/1401] 10.222.0.78 () {54 vars in 943 bytes} [Sun Aug 28 19:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:32.258039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae130-22f9-4e55-b4eb-2de96c3d9a75 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:32.258525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae130-22f9-4e55-b4eb-2de96c3d9a75 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:32.258663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae130-22f9-4e55-b4eb-2de96c3d9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:32.294593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:32.345677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-900ae130-22f9-4e55-b4eb-2de96c3d9a75 None None] MFA Rules not processed for user `1120d09d46e5416a9257f2a40da688d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:32.346936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-900ae130-22f9-4e55-b4eb-2de96c3d9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:32.481504 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 696/1402] 10.222.0.78 () {58 vars in 1040 bytes} [Sun Aug 28 19:43:32 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:32.491873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a05f-056c-4183-9349-4f19877c5c30 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:32.493550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6416a05f-056c-4183-9349-4f19877c5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:32.562145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:32.650037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a05f-056c-4183-9349-4f19877c5c30 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:32.770147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:32.771377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:32.771767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:32.771964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:32.773612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:32.824165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:32.877214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:32.881090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cda968-1c64-45cc-a904-a9c40323282a service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:32.892884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 707/1403] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:43:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:43:34.078988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d568-5f70-43b0-90f3-cefea0f2ac05 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:34.079563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d568-5f70-43b0-90f3-cefea0f2ac05 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:34.079563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d568-5f70-43b0-90f3-cefea0f2ac05 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:34.080922 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 697/1404] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:34.087051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69352c2-f02c-4ef2-bc82-3ecdea992b7a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:34.087546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69352c2-f02c-4ef2-bc82-3ecdea992b7a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:34.087734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69352c2-f02c-4ef2-bc82-3ecdea992b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:34.159138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e69352c2-f02c-4ef2-bc82-3ecdea992b7a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:34.160426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e69352c2-f02c-4ef2-bc82-3ecdea992b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:34.276786 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 708/1405] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:34.584258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d568-5f70-43b0-90f3-cefea0f2ac05 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:34.586010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a3c4d568-5f70-43b0-90f3-cefea0f2ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:34.704318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:34.798160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d568-5f70-43b0-90f3-cefea0f2ac05 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:34.949283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:34.951934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:34.952533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:34.952820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:34.955138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:35.011202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:35.067986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:35.069975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e3354-cf6e-4f59-a53f-eee67da33996 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:35.091869 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 698/1406] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:37.279605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7fa6a-acc6-4497-a61e-c26aeb36608f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:37.280247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7fa6a-acc6-4497-a61e-c26aeb36608f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:37.280354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7fa6a-acc6-4497-a61e-c26aeb36608f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:37.281666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 709/1407] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:37.289908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981cb40-77e9-45db-a287-6e78ff31142e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:37.290483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981cb40-77e9-45db-a287-6e78ff31142e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:37.291401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981cb40-77e9-45db-a287-6e78ff31142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:37.375761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0981cb40-77e9-45db-a287-6e78ff31142e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:37.377141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0981cb40-77e9-45db-a287-6e78ff31142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:37.497840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 699/1408] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:37.800504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7fa6a-acc6-4497-a61e-c26aeb36608f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:37.802679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4dd7fa6a-acc6-4497-a61e-c26aeb36608f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:37.850340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:38.007664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7fa6a-acc6-4497-a61e-c26aeb36608f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:38.152944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:38.170614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:38.171782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:38.175457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:38.175457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:38.176306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:38.344693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:38.346392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5b810-b76c-4a96-826a-af3748e09fbd service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:38.370278 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 710/1409] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:43:47.495835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:48.367508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=47 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:58.329523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086659cb-cdef-450c-b0b5-7c20f1e34326 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:58.330154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086659cb-cdef-450c-b0b5-7c20f1e34326 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:58.330154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086659cb-cdef-450c-b0b5-7c20f1e34326 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:58.331514 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 700/1410] 10.222.0.78 () {54 vars in 918 bytes} [Sun Aug 28 19:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:58.338016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab92a6-401e-4a36-a6c8-8a00d8ea942f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:58.338591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab92a6-401e-4a36-a6c8-8a00d8ea942f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:58.338591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab92a6-401e-4a36-a6c8-8a00d8ea942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:58.441768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-83ab92a6-401e-4a36-a6c8-8a00d8ea942f None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:58.443057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-83ab92a6-401e-4a36-a6c8-8a00d8ea942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:58.559323 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 711/1411] 10.222.0.78 () {58 vars in 1015 bytes} [Sun Aug 28 19:43:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:58.575232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716243eb-4e14-4bf3-a8b6-8e3d5a4d1ec0 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:58.575493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716243eb-4e14-4bf3-a8b6-8e3d5a4d1ec0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:58.575763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716243eb-4e14-4bf3-a8b6-8e3d5a4d1ec0 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:58.577141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 701/1412] 10.222.0.78 () {54 vars in 918 bytes} [Sun Aug 28 19:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:58.583725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32f83-8868-44d9-9314-44904cb0e9cc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:58.583934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32f83-8868-44d9-9314-44904cb0e9cc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:58.584198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32f83-8868-44d9-9314-44904cb0e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:58.663863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:58.667113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e9a32f83-8868-44d9-9314-44904cb0e9cc None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:58.668342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e9a32f83-8868-44d9-9314-44904cb0e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:58.794640 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 712/1413] 10.222.0.78 () {58 vars in 1015 bytes} [Sun Aug 28 19:43:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:01.248606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd80ad-9553-4acb-abb1-f910074ca40e None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:01.249235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd80ad-9553-4acb-abb1-f910074ca40e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:01.249235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd80ad-9553-4acb-abb1-f910074ca40e None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:01.250572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:01.256473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb015a-4883-4efd-8646-dbd6bbbf042f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:01.256986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb015a-4883-4efd-8646-dbd6bbbf042f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:01.256986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb015a-4883-4efd-8646-dbd6bbbf042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:01.330820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b9cb015a-4883-4efd-8646-dbd6bbbf042f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:01.332209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b9cb015a-4883-4efd-8646-dbd6bbbf042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:01.402341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:01.449467 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:01.743098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd80ad-9553-4acb-abb1-f910074ca40e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:01.744747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6fd80ad-9553-4acb-abb1-f910074ca40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:01.918697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd80ad-9553-4acb-abb1-f910074ca40e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:02.012709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:02.060727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:02.061333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:02.061774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:02.062157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:02.063776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:02.162764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:02.164376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1f31-405b-420e-ab87-803eb844d9c2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:02.185711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 703/1416] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:03.106994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01730-306c-4eab-be33-75b5ef72c48d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:03.107652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01730-306c-4eab-be33-75b5ef72c48d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:03.107652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01730-306c-4eab-be33-75b5ef72c48d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:03.108889 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:03.114264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c2d8-af8d-4247-926d-bfd866750b40 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:03.114784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c2d8-af8d-4247-926d-bfd866750b40 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:03.114784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c2d8-af8d-4247-926d-bfd866750b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:03.198336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3552c2d8-af8d-4247-926d-bfd866750b40 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:03.199582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3552c2d8-af8d-4247-926d-bfd866750b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:03.230281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:03.305476 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:03.498872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e01730-306c-4eab-be33-75b5ef72c48d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:03.500376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9e01730-306c-4eab-be33-75b5ef72c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:03.658315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e01730-306c-4eab-be33-75b5ef72c48d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:03.704764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:03.782250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:03.782776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:03.783059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:03.783331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:03.784946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:03.892591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:03.894250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97fff4-cadc-4675-90cf-e7647cc51349 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:03.915811 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 715/1419] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:04.824439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583be87-7c74-44a2-ab59-0c9bf2077c66 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:04.824979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583be87-7c74-44a2-ab59-0c9bf2077c66 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:04.824979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583be87-7c74-44a2-ab59-0c9bf2077c66 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:04.826458 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:04.831655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557e8a-bde1-42e8-be8e-4f44bdd87780 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:04.832188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557e8a-bde1-42e8-be8e-4f44bdd87780 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:04.832299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557e8a-bde1-42e8-be8e-4f44bdd87780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:04.900809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:04.924417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d0557e8a-bde1-42e8-be8e-4f44bdd87780 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:04.925674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0557e8a-bde1-42e8-be8e-4f44bdd87780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:05.033619 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:05.186880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583be87-7c74-44a2-ab59-0c9bf2077c66 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:05.188417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8583be87-7c74-44a2-ab59-0c9bf2077c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:05.346450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583be87-7c74-44a2-ab59-0c9bf2077c66 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:05.359560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:05.469045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:05.469564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:05.469844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:05.470145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:05.471746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:05.567626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:05.569330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364ace-2807-4f44-949f-cb2acfe3cd73 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:05.592830 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 706/1422] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:06.470641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa086d5b-4aa3-4da9-b433-1f7c6b045d8f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:06.471214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa086d5b-4aa3-4da9-b433-1f7c6b045d8f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:06.471214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa086d5b-4aa3-4da9-b433-1f7c6b045d8f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:06.472539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:06.478681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907fd4-f5d3-47f5-b90c-570e3f55bf85 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:06.479165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907fd4-f5d3-47f5-b90c-570e3f55bf85 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:06.479279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907fd4-f5d3-47f5-b90c-570e3f55bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:06.501452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:06.569322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6c907fd4-f5d3-47f5-b90c-570e3f55bf85 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:06.570573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c907fd4-f5d3-47f5-b90c-570e3f55bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:06.681520 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:06.835659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa086d5b-4aa3-4da9-b433-1f7c6b045d8f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:06.837216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-aa086d5b-4aa3-4da9-b433-1f7c6b045d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:06.954356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:06.995008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa086d5b-4aa3-4da9-b433-1f7c6b045d8f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:07.111233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:07.111844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:07.112129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:07.112404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:07.114688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:07.201879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:07.218864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:07.220679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf631456-bb79-4769-90b2-c965ca440474 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:07.242713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 718/1425] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:44:08.163344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731975a2-fd3e-4724-9c69-9a4c70155746 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.163946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731975a2-fd3e-4724-9c69-9a4c70155746 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.163946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731975a2-fd3e-4724-9c69-9a4c70155746 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.165295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:08.170620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb7fa-d9a3-402a-9623-a818900b94db None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.171141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb7fa-d9a3-402a-9623-a818900b94db None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.171255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb7fa-d9a3-402a-9623-a818900b94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.252565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a5bdb7fa-d9a3-402a-9623-a818900b94db None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:08.253795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5bdb7fa-d9a3-402a-9623-a818900b94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:08.373936 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:44:08.531777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731975a2-fd3e-4724-9c69-9a4c70155746 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:08.533287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-731975a2-fd3e-4724-9c69-9a4c70155746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:08.626953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:08.694224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731975a2-fd3e-4724-9c69-9a4c70155746 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:08.812034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:08.812611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.812889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.813157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.814829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:08.866366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:08.908570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:08.911316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796dc91-3e1b-4d45-97ea-8e30fa2d447a service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:08.932261 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 709/1428] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:09.847905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fb27a-6716-4196-8127-b4bb8556522b None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.848541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fb27a-6716-4196-8127-b4bb8556522b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.848541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fb27a-6716-4196-8127-b4bb8556522b None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.849795 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:09.855694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994858-d2a7-48f5-88e7-c6f51c403db1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.856346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994858-d2a7-48f5-88e7-c6f51c403db1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.856346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994858-d2a7-48f5-88e7-c6f51c403db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.939196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9a994858-d2a7-48f5-88e7-c6f51c403db1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:09.940518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9a994858-d2a7-48f5-88e7-c6f51c403db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:10.047321 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:10.201411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fb27a-6716-4196-8127-b4bb8556522b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:10.203035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d40fb27a-6716-4196-8127-b4bb8556522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:10.256228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:10.368717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fb27a-6716-4196-8127-b4bb8556522b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:10.504874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:10.505745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:10.506058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:10.506329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:10.507996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:10.515184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:10.614091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:10.615700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ef7e-4f61-40f8-b05c-cdfd854ec427 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:10.634865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 721/1431] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:11.517289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df451-db72-440a-875c-ad511380508d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:11.518050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df451-db72-440a-875c-ad511380508d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:11.518050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df451-db72-440a-875c-ad511380508d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:11.519272 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:11.524660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81c6c5-6b38-401c-97b6-b16b94a3f882 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:11.525179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81c6c5-6b38-401c-97b6-b16b94a3f882 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:11.525179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81c6c5-6b38-401c-97b6-b16b94a3f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:11.607494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0e81c6c5-6b38-401c-97b6-b16b94a3f882 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:11.608643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0e81c6c5-6b38-401c-97b6-b16b94a3f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:11.678148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:11.707267 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:11.863951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df451-db72-440a-875c-ad511380508d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:11.865391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-128df451-db72-440a-875c-ad511380508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:11.884490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:12.032140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df451-db72-440a-875c-ad511380508d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:12.125831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:12.152517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:12.153117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:12.153453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:12.153743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:12.156025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:12.264076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:12.265740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59e56c-2372-49f5-92d7-36519db43990 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:12.285651 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 712/1434] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:13.172132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd79f7-5994-4ed0-8e07-0b5e4102d7ec None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:13.172855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd79f7-5994-4ed0-8e07-0b5e4102d7ec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:13.172855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd79f7-5994-4ed0-8e07-0b5e4102d7ec None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:13.174320 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:13.180461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a145-07f9-4f7e-890c-412e65f29888 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:13.180987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a145-07f9-4f7e-890c-412e65f29888 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:13.180987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a145-07f9-4f7e-890c-412e65f29888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:13.269927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a291a145-07f9-4f7e-890c-412e65f29888 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:13.271189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a291a145-07f9-4f7e-890c-412e65f29888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:13.319345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:13.391159 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:13.550700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd79f7-5994-4ed0-8e07-0b5e4102d7ec None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:13.552838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-acfd79f7-5994-4ed0-8e07-0b5e4102d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:13.734238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd79f7-5994-4ed0-8e07-0b5e4102d7ec None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:13.793335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:13.856687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:13.857201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:13.857486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:13.857757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:13.859398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:13.956346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:13.958061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce7d6d-27a0-4abc-b782-91bb27d60994 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:13.978240 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 724/1437] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:14.891021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456f3d-5731-4655-bed4-ee9949170770 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:14.891567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456f3d-5731-4655-bed4-ee9949170770 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:14.891567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456f3d-5731-4655-bed4-ee9949170770 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:14.892939 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:14.898273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4306ea2-e3af-49d4-89a3-56a882ecf0b9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:14.898931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4306ea2-e3af-49d4-89a3-56a882ecf0b9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:14.898931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4306ea2-e3af-49d4-89a3-56a882ecf0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:14.982895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a4306ea2-e3af-49d4-89a3-56a882ecf0b9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:14.984245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a4306ea2-e3af-49d4-89a3-56a882ecf0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:14.986385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:15.088423 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:15.242332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1456f3d-5731-4655-bed4-ee9949170770 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:15.243781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1456f3d-5731-4655-bed4-ee9949170770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:15.416975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1456f3d-5731-4655-bed4-ee9949170770 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:15.449634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:15.542848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:15.543384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:15.543643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:15.543915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:15.545509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:15.644233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:15.646519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a5df3-f652-47e6-a9f2-08cc79b42915 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:15.670033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 715/1440] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:17.564773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa4ae9-deda-4350-81da-0cecee50ec59 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:17.565407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa4ae9-deda-4350-81da-0cecee50ec59 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:17.565407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa4ae9-deda-4350-81da-0cecee50ec59 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:17.567260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:17.572897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4840-86ce-406a-bc2a-a891b530fe65 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:17.573360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4840-86ce-406a-bc2a-a891b530fe65 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:17.573492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4840-86ce-406a-bc2a-a891b530fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:17.620646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:17.649288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6f0d4840-86ce-406a-bc2a-a891b530fe65 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:17.650499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6f0d4840-86ce-406a-bc2a-a891b530fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:17.751884 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:44:18.049544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa4ae9-deda-4350-81da-0cecee50ec59 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:18.051288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54aa4ae9-deda-4350-81da-0cecee50ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:18.162835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa4ae9-deda-4350-81da-0cecee50ec59 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:18.197061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:18.240476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:18.241096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:18.241378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:18.241651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:18.243360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:18.367360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:18.368805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3e1b3-bfb2-414c-9025-33f116e379c7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:18.388920 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 727/1443] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:20.505647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545ee23-0195-43d8-a064-ba0fd2eca929 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:20.506236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545ee23-0195-43d8-a064-ba0fd2eca929 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:20.506236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545ee23-0195-43d8-a064-ba0fd2eca929 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:20.507595 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:44:20.513142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d911c41-f7e0-4b92-a8eb-5a4caee7bb1b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:20.513655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d911c41-f7e0-4b92-a8eb-5a4caee7bb1b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:20.513765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d911c41-f7e0-4b92-a8eb-5a4caee7bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:20.587730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4d911c41-f7e0-4b92-a8eb-5a4caee7bb1b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:20.589077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4d911c41-f7e0-4b92-a8eb-5a4caee7bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:20.605963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:20.830155 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:21.122951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545ee23-0195-43d8-a064-ba0fd2eca929 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:21.124571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d545ee23-0195-43d8-a064-ba0fd2eca929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:21.240580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545ee23-0195-43d8-a064-ba0fd2eca929 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:21.255907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:21.357660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:21.358302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:21.358582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:21.358850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:21.360494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:21.480258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:21.481618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edb3ea-569c-48e9-8b61-ab6b0fdb7660 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:21.501554 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 718/1446] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:44:23.889843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d1423-1dd8-43d2-ad7d-32fa99b7a48b None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:23.890476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d1423-1dd8-43d2-ad7d-32fa99b7a48b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:23.890476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d1423-1dd8-43d2-ad7d-32fa99b7a48b None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:23.891766 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:23.898051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d71a2-9542-4883-9609-1341f8ed4df7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:23.898536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d71a2-9542-4883-9609-1341f8ed4df7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:23.898646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d71a2-9542-4883-9609-1341f8ed4df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:23.950650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:23.971930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-575d71a2-9542-4883-9609-1341f8ed4df7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:23.973727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-575d71a2-9542-4883-9609-1341f8ed4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:24.082385 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:24.373230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d1423-1dd8-43d2-ad7d-32fa99b7a48b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:24.374813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8f3d1423-1dd8-43d2-ad7d-32fa99b7a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:24.493652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d1423-1dd8-43d2-ad7d-32fa99b7a48b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:24.538897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:24.576626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:24.577233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:24.577552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:24.577779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:24.579439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:24.702271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:24.703719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7daecb-81fc-4be1-a026-7be038ab8532 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:24.728303 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 730/1449] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:26.858337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea683d-a80b-4560-81f0-8d406e0d9538 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:26.859063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea683d-a80b-4560-81f0-8d406e0d9538 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:26.859063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea683d-a80b-4560-81f0-8d406e0d9538 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:26.860496 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:26.867195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c150-9371-4501-bdce-7d886f7e5016 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:26.867717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c150-9371-4501-bdce-7d886f7e5016 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:26.867717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c150-9371-4501-bdce-7d886f7e5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:26.945205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e8d8c150-9371-4501-bdce-7d886f7e5016 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:26.946410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e8d8c150-9371-4501-bdce-7d886f7e5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:26.968723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:27.049239 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:27.343477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea683d-a80b-4560-81f0-8d406e0d9538 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:27.343477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-41ea683d-a80b-4560-81f0-8d406e0d9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:27.451620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea683d-a80b-4560-81f0-8d406e0d9538 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:27.473293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:27.539116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:27.539635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:27.539914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:27.540188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:27.541800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:27.657656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:27.659138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396d18b-7ec4-42a2-9ea7-0d6e3d026b43 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:27.677962 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 721/1452] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:29.708211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4326f-1f17-4431-88a4-2fece2795bd6 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:29.708905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4326f-1f17-4431-88a4-2fece2795bd6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:29.708905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4326f-1f17-4431-88a4-2fece2795bd6 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:29.710879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:29.716789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6771-a263-4d1a-9916-81e6cf9f19fb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:29.717299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6771-a263-4d1a-9916-81e6cf9f19fb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:29.717405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6771-a263-4d1a-9916-81e6cf9f19fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:29.788612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:29.791710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-73fc6771-a263-4d1a-9916-81e6cf9f19fb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:29.792939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73fc6771-a263-4d1a-9916-81e6cf9f19fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:29.905017 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:30.190538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4326f-1f17-4431-88a4-2fece2795bd6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:30.193314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-33b4326f-1f17-4431-88a4-2fece2795bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:30.328815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4326f-1f17-4431-88a4-2fece2795bd6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:30.379749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:30.405437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:30.406087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:30.406398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:30.406671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:30.408297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:30.523946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:30.526237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75f7f6-01aa-415e-ba78-fc41ce6d127c service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:30.552216 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 733/1455] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:32.582613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc5d4-dbee-42c1-bbc5-bd985087ff8d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:32.583143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc5d4-dbee-42c1-bbc5-bd985087ff8d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:32.583258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc5d4-dbee-42c1-bbc5-bd985087ff8d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:32.584597 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:32.589999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da836-faa6-4f2a-b260-290409ca556c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:32.590436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da836-faa6-4f2a-b260-290409ca556c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:32.590535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da836-faa6-4f2a-b260-290409ca556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:32.662416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-274da836-faa6-4f2a-b260-290409ca556c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:32.663057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-274da836-faa6-4f2a-b260-290409ca556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:32.694355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:32.764450 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:33.053986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bc5d4-dbee-42c1-bbc5-bd985087ff8d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:33.055539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b3bc5d4-dbee-42c1-bbc5-bd985087ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:33.168307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bc5d4-dbee-42c1-bbc5-bd985087ff8d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:33.198779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:33.246347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:33.247304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:33.247588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:33.247855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:33.249526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:33.367757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:33.369199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eb1b2-d428-4536-88ea-0b724eac6b5c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:33.388599 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 724/1458] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:35.387981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9956-989d-4a45-844e-b4bd219ec718 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:35.388675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9956-989d-4a45-844e-b4bd219ec718 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:35.388675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9956-989d-4a45-844e-b4bd219ec718 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:35.390024 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:35.396793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735a695-819a-4f92-b9dc-68965624a8f6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:35.397374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735a695-819a-4f92-b9dc-68965624a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:35.397531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735a695-819a-4f92-b9dc-68965624a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:35.467422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d735a695-819a-4f92-b9dc-68965624a8f6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:35.468639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d735a695-819a-4f92-b9dc-68965624a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:35.477557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:35.580394 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:35.866079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9956-989d-4a45-844e-b4bd219ec718 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:35.867645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8fde9956-989d-4a45-844e-b4bd219ec718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:35.980552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9956-989d-4a45-844e-b4bd219ec718 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:36.043004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:36.063622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:36.064235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:36.064514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:36.064780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:36.066435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:36.196595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:36.198783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fe5c-286c-4dd3-88ed-3c887f9dcec2 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:36.219407 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 736/1461] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:38.260185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907403c-29ba-44d6-a54d-01f67b654998 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:38.260822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907403c-29ba-44d6-a54d-01f67b654998 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:38.260822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907403c-29ba-44d6-a54d-01f67b654998 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:38.262137 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:38.267902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996294be-6981-4a3d-bf3a-d2b4bff26353 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:38.268492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996294be-6981-4a3d-bf3a-d2b4bff26353 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:38.268492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996294be-6981-4a3d-bf3a-d2b4bff26353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:38.342103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-996294be-6981-4a3d-bf3a-d2b4bff26353 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:38.343351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-996294be-6981-4a3d-bf3a-d2b4bff26353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:38.393588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:38.455979 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:44:38.739291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907403c-29ba-44d6-a54d-01f67b654998 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:38.740850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2907403c-29ba-44d6-a54d-01f67b654998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:38.860112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907403c-29ba-44d6-a54d-01f67b654998 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:38.905421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:38.944318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:38.944838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:38.945118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:38.945525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:38.947067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:39.066043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:39.067577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f028f7-6c67-4a8e-ae92-2063e5f28ff9 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:39.089748 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 727/1464] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:41.032905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75b09f-fb50-4657-9fe4-95291c300fe7 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:41.033468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75b09f-fb50-4657-9fe4-95291c300fe7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:41.033468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75b09f-fb50-4657-9fe4-95291c300fe7 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:41.035326 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:41.041054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7c7bf-308e-48bb-b55b-d5b39a1f1915 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:41.041518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7c7bf-308e-48bb-b55b-d5b39a1f1915 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:41.041637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7c7bf-308e-48bb-b55b-d5b39a1f1915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:41.113210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-85b7c7bf-308e-48bb-b55b-d5b39a1f1915 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:41.114588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-85b7c7bf-308e-48bb-b55b-d5b39a1f1915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:41.134930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:41.217828 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:41.504542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75b09f-fb50-4657-9fe4-95291c300fe7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:41.506552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ca75b09f-fb50-4657-9fe4-95291c300fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:41.618816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75b09f-fb50-4657-9fe4-95291c300fe7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:41.689023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:41.696582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:41.700522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:41.700522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:41.700522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:41.700522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:41.819515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:41.820952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14caf21-0732-4547-8db6-93635c73a730 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:41.842039 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 739/1467] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:43.797523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576b33-96e2-4a2c-9a77-832a8d55ffe9 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:43.798114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576b33-96e2-4a2c-9a77-832a8d55ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:43.798114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576b33-96e2-4a2c-9a77-832a8d55ffe9 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:43.799408 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:44:43.805025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2605d4c-ea78-41d1-9307-c90cdcd2c989 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:43.805516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2605d4c-ea78-41d1-9307-c90cdcd2c989 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:43.805668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2605d4c-ea78-41d1-9307-c90cdcd2c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:43.874775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a2605d4c-ea78-41d1-9307-c90cdcd2c989 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:43.876004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a2605d4c-ea78-41d1-9307-c90cdcd2c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:43.929542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:43.981642 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:44.267570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23576b33-96e2-4a2c-9a77-832a8d55ffe9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:44.274785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-23576b33-96e2-4a2c-9a77-832a8d55ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:44.395834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23576b33-96e2-4a2c-9a77-832a8d55ffe9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:44.459675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:44.489393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:44.490046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:44.490326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:44.495221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:44.495221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:44.624730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:44.626219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664b72-5eec-432c-8737-b7bd7162ab02 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:44.647607 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 730/1470] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:44:53.980508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=22 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:54.644821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=66 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:05.982534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5bce9-cf46-425f-b261-eed39111b1bb None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:05.983132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5bce9-cf46-425f-b261-eed39111b1bb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:05.983132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5bce9-cf46-425f-b261-eed39111b1bb None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:05.984512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 741/1471] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:45:05.991030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b264a9-421c-4e8a-a061-8d6faf3371c6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:05.991557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b264a9-421c-4e8a-a061-8d6faf3371c6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:05.991652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b264a9-421c-4e8a-a061-8d6faf3371c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:06.063968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-44b264a9-421c-4e8a-a061-8d6faf3371c6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:06.065209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-44b264a9-421c-4e8a-a061-8d6faf3371c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:06.167707 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 731/1472] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:06.473066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c3d7-8f20-4c71-81fe-20d7a15b8bf3 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:06.473352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c3d7-8f20-4c71-81fe-20d7a15b8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:06.473631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c3d7-8f20-4c71-81fe-20d7a15b8bf3 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:06.475348 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 742/1473] 10.222.0.78 () {54 vars in 967 bytes} [Sun Aug 28 19:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:45:06.480602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2b42-97d2-4e51-9d7c-1dc6b27e56aa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:06.480886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2b42-97d2-4e51-9d7c-1dc6b27e56aa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:06.481161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2b42-97d2-4e51-9d7c-1dc6b27e56aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:06.565682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-44cf2b42-97d2-4e51-9d7c-1dc6b27e56aa None None] MFA Rules not processed for user `2c178aac643a48d48f2707b407ffa65f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:06.566938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-44cf2b42-97d2-4e51-9d7c-1dc6b27e56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:06.588466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:06.647837 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 732/1474] 10.222.0.78 () {58 vars in 1064 bytes} [Sun Aug 28 19:45:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:06.655451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c3d7-8f20-4c71-81fe-20d7a15b8bf3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:06.656984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d719c3d7-8f20-4c71-81fe-20d7a15b8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:06.775520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c3d7-8f20-4c71-81fe-20d7a15b8bf3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:06.867544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:06.868168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:06.868446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:06.868714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:06.870409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:06.931813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:06.991759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:06.993193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e43ee-3cd7-474a-9c45-b6bcbe6fcdee service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:07.012959 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 743/1475] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:09.043583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e366-502b-4396-b020-2cea00fb55cd None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:09.044111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e366-502b-4396-b020-2cea00fb55cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:09.044111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e366-502b-4396-b020-2cea00fb55cd None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:09.045394 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 733/1476] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:45:09.051127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1ae3f-1aa6-486f-84a1-656c29513aa8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:09.051598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1ae3f-1aa6-486f-84a1-656c29513aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:09.051714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1ae3f-1aa6-486f-84a1-656c29513aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:09.131803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dfd1ae3f-1aa6-486f-84a1-656c29513aa8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:09.134078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dfd1ae3f-1aa6-486f-84a1-656c29513aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:09.256431 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 744/1477] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:09.532660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e366-502b-4396-b020-2cea00fb55cd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:09.534686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b72e366-502b-4396-b020-2cea00fb55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:09.688675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e366-502b-4396-b020-2cea00fb55cd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:09.742667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:09.788990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:09.789610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:09.789913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:09.790184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:09.790825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:09.793080 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:45:09.793080 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:45:09.793080 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:45:09.794406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70bb49-a301-419c-b6fb-8c7304288b9a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:09.817429 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 734/1478] 10.222.0.78 () {56 vars in 1108 bytes} [Sun Aug 28 19:45:09 2022] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:45:11.819407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7eb89-a5c3-46d4-9bb0-402e887d5f31 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:11.819974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7eb89-a5c3-46d4-9bb0-402e887d5f31 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:11.819974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7eb89-a5c3-46d4-9bb0-402e887d5f31 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:11.821379 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 745/1479] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:45:11.826875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557ac7-fe22-4644-b9c0-ee699e0becb7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:11.827357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557ac7-fe22-4644-b9c0-ee699e0becb7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:11.827459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557ac7-fe22-4644-b9c0-ee699e0becb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:11.897047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b8557ac7-fe22-4644-b9c0-ee699e0becb7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:11.898313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b8557ac7-fe22-4644-b9c0-ee699e0becb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:12.002724 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 735/1480] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:12.295928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7eb89-a5c3-46d4-9bb0-402e887d5f31 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:12.297465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85c7eb89-a5c3-46d4-9bb0-402e887d5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:12.308159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:12.451206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7eb89-a5c3-46d4-9bb0-402e887d5f31 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:12.536002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:12.571273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:12.571878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:12.572158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:12.572426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:12.574122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:12.666416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:12.668026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc2b46-8744-462f-be8c-1621fd4081fd service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:12.688773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 746/1481] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:14.976511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42d58e-7eef-4f3a-b89a-88edc66022e0 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:14.977018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42d58e-7eef-4f3a-b89a-88edc66022e0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:14.977018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42d58e-7eef-4f3a-b89a-88edc66022e0 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:14.978411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 736/1482] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:45:14.984206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bc52-ed2b-4bc5-8907-51c95579b9c0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:14.984687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bc52-ed2b-4bc5-8907-51c95579b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:14.984687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bc52-ed2b-4bc5-8907-51c95579b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:15.056135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3362bc52-ed2b-4bc5-8907-51c95579b9c0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:15.057381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3362bc52-ed2b-4bc5-8907-51c95579b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:15.106283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:15.160785 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 747/1483] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:15.458319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42d58e-7eef-4f3a-b89a-88edc66022e0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:15.459892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff42d58e-7eef-4f3a-b89a-88edc66022e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:15.492769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:15.597823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42d58e-7eef-4f3a-b89a-88edc66022e0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:15.720047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:15.720567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:15.720840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:15.721112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:15.722760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:15.824431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:15.871095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:15.872723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d3e71-24b1-4527-b9d2-db868321495b service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:15.895401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 737/1484] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:45:17.967089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093deda-9745-4595-af83-91af14a767a7 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:17.967784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093deda-9745-4595-af83-91af14a767a7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:17.968126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093deda-9745-4595-af83-91af14a767a7 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:17.970003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 748/1485] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:45:17.976915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002eee-3d99-4960-a382-18443e8f1efb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:17.977458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002eee-3d99-4960-a382-18443e8f1efb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:17.977458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002eee-3d99-4960-a382-18443e8f1efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:18.057542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-50002eee-3d99-4960-a382-18443e8f1efb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:18.058809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-50002eee-3d99-4960-a382-18443e8f1efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:18.167907 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 738/1486] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:45:18.475039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093deda-9745-4595-af83-91af14a767a7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:18.476589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d093deda-9745-4595-af83-91af14a767a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:18.608849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093deda-9745-4595-af83-91af14a767a7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:18.687168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:18.690043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:18.690664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:18.690962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:18.691250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:18.692892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:18.820622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:18.821992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499a1ea-aaf4-4307-acc8-a7b64197188d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:18.840966 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 749/1487] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:20.939190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a2271-05a9-4474-a02e-6436790a84cc None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:20.940455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a2271-05a9-4474-a02e-6436790a84cc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:20.940455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a2271-05a9-4474-a02e-6436790a84cc None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:20.941990 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 739/1488] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:45:20.950787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954dfa3-0af6-4d4b-9a40-016f9e9725ff None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:20.951325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954dfa3-0af6-4d4b-9a40-016f9e9725ff None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:20.951325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954dfa3-0af6-4d4b-9a40-016f9e9725ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:21.028689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c954dfa3-0af6-4d4b-9a40-016f9e9725ff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:21.030002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c954dfa3-0af6-4d4b-9a40-016f9e9725ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:21.109831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:21.160247 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 750/1489] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:21.470333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a2271-05a9-4474-a02e-6436790a84cc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:21.471914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c2a2271-05a9-4474-a02e-6436790a84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:21.525485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:21.616081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a2271-05a9-4474-a02e-6436790a84cc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:21.712000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:21.712603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:21.712882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:21.713153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:21.714885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:21.807890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:21.839465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:21.840911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fb08d-3a8f-4ccb-9e99-ba0a56e587d7 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:21.865463 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 740/1490] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:24.462599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6dc42-81b0-4b7b-891a-46f5cec61aa8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:24.463494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6dc42-81b0-4b7b-891a-46f5cec61aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:24.463682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6dc42-81b0-4b7b-891a-46f5cec61aa8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:24.466293 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 751/1491] 10.222.0.78 () {54 vars in 927 bytes} [Sun Aug 28 19:45:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:45:24.473147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162431a6-815f-4799-afcb-cec8deb921b6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:24.473147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162431a6-815f-4799-afcb-cec8deb921b6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:24.473743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162431a6-815f-4799-afcb-cec8deb921b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:24.552555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-162431a6-815f-4799-afcb-cec8deb921b6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:24.553831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-162431a6-815f-4799-afcb-cec8deb921b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:24.680438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 741/1492] 10.222.0.78 () {58 vars in 1024 bytes} [Sun Aug 28 19:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:45:25.005105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6dc42-81b0-4b7b-891a-46f5cec61aa8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:25.006895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-76a6dc42-81b0-4b7b-891a-46f5cec61aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:25.134251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6dc42-81b0-4b7b-891a-46f5cec61aa8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:25.219334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:25.220463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:25.220741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:25.221007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:25.222691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:25.232688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:25.350362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:25.352032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39ed8-b3d3-40e2-9b6b-751498b01e3b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:25.373607 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 752/1493] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:34.675543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=82 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:35.371537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=50 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:01.642194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:01.642805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:01.642805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:01.728297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:47:01.729519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:01.845156 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 742/1494] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:47:01.857553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:01.858137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:01.859015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:01.887898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:47:01.889630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:01.902528 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 753/1495] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:47:01.907821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:01.917581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b420-cd23-40ab-b9d4-dcf46d5ae8f9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:01.923012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:01.923621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:01.923903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:01.924174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:01.924835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:47:01.925138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:01.926205 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:01.926205 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:47:01.926205 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:47:01.927099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:01.939539 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 743/1496] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:47:01.948362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:01.958184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdb55-3403-4a50-aa48-73d9172ad9a9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:01.963742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:01.964372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:01.964692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:01.964961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:01.965613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:01.967422 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:01.967422 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:47:01.967422 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:47:01.969362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:02.115952 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 754/1497] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:47:01 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:47:02.124016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:02.136122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767418f-47f6-4e42-a8cd-521d76e8ae6f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:02.192071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:02.199573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:02.200194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.200474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.200747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.201398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:02.202999 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:02.202999 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:47:02.202999 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:47:02.204210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:02.299788 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 744/1498] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:47:02 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:47:02.303982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:02.314638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89594691-9c27-44b1-9c43-573d23ac5dd2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:02.319581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:02.320212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.320489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.320761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.321551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:02.322495 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:02.322495 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:47:02.322495 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:47:02.329081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:02.339090 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 755/1499] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:47:02.343953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:02.354942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b289-0785-4253-94b0-cf728ff461b6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:02.359796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:02.360396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.360678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.360982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.361630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:02.362687 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:02.362687 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:47:02.362687 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:47:02.363577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41acad-fd40-4a42-bb6a-a86395434923 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:02.377994 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 745/1500] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:47:02.382337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:02.393200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81c883-71a0-43bd-a527-512745f6374a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:02.397998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:02.398654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.398936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.399213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] PATH_INFO: `/v3/projects/59b078c12a7e4f92a827059c0795d86b/users/6ec78193d77a4b85b9007024ff277e31/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.415003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b078c12a7e4f92a827059c0795d86b, user_id=6ec78193d77a4b85b9007024ff277e31, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:02.416049 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:02.416049 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:47:02.416049 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:47:02.418009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1d1a8-8477-4f4a-8a2c-6b39122ee01e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:02.503047 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 756/1501] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:47:02 2022] PUT /identity/v3/projects/59b078c12a7e4f92a827059c0795d86b/users/6ec78193d77a4b85b9007024ff277e31/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:47:02.517018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185200c0-1a39-493d-bd17-53976ccdb398 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.523732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185200c0-1a39-493d-bd17-53976ccdb398 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.523732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185200c0-1a39-493d-bd17-53976ccdb398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.547512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-185200c0-1a39-493d-bd17-53976ccdb398 None None] MFA Rules not processed for user `6ec78193d77a4b85b9007024ff277e31`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:47:02.548746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-185200c0-1a39-493d-bd17-53976ccdb398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:02.631289 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 746/1502] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:47:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:47:02.646125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3d66-bad9-4408-8a8a-9cbdf80e67a3 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.646486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3d66-bad9-4408-8a8a-9cbdf80e67a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.646775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3d66-bad9-4408-8a8a-9cbdf80e67a3 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.648145 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 757/1503] 10.222.0.78 () {54 vars in 964 bytes} [Sun Aug 28 19:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:47:02.653842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b174e-ebc6-4bbf-817e-e7d8dcb7c84a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.654389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b174e-ebc6-4bbf-817e-e7d8dcb7c84a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.654639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b174e-ebc6-4bbf-817e-e7d8dcb7c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.721778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-035b174e-ebc6-4bbf-817e-e7d8dcb7c84a None None] MFA Rules not processed for user `53cb76d30b8a4dc7961464c640315123`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:47:02.723102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-035b174e-ebc6-4bbf-817e-e7d8dcb7c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:02.931981 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 747/1504] 10.222.0.78 () {58 vars in 1061 bytes} [Sun Aug 28 19:47:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:47:02.940663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3d66-bad9-4408-8a8a-9cbdf80e67a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:02.953168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3d66-bad9-4408-8a8a-9cbdf80e67a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:02.958834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:02.958834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:02.958834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:02.958834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:02.969092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:02.970873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:02.981374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 758/1505] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:47:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:47:03.040860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9879b0-c9c1-4145-b42c-eced0b27a70b None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:03.041352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9879b0-c9c1-4145-b42c-eced0b27a70b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:03.041872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9879b0-c9c1-4145-b42c-eced0b27a70b None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:03.047531 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 748/1506] 10.222.0.78 () {52 vars in 830 bytes} [Sun Aug 28 19:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:47:03.049051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:03.115436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdb121-2157-4edc-9344-6263640f7e93 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:03.120642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:03.121292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:03.121572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:03.121843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] PATH_INFO: `/v3/users/6ec78193d77a4b85b9007024ff277e31` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:03.123035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec78193d77a4b85b9007024ff277e31)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:03.124716 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:03.124716 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:47:03.124716 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:47:03.125955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:03.380346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec78193d77a4b85b9007024ff277e31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:03.382842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec78193d77a4b85b9007024ff277e31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:03.484988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec78193d77a4b85b9007024ff277e31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:03.500498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec78193d77a4b85b9007024ff277e31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:03.501267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec78193d77a4b85b9007024ff277e31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:03.524055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:03.533221 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 759/1507] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:47:03 2022] DELETE /identity/v3/users/6ec78193d77a4b85b9007024ff277e31 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:47:03.537943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:03.538232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:03.538505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:03.557707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:47:03.558992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:03.570047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:03.622523 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 749/1508] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:47:03.633112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:03.634634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:03.716591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f552dc-737d-48a7-92d9-54a2dc237506 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:03.720986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b92bf-f04c-421d-bf9e-1cfda72f5e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:03.721604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b92bf-f04c-421d-bf9e-1cfda72f5e83 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:03.721985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b92bf-f04c-421d-bf9e-1cfda72f5e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:03.722259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b92bf-f04c-421d-bf9e-1cfda72f5e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:03.733746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b92bf-f04c-421d-bf9e-1cfda72f5e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:03.735634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b92bf-f04c-421d-bf9e-1cfda72f5e83 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:03.748747 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 760/1509] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:47:04.315518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:04.316957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:04.330146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26ecf-3801-4b6d-a431-d2e9d4b2a5d3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:04.335743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:04.336418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:04.336696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:04.336963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] PATH_INFO: `/v3/projects/59b078c12a7e4f92a827059c0795d86b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:04.338290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b078c12a7e4f92a827059c0795d86b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:04.339426 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:47:04.339426 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:47:04.339426 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:47:04.340568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:04.495569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b078c12a7e4f92a827059c0795d86b', 'request_id': 'req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:04.503940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b078c12a7e4f92a827059c0795d86b', 'request_id': 'req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:04.518026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b078c12a7e4f92a827059c0795d86b', 'request_id': 'req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:04.611070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] The token cache is being invalidate because project 59b078c12a7e4f92a827059c0795d86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:47:04.611312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:04.612000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26aeabd7-6c38-49de-ae2f-34c6c88c84a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:47:04.614239 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 750/1510] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:47:04 2022] DELETE /identity/v3/projects/59b078c12a7e4f92a827059c0795d86b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:47:13.743079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:14.606199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:14.783112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede67aa-c270-46f2-b5f9-cbfc3c9f0ad2 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:14.783725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede67aa-c270-46f2-b5f9-cbfc3c9f0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:14.783725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede67aa-c270-46f2-b5f9-cbfc3c9f0ad2 None None] PATH_INFO: `/v3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:14.784886 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 761/1511] 10.222.0.89 () {54 vars in 925 bytes} [Sun Aug 28 19:50:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:50:14.791497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d9e0-e8cc-45cd-99d6-c2232a7d44f7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:14.792002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d9e0-e8cc-45cd-99d6-c2232a7d44f7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:14.792345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d9e0-e8cc-45cd-99d6-c2232a7d44f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:14.848306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9f51d9e0-e8cc-45cd-99d6-c2232a7d44f7 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:14.849547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9f51d9e0-e8cc-45cd-99d6-c2232a7d44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:14.929689 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 751/1512] 10.222.0.89 () {58 vars in 1015 bytes} [Sun Aug 28 19:50:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:50:18.980253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39f59-5c2e-46e0-a8f8-442c011de9e3 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:18.980880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39f59-5c2e-46e0-a8f8-442c011de9e3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:18.980880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39f59-5c2e-46e0-a8f8-442c011de9e3 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:18.988882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 762/1513] 10.222.0.78 () {54 vars in 961 bytes} [Sun Aug 28 19:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:50:18.989030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ceeac-ee31-4f6e-bcda-631e36d913e3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:18.989517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ceeac-ee31-4f6e-bcda-631e36d913e3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:18.989517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ceeac-ee31-4f6e-bcda-631e36d913e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:19.011581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ea2ceeac-ee31-4f6e-bcda-631e36d913e3 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:19.013429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea2ceeac-ee31-4f6e-bcda-631e36d913e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:19.022410 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 752/1514] 10.222.0.78 () {58 vars in 1058 bytes} [Sun Aug 28 19:50:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:50:19.035120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39f59-5c2e-46e0-a8f8-442c011de9e3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:19.045547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39f59-5c2e-46e0-a8f8-442c011de9e3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:19.050946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee05924-0cd3-478a-882e-8d6b7e386f71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:19.051565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee05924-0cd3-478a-882e-8d6b7e386f71 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:19.051845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee05924-0cd3-478a-882e-8d6b7e386f71 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:19.052119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee05924-0cd3-478a-882e-8d6b7e386f71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:19.066908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee05924-0cd3-478a-882e-8d6b7e386f71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:19.068553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee05924-0cd3-478a-882e-8d6b7e386f71 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:19.080065 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 763/1515] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:24.374182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77d56b-9ffc-41f0-a1f5-b9468dbf53bf None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:24.374726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77d56b-9ffc-41f0-a1f5-b9468dbf53bf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:24.374862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77d56b-9ffc-41f0-a1f5-b9468dbf53bf None None] PATH_INFO: `/v3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:24.376298 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 753/1516] 10.222.0.84 () {54 vars in 925 bytes} [Sun Aug 28 19:50:24 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:50:24.385325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4331-bfda-4015-be9b-af46937a04f0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:24.391541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4331-bfda-4015-be9b-af46937a04f0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:24.391541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4331-bfda-4015-be9b-af46937a04f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:24.407769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-31bd4331-bfda-4015-be9b-af46937a04f0 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:24.409012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-31bd4331-bfda-4015-be9b-af46937a04f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:24.418305 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 764/1517] 10.222.0.84 () {58 vars in 1015 bytes} [Sun Aug 28 19:50:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:29.004258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=47 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:33.597952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c9757-608d-4383-b781-2c1bfe04c0ab None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:33.602039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c9757-608d-4383-b781-2c1bfe04c0ab None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:33.602039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c9757-608d-4383-b781-2c1bfe04c0ab None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:33.602039 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 754/1518] 10.222.0.78 () {54 vars in 961 bytes} [Sun Aug 28 19:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:50:33.604940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadf0c3-7858-479e-9c08-e9158c461b4a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:33.605452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadf0c3-7858-479e-9c08-e9158c461b4a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:33.605567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadf0c3-7858-479e-9c08-e9158c461b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:33.627733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cfadf0c3-7858-479e-9c08-e9158c461b4a None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:33.628952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cfadf0c3-7858-479e-9c08-e9158c461b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:33.637559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 765/1519] 10.222.0.78 () {58 vars in 1058 bytes} [Sun Aug 28 19:50:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:50:33.645162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c9757-608d-4383-b781-2c1bfe04c0ab None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:33.660001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c9757-608d-4383-b781-2c1bfe04c0ab None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:33.665182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891b8c9-fb09-488f-b9ab-bef806401feb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:33.665783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891b8c9-fb09-488f-b9ab-bef806401feb service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:33.666102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891b8c9-fb09-488f-b9ab-bef806401feb service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:33.666375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891b8c9-fb09-488f-b9ab-bef806401feb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:33.675821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891b8c9-fb09-488f-b9ab-bef806401feb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:33.677419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891b8c9-fb09-488f-b9ab-bef806401feb service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:33.687671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 755/1520] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:43.620507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=12 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:43.683404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:53.949260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1659f-81e8-40c9-8ffe-f83724a1b288 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:53.949792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1659f-81e8-40c9-8ffe-f83724a1b288 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:53.949991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1659f-81e8-40c9-8ffe-f83724a1b288 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:53.951251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 766/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:50:53.956376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e070f-381d-4818-85cf-f0356bb2e8cc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:53.957097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e070f-381d-4818-85cf-f0356bb2e8cc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:53.957097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e070f-381d-4818-85cf-f0356bb2e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:53.978601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d19e070f-381d-4818-85cf-f0356bb2e8cc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:53.979757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d19e070f-381d-4818-85cf-f0356bb2e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:54.042698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 756/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:54.198458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1659f-81e8-40c9-8ffe-f83724a1b288 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:54.204351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-43e1659f-81e8-40c9-8ffe-f83724a1b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:54.307329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1659f-81e8-40c9-8ffe-f83724a1b288 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:54.313115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c844526-591e-46b1-b906-abb8b1ca6eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:54.313762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844526-591e-46b1-b906-abb8b1ca6eed service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:54.314075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844526-591e-46b1-b906-abb8b1ca6eed service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:54.314381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844526-591e-46b1-b906-abb8b1ca6eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:54.323330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c844526-591e-46b1-b906-abb8b1ca6eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:54.324930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c844526-591e-46b1-b906-abb8b1ca6eed service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:54.334991 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 767/1523] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:55.185031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d3c03-865b-4203-a26b-c8324a912d9e None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:55.185623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d3c03-865b-4203-a26b-c8324a912d9e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:55.185623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d3c03-865b-4203-a26b-c8324a912d9e None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:55.186918 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 757/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 19:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:50:55.193159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25f039-5eee-4ad2-95bd-7b1134572475 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:55.193769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25f039-5eee-4ad2-95bd-7b1134572475 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:55.193769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25f039-5eee-4ad2-95bd-7b1134572475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:55.215245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7d25f039-5eee-4ad2-95bd-7b1134572475 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:55.216816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d25f039-5eee-4ad2-95bd-7b1134572475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:55.225205 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 768/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:55.377808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d3c03-865b-4203-a26b-c8324a912d9e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:55.393628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d3c03-865b-4203-a26b-c8324a912d9e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:55.399268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caacb0b-36a4-4e2d-9ce8-6b849f8a322f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:55.399870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caacb0b-36a4-4e2d-9ce8-6b849f8a322f service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:55.400144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caacb0b-36a4-4e2d-9ce8-6b849f8a322f service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:55.400407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caacb0b-36a4-4e2d-9ce8-6b849f8a322f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:55.409333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caacb0b-36a4-4e2d-9ce8-6b849f8a322f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:55.410973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caacb0b-36a4-4e2d-9ce8-6b849f8a322f service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:55.421411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 758/1526] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:59.097015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ae01-b636-46e0-b83a-fce4772b4485 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:59.098259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ae01-b636-46e0-b83a-fce4772b4485 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:59.098259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ae01-b636-46e0-b83a-fce4772b4485 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:59.099529 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 769/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:50:59.105784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703b3ef-3d77-4f94-b89b-9c836a2a53c2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:59.105784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703b3ef-3d77-4f94-b89b-9c836a2a53c2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:59.105784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703b3ef-3d77-4f94-b89b-9c836a2a53c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:59.125643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0703b3ef-3d77-4f94-b89b-9c836a2a53c2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:59.126900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0703b3ef-3d77-4f94-b89b-9c836a2a53c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:59.137032 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 759/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:59.426964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ae01-b636-46e0-b83a-fce4772b4485 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:59.428710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6764ae01-b636-46e0-b83a-fce4772b4485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:59.488737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ae01-b636-46e0-b83a-fce4772b4485 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:59.492358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997572ba-60e0-44c6-aeb2-76541ab32dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:59.492952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997572ba-60e0-44c6-aeb2-76541ab32dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:59.493233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997572ba-60e0-44c6-aeb2-76541ab32dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:59.493504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997572ba-60e0-44c6-aeb2-76541ab32dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:59.502992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997572ba-60e0-44c6-aeb2-76541ab32dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:59.505154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997572ba-60e0-44c6-aeb2-76541ab32dd1 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:59.515250 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 770/1529] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:01.475036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e7ed-f7ab-44df-8887-54dd37b58c97 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:01.475606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e7ed-f7ab-44df-8887-54dd37b58c97 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:01.475606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e7ed-f7ab-44df-8887-54dd37b58c97 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:01.477055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 760/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 19:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:51:01.482547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52eca-4660-4831-a9c4-aefb0c9c4d17 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:01.483067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52eca-4660-4831-a9c4-aefb0c9c4d17 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:01.483185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52eca-4660-4831-a9c4-aefb0c9c4d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:01.503244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7ae52eca-4660-4831-a9c4-aefb0c9c4d17 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:01.504442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7ae52eca-4660-4831-a9c4-aefb0c9c4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:01.513588 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 771/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:51:01.806339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e7ed-f7ab-44df-8887-54dd37b58c97 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:01.808213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54b1e7ed-f7ab-44df-8887-54dd37b58c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:01.822487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e7ed-f7ab-44df-8887-54dd37b58c97 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:01.826395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcae624-4993-4ff4-834f-7dc836f8493e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:01.827004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae624-4993-4ff4-834f-7dc836f8493e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:01.827281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae624-4993-4ff4-834f-7dc836f8493e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:01.827573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae624-4993-4ff4-834f-7dc836f8493e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:01.838072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcae624-4993-4ff4-834f-7dc836f8493e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:01.839535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcae624-4993-4ff4-834f-7dc836f8493e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:01.850748 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 761/1532] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:11.497388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=78 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:11.845552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=42 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:51.939149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9537-26e6-45b9-ae44-0b6ea21c526f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:51.939718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9537-26e6-45b9-ae44-0b6ea21c526f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:51.939718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9537-26e6-45b9-ae44-0b6ea21c526f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:51.941154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 772/1533] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:51:51.947380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4123-6c5a-4b48-840a-0d4ef70f601f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:51.947888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4123-6c5a-4b48-840a-0d4ef70f601f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:51.947977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4123-6c5a-4b48-840a-0d4ef70f601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:51.970305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-742c4123-6c5a-4b48-840a-0d4ef70f601f None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:51.971546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-742c4123-6c5a-4b48-840a-0d4ef70f601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:51.981588 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 762/1534] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:51:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:01.963829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:24.575325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:24.575916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:24.575916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:24.619764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:24.621498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:24.641823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 773/1535] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:24.651179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:24.652202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:24.652678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:24.684795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:24.687780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:24.701917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 763/1536] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:52:24.708043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:24.731931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651feeb-81f4-4e48-958d-4338761bdcac None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:24.747603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:24.748675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:24.749190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:24.750239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:24.751436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:24.751975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:24.753948 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:52:24.753948 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:52:24.753948 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:52:24.755655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbda15e-584b-43db-bf89-ff82e5702c30 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:24.790052 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 774/1537] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:24.793461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:24.819483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925fd3-5247-45df-a93f-313d8328d854 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:24.837895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f058-e405-49a0-8122-111a8e5ac8f4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:24.838387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f058-e405-49a0-8122-111a8e5ac8f4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:24.839135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f058-e405-49a0-8122-111a8e5ac8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:24.841968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:24.842977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:24.843464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:24.843917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:24.845042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:24.846980 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:52:24.846980 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:52:24.846980 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:52:24.849503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:24.895942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d980f058-e405-49a0-8122-111a8e5ac8f4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:24.898256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d980f058-e405-49a0-8122-111a8e5ac8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:24.924333 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 775/1538] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:52:24.941831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:24.942312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:24.942752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:24.991682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:24.993771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.017279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 776/1539] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:52:25.018590 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 764/1540] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:24 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:25.023392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.040055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.046349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbaaa-12b5-4e0c-a0ca-3414f7beeaba None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.210681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.211663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.212169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.212645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.214052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.215828 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:52:25.215828 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:52:25.215828 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:52:25.222095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.235313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19368b9-1e48-444b-9812-33fc55727baf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.243319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.244180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.244609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.245031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.245833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:25.246359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.248235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c875-7854-459c-9a42-1bfbe4de6dd5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.272700 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 765/1541] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:25.277253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c7a2-3ad3-4e7e-950e-dfe7e37fd208 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.277253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c7a2-3ad3-4e7e-950e-dfe7e37fd208 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.277253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c7a2-3ad3-4e7e-950e-dfe7e37fd208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.308280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ad17c7a2-3ad3-4e7e-950e-dfe7e37fd208 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.311751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ad17c7a2-3ad3-4e7e-950e-dfe7e37fd208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.325918 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 766/1542] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.327027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d739223-9c35-49b5-92fa-e35f89361e40 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.327318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d739223-9c35-49b5-92fa-e35f89361e40 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.328171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d739223-9c35-49b5-92fa-e35f89361e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.353833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 777/1543] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:52:25.357958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.371828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2d739223-9c35-49b5-92fa-e35f89361e40 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.378812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d739223-9c35-49b5-92fa-e35f89361e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.397090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c341-e716-49c4-aa55-b4eef3f89f49 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.406127 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 767/1544] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.410710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.410710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.410710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.427074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cffff5-f694-4fbd-b8ba-4e47a6fe9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.428302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cffff5-f694-4fbd-b8ba-4e47a6fe9013 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.428811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cffff5-f694-4fbd-b8ba-4e47a6fe9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.429312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cffff5-f694-4fbd-b8ba-4e47a6fe9013 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.432274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cffff5-f694-4fbd-b8ba-4e47a6fe9013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.435340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cffff5-f694-4fbd-b8ba-4e47a6fe9013 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.473460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.473460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.495074 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 768/1545] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.496768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.522720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a087b-676b-4fe5-9d45-d2e4bf2e6596 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.535620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4710287-ae5f-4cf1-a063-4ae2064f5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.536694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710287-ae5f-4cf1-a063-4ae2064f5adb admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.537170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710287-ae5f-4cf1-a063-4ae2064f5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.537593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710287-ae5f-4cf1-a063-4ae2064f5adb admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.538430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4710287-ae5f-4cf1-a063-4ae2064f5adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.542480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4710287-ae5f-4cf1-a063-4ae2064f5adb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.553747 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 769/1546] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:25.555877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5cda-afc1-41a1-87d9-18c008af5662 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.556458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5cda-afc1-41a1-87d9-18c008af5662 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.556947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5cda-afc1-41a1-87d9-18c008af5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.575584 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 778/1547] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:25.577455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.577725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.578406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.582367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-18fb5cda-afc1-41a1-87d9-18c008af5662 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.583707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-18fb5cda-afc1-41a1-87d9-18c008af5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.603603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.605946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.699182 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 779/1548] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.700375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.710140 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 770/1549] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.713356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c34e1-d986-48f2-8ad8-8eaddd2934a9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.715859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f3c61-76f3-494d-824c-41d636debbda None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.716147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f3c61-76f3-494d-824c-41d636debbda None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.716413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f3c61-76f3-494d-824c-41d636debbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.719348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.720050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.720406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.720683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.721404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:25.721715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.723444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e680-abd1-4b8c-8472-d1045aeb349c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.744160 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 780/1550] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:25.745991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.746442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.746935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.748105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-252f3c61-76f3-494d-824c-41d636debbda None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.750674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-252f3c61-76f3-494d-824c-41d636debbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.763409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 771/1551] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.769337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f3c61-76f3-494d-824c-41d636debbda None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.777770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.779299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.781831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f3c61-76f3-494d-824c-41d636debbda None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.787252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2eb25-69b6-45c1-8bd3-9e00011448b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.787969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2eb25-69b6-45c1-8bd3-9e00011448b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.788426 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 781/1552] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.788536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2eb25-69b6-45c1-8bd3-9e00011448b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.788800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2eb25-69b6-45c1-8bd3-9e00011448b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.789117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.789968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2eb25-69b6-45c1-8bd3-9e00011448b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.793174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2eb25-69b6-45c1-8bd3-9e00011448b5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.799923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354453-5ea3-498d-b1b2-781610f124bd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.804894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784997-9a3e-4d54-955d-d635d8a35b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.805499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784997-9a3e-4d54-955d-d635d8a35b54 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.805773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784997-9a3e-4d54-955d-d635d8a35b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.806076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784997-9a3e-4d54-955d-d635d8a35b54 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.806706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784997-9a3e-4d54-955d-d635d8a35b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.808778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784997-9a3e-4d54-955d-d635d8a35b54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.810091 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 772/1553] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:25.811502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39706-392e-4287-8df9-d68fd78ce3a8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.811802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39706-392e-4287-8df9-d68fd78ce3a8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.812080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39706-392e-4287-8df9-d68fd78ce3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.832923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-71b39706-392e-4287-8df9-d68fd78ce3a8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.834177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-71b39706-392e-4287-8df9-d68fd78ce3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.842397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 773/1554] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.844121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.844408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.844678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.865356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.866661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.874777 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 774/1555] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.875610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.881786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:25.885713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2d91-3923-464e-bcc5-a6c6d3484393 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.892551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.893686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.895558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.895558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.895558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:25.895558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.898959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.912356 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 775/1556] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:25.913208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:25.926318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5af20-d846-43c4-bbf5-b63bba2e7d97 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:25.931174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a694086-0953-46de-9c8d-47515ff02710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:25.931781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a694086-0953-46de-9c8d-47515ff02710 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.932062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a694086-0953-46de-9c8d-47515ff02710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.932336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a694086-0953-46de-9c8d-47515ff02710 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.932966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a694086-0953-46de-9c8d-47515ff02710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:25.935034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a694086-0953-46de-9c8d-47515ff02710 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:25.947901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:25.954010 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 782/1557] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:25.955155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f739d3-2823-4871-b06e-ac6312a96eaa None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.956513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f739d3-2823-4871-b06e-ac6312a96eaa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.956513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f739d3-2823-4871-b06e-ac6312a96eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:25.975824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d2f739d3-2823-4871-b06e-ac6312a96eaa None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:25.977068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d2f739d3-2823-4871-b06e-ac6312a96eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:25.985659 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 783/1558] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:25.986901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:25.987187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:25.987462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.011573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:26.012710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:26.020764 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 784/1559] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:26.021639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.032003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963df185-eb56-48c2-b3ca-8c08c76e8bda None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.036724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.037390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.037670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.037993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] PATH_INFO: `/v3/projects/9391f58220a44c3b83399d625f33048c/users/79946d2da3ef435093064a27e579e616/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.054147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9391f58220a44c3b83399d625f33048c, user_id=79946d2da3ef435093064a27e579e616, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.056885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.065789 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 776/1560] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:25 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.067156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.067458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.067723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.087541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:26.089505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:26.155066 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 777/1561] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:26.159035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.165206 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 785/1562] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:26 2022] PUT /identity/v3/projects/9391f58220a44c3b83399d625f33048c/users/79946d2da3ef435093064a27e579e616/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:26.173454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.173778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf409d-ad46-45e0-9ea3-aa0279326c9b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.246067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.246731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.247027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.247293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.248065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:26.248367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.250225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.251121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a6a7-de22-46ea-91e1-0929adbc2464 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.255776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.256405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.256663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.256937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.257578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.259490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.262712 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 778/1563] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:26.263491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.274026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7033e-da99-40fd-a3a7-ffae9f9e1c29 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.279193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.280102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.280102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.280384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.282119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.286086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.294533 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 779/1564] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:26.295386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.305571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465fc30-7cd2-4d7f-8bc1-fd669e7a2858 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.310630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.311244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.311551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.311874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.312590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:26.312889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.314509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.326290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 780/1565] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:26.331503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.337066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c79637-4714-4217-9709-6ab2997dfa13 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.342251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.342876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.343737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.344002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.344636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:26.344933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.346541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.359543 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 781/1566] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:26.361276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.371267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117b8b8-c6c6-42da-900b-481c5152a4f5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.377459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb97cd-54f8-4186-8e71-d20809926443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.377459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb97cd-54f8-4186-8e71-d20809926443 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.377459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb97cd-54f8-4186-8e71-d20809926443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.377459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb97cd-54f8-4186-8e71-d20809926443 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.377958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb97cd-54f8-4186-8e71-d20809926443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.379879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb97cd-54f8-4186-8e71-d20809926443 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.438090 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 786/1567] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/projects => generated 371 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.438865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.499192 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 782/1568] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.501392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.501682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.501983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.514183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd421-9902-4970-9c70-56aa19c076e8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.519621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.520236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.520514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.520791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.521451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:26.521762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.522812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:26.523406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.532575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] MFA Rules not processed for user `79946d2da3ef435093064a27e579e616`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:26.534066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:26.536685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 787/1569] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:26.537541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.548668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006640a-dee7-479a-bd10-317dc23cc88a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.554539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.555159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.555441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.555714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.556363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.558372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.612211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 783/1570] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:26.613072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.624821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65e8b-aa86-4900-9414-48926dbd5034 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.629845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.630527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.630817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.631084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.631804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.633333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.645248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 784/1571] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:26.646276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.656989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1f32-443a-496b-95c7-ba73281baeb8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.662013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.662637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.662911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.663184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.663818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.666158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.672288 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 788/1572] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.672288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.694887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:26.741445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8fd12-b6e5-424b-8b37-7ac56a1ce008 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.746312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.746917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.747204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.747482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.748123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.750571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.789067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 785/1573] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.789067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.845887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621c2e2-9405-40e9-8e86-9c00dc60b9b1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.851288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.851896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.852179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.852452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.853087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.855060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.938405 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 789/1574] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/projects => generated 399 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.939098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.972310 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 786/1575] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:26.978250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.987343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f921-28bc-4368-ac94-6a1f91a5d75a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.006792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2160d2d-1797-4130-87c5-64c1201166fb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.011883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.012492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.012778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.013052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.014144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.016198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.027733 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 790/1576] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.028575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.039237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7645-752a-4ec5-9345-76e012e50d76 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.042720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:27.044735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.045344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.045632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.045933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.047119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.049015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.049811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.050460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.050738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.051068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.051656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.053791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.204014 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 791/1577] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.204220 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 787/1578] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.204310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.204380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.274970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b913-0f4b-45bf-ba15-9706ee0b7ae4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.275909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da85d93-aeb6-4a23-97c6-b9aa5472fc45 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.280237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.281407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.281654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.281791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.281978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] PATH_INFO: `/v3/projects/5fa1cc87ef6548ef83ad4b014f4da077/users/548435e7f5d7476ea9cf0a226e5cc652/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.282399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.282675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.283963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.283963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.285547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.298173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa1cc87ef6548ef83ad4b014f4da077, user_id=548435e7f5d7476ea9cf0a226e5cc652, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.300829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.402483 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 788/1579] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.403392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.414741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b619897-aba0-4601-b3d8-dbe03618ff17 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.419921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.420566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.420845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.421207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.422402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.424367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.432134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:27.438522 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 792/1580] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:27 2022] PUT /identity/v3/projects/5fa1cc87ef6548ef83ad4b014f4da077/users/548435e7f5d7476ea9cf0a226e5cc652/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:27.439917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.508749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056252f5-352a-417d-941a-2754e63337ed admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.513703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.514353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.514640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.514944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.515588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.517552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.527287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 789/1581] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.531860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.542265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ccaa9-e174-46bd-9248-3dc958c65aa9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.547698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.548385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.548610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.548885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.549564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.551175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.561808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 790/1582] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.562639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.572334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077b658-4f37-4e6e-bee0-291312899b92 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.577175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.577798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.578115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.578429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.579043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.580633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.591026 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 791/1583] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.591804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.603294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c186fd-df36-4bc5-b749-226ba1522e8b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.608050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.609572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.609572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.609946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.610471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.612378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.676539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 793/1584] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.677558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.687719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b6704-87ee-48de-8752-cdd394011af4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.692342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.692937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.693211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.693479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.694212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.696156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.749981 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 792/1585] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.750926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.761117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648551-aa93-47f9-bb62-05d402e4066e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.766646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe85d9-d39a-49e4-ae09-a70d8904594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.767323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe85d9-d39a-49e4-ae09-a70d8904594d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.767658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe85d9-d39a-49e4-ae09-a70d8904594d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.767972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe85d9-d39a-49e4-ae09-a70d8904594d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.768667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe85d9-d39a-49e4-ae09-a70d8904594d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.770585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe85d9-d39a-49e4-ae09-a70d8904594d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.783400 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 793/1586] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.787134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.787134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.787134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.805060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:27.806322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:27.813818 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 794/1587] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.819749 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 794/1588] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:27.821115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.821263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.828257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454356c-b8f7-4dbf-b04d-aeefacbafa1d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.833006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.833628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.834003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.834178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.834342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37f4e0-d84c-4613-94ae-18f65f4e8844 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.834834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.836446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.842396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.844018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.844460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.844921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.846153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.848931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.852412 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 795/1589] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.853395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.868017 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 795/1590] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.869169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.872544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59416f-7867-4938-b416-a84b8b83de34 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.879931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.880701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.881165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.881622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] PATH_INFO: `/v3/projects/07cace5396f94b9da735c3d6cd0e653c/users/48b2798f813c44adb9b0ac245b9a2d52/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.887343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214292-e714-4391-96b2-3a97ce36490c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.894572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.895399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.895844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.896955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.896955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.899734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.908067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cace5396f94b9da735c3d6cd0e653c, user_id=48b2798f813c44adb9b0ac245b9a2d52, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.909814 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:52:27.909814 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:52:27.909814 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:52:27.913433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.917455 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 796/1591] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.918588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.930680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291493f-a378-4250-873c-dbe6954b3b06 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.935965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.936674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.937565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.937972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.938724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.940490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.951325 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 797/1592] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.952179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.963824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186d6e-eca1-4c2a-9574-4d5d66dbcc54 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.969476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.972200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.972200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.972200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.972200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.972820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.983613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 798/1593] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.985304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.994144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb2aed-6ef7-431d-b3a8-32eeb1036d69 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.999026 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 796/1594] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:27 2022] PUT /identity/v3/projects/07cace5396f94b9da735c3d6cd0e653c/users/48b2798f813c44adb9b0ac245b9a2d52/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:28.000221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.027958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:28.062780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.063423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.063705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.063976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.064640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.064986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471c51-0f88-4f76-abf3-224fecbe19ea admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.066258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.069590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.070245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.070529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.070803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.081199 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 799/1595] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:28.081199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.084355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.086230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.089839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7414-4896-46d6-ba12-b719f3e939cc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.095077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.095730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.096009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.096284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] PATH_INFO: `/v3/projects/bbda0fedca8f4509b6b079fcb2091a0a/users/cd4b791e7ffb420c867a880c1320f269/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.097243 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 797/1596] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:28.098118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.108019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b2f3-a413-493a-ae07-3b8c74d8c796 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.113171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.113962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.114318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.114585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.115165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.115755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbda0fedca8f4509b6b079fcb2091a0a, user_id=cd4b791e7ffb420c867a880c1320f269, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.116763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.118722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.128670 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 798/1597] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:28.129580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.141110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503beaf8-b3c8-4d62-8471-8fc82762eb65 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.146094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.146775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.147056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.147331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.147981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.149593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.160381 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 799/1598] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:28.161222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.175968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43811a3-f884-4609-9f9d-43f2c40c7d04 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.180899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c45cc-3c5e-4739-b892-f2e21f4bba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.181599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c45cc-3c5e-4739-b892-f2e21f4bba1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.181910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c45cc-3c5e-4739-b892-f2e21f4bba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.182190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c45cc-3c5e-4739-b892-f2e21f4bba1f admin admin] PATH_INFO: `/v3/projects/79b461e596624f12a0f0755b9674758e/users/db0204c167364b9eb67e2fab564fdd22/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.201132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c45cc-3c5e-4739-b892-f2e21f4bba1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b461e596624f12a0f0755b9674758e, user_id=db0204c167364b9eb67e2fab564fdd22, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.204607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c45cc-3c5e-4739-b892-f2e21f4bba1f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.212287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:28.218755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 800/1599] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:28 2022] PUT /identity/v3/projects/bbda0fedca8f4509b6b079fcb2091a0a/users/cd4b791e7ffb420c867a880c1320f269/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:28.219651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.284673 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 800/1600] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:28 2022] PUT /identity/v3/projects/79b461e596624f12a0f0755b9674758e/users/db0204c167364b9eb67e2fab564fdd22/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:28.286889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.287368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.287834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.301828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8abc-b470-49e3-a219-232f14d0821c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.337543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] MFA Rules not processed for user `48b2798f813c44adb9b0ac245b9a2d52`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:28.339752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:28.408246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.409507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.410076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.410607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] PATH_INFO: `/v3/projects/bc8791c45b3d488c8478be6c749c13d9/users/0dcc5c4f10704736bc29ed35c3b0f306/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.432705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8791c45b3d488c8478be6c749c13d9, user_id=0dcc5c4f10704736bc29ed35c3b0f306, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.435720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.454926 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 801/1601] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:28.454926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.471941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a890a75-fd7a-4f7e-ab8b-5dc9af1c64a3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.477081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.477728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.478055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.478327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.478978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.480645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.494052 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 802/1602] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:28.494052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.512937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f207-08aa-41c6-9776-216a3ab50c3a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.520112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3937a-6cfe-410e-a84e-0ac2e1386418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.520937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3937a-6cfe-410e-a84e-0ac2e1386418 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.534280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3937a-6cfe-410e-a84e-0ac2e1386418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.534280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3937a-6cfe-410e-a84e-0ac2e1386418 admin admin] PATH_INFO: `/v3/projects/385e50ea590c4057b37c190f6510659c/users/f75659ea2eb9488682a691e1c1718ed3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.538778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3937a-6cfe-410e-a84e-0ac2e1386418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385e50ea590c4057b37c190f6510659c, user_id=f75659ea2eb9488682a691e1c1718ed3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.541470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3937a-6cfe-410e-a84e-0ac2e1386418 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.562544 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 801/1603] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:28 2022] PUT /identity/v3/projects/bc8791c45b3d488c8478be6c749c13d9/users/0dcc5c4f10704736bc29ed35c3b0f306/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:28.569467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.621944 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 803/1604] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:28 2022] PUT /identity/v3/projects/385e50ea590c4057b37c190f6510659c/users/f75659ea2eb9488682a691e1c1718ed3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:28.634106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.634106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.634106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.643002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b453b-8371-4583-894f-07228ee08b2d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.658824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] MFA Rules not processed for user `cd4b791e7ffb420c867a880c1320f269`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:28.661239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:28.679463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:28.686659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:28.707032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.707852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.708376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.708690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] PATH_INFO: `/v3/projects/fabc9dcb56594525a6388dc5a71a5bcc/users/a6cd2e91843a4370967481cf4d866759/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.728594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabc9dcb56594525a6388dc5a71a5bcc, user_id=a6cd2e91843a4370967481cf4d866759, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.732229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.748233 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 804/1605] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:28.749052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.761245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06edb6-5108-4df7-b3ae-acaa3f1f9752 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.767658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.768581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.768928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.769323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.770075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.772002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:28.784235 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 805/1606] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:28.785259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.867687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb0439-4f32-4705-bc7f-df99dffb54f2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.871886 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 802/1607] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:28 2022] PUT /identity/v3/projects/fabc9dcb56594525a6388dc5a71a5bcc/users/a6cd2e91843a4370967481cf4d866759/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:28.873441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:28.932089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb0ec-fb18-4ecf-8d97-ca317d5b617d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.932726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb0ec-fb18-4ecf-8d97-ca317d5b617d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.933054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb0ec-fb18-4ecf-8d97-ca317d5b617d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.933247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb0ec-fb18-4ecf-8d97-ca317d5b617d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.949469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0637-ddb3-463e-a100-8c71ee2dfde8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:28.955328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb8c46-54e7-4ebc-a5b0-47f1fa8fb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:28.956010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8c46-54e7-4ebc-a5b0-47f1fa8fb55c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:28.956291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8c46-54e7-4ebc-a5b0-47f1fa8fb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:28.956570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8c46-54e7-4ebc-a5b0-47f1fa8fb55c admin admin] PATH_INFO: `/v3/projects/95c5ca8805924846b6cfddfb38797097/users/dc619d72ea5348e3a1712eec0757e0d2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:28.975531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8c46-54e7-4ebc-a5b0-47f1fa8fb55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c5ca8805924846b6cfddfb38797097, user_id=dc619d72ea5348e3a1712eec0757e0d2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:28.978970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8c46-54e7-4ebc-a5b0-47f1fa8fb55c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.005072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bb0ec-fb18-4ecf-8d97-ca317d5b617d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.006913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bb0ec-fb18-4ecf-8d97-ca317d5b617d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.020226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 806/1608] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:29.021461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.023811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.023811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.060741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] MFA Rules not processed for user `0dcc5c4f10704736bc29ed35c3b0f306`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:29.062505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:29.071923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:29.082067 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 803/1609] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:28 2022] PUT /identity/v3/projects/95c5ca8805924846b6cfddfb38797097/users/dc619d72ea5348e3a1712eec0757e0d2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:29.083617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.084088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.084360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.116942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] MFA Rules not processed for user `f75659ea2eb9488682a691e1c1718ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:29.119172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:29.167443 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 807/1610] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:29.168063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:29.181469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539e7df-4f80-4397-9585-aa266dc3c941 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:29.205697 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 804/1611] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:29.206438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:29.247350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948fad1-91f9-49ed-a56e-7ed629b0f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:29.248054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:29.248215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948fad1-91f9-49ed-a56e-7ed629b0f07e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.248602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948fad1-91f9-49ed-a56e-7ed629b0f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.248945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948fad1-91f9-49ed-a56e-7ed629b0f07e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.250302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948fad1-91f9-49ed-a56e-7ed629b0f07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.252438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948fad1-91f9-49ed-a56e-7ed629b0f07e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.282275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada9a95-2a66-4027-8ed1-ef3dc6a329f0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:29.287196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad096-4968-466a-89ff-37c8597f02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:29.287876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad096-4968-466a-89ff-37c8597f02a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.288152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad096-4968-466a-89ff-37c8597f02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.288428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad096-4968-466a-89ff-37c8597f02a7 admin admin] PATH_INFO: `/v3/projects/79b461e596624f12a0f0755b9674758e/users/db0204c167364b9eb67e2fab564fdd22/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.290456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad096-4968-466a-89ff-37c8597f02a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b461e596624f12a0f0755b9674758e, user_id=db0204c167364b9eb67e2fab564fdd22, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.293214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad096-4968-466a-89ff-37c8597f02a7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.314363 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 805/1612] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:29 2022] PUT /identity/v3/projects/79b461e596624f12a0f0755b9674758e/users/db0204c167364b9eb67e2fab564fdd22/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:29.314363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.314363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.314363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.345069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] MFA Rules not processed for user `a6cd2e91843a4370967481cf4d866759`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:29.346599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:29.387280 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 808/1613] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:29.389270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.389562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.390111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.432450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] MFA Rules not processed for user `dc619d72ea5348e3a1712eec0757e0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:29.438447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:29.450742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 806/1614] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:29.451823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:29.511236 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 809/1615] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:29.512875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:29.543489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d3257-75b3-4c04-9112-798136e3d89a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:29.550985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:29.592034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a87845-c3fa-4979-bd89-fd9b5eab5492 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:29.598479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf83457-d4f8-4fed-817e-a089970f0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:29.599135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf83457-d4f8-4fed-817e-a089970f0b0c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.599458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf83457-d4f8-4fed-817e-a089970f0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.599750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf83457-d4f8-4fed-817e-a089970f0b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.600394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf83457-d4f8-4fed-817e-a089970f0b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.602362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf83457-d4f8-4fed-817e-a089970f0b0c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.615812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:29.616430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.616751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.617025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.617670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.619628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.630106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:29.727336 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 810/1616] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:29.728551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.729018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.729437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.761346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] MFA Rules not processed for user `db0204c167364b9eb67e2fab564fdd22`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:29.763182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:29.763548 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 807/1617] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:29.766518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:29.854932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4abf-eae9-4407-9cbc-907870453b9a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:29.855564 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 811/1618] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:29.856906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:29.861338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:29.862004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.862284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.862555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.863195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.865636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:29.871938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3188edb-fa2c-4351-9f17-99ce0abd9996 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:29.878581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:29.879585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:29.879861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:29.880531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] PATH_INFO: `/v3/users/48b2798f813c44adb9b0ac245b9a2d52` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:29.881444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b2798f813c44adb9b0ac245b9a2d52)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:29.882598 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:52:29.882598 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 19:52:29.882598 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 19:52:29.883756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.007842 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 808/1619] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:29 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.008814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.019726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd80bc-c7cb-4467-9059-ed2232a6c726 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.024629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.025319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.025702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.026010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.026765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.028764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.160676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 809/1620] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/projects => generated 397 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.161646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.182615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b2798f813c44adb9b0ac245b9a2d52'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:30.225170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b2798f813c44adb9b0ac245b9a2d52'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:30.239000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b2798f813c44adb9b0ac245b9a2d52'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:30.239999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b2798f813c44adb9b0ac245b9a2d52'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:30.240660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b2798f813c44adb9b0ac245b9a2d52'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:30.283966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015a37-ad4e-49e9-8d04-666f67d77c8b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.289101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.290029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.290336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.290422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.291124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.293063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.342222 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 812/1621] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:29 2022] DELETE /identity/v3/users/48b2798f813c44adb9b0ac245b9a2d52 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:30.343137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.344592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.360346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:30.404524 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 810/1622] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.404524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.404524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.428860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837192a-8885-4733-9cd2-9f65ae57a32e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.467415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:30.492589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.493213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.493496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.493771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.493884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca154c-c10a-4731-88bf-b51479638334 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.495055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.496910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.500378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feefba-cc7a-438d-a3d9-837ccfacf162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.501166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feefba-cc7a-438d-a3d9-837ccfacf162 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.501446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feefba-cc7a-438d-a3d9-837ccfacf162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.501793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feefba-cc7a-438d-a3d9-837ccfacf162 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.502608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feefba-cc7a-438d-a3d9-837ccfacf162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.505357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feefba-cc7a-438d-a3d9-837ccfacf162 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.614188 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 811/1623] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.614553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 813/1624] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.615536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262a96-1eef-440a-a961-12cf285146b0 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.615888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262a96-1eef-440a-a961-12cf285146b0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.616169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262a96-1eef-440a-a961-12cf285146b0 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.616386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.618624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.622369 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 812/1625] 10.222.0.78 () {54 vars in 962 bytes} [Sun Aug 28 19:52:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:30.623320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262a96-1eef-440a-a961-12cf285146b0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.625643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-31262a96-1eef-440a-a961-12cf285146b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.636258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df51dac-6972-4196-aa4e-20a03d8b1368 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.648410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9188959-e036-4775-9ee6-06767a078703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.649049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9188959-e036-4775-9ee6-06767a078703 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.649336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9188959-e036-4775-9ee6-06767a078703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.649642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9188959-e036-4775-9ee6-06767a078703 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.649775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262a96-1eef-440a-a961-12cf285146b0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.650571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9188959-e036-4775-9ee6-06767a078703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.652232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9188959-e036-4775-9ee6-06767a078703 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.656704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.657374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.657718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.658094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.659246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.661303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.664722 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 814/1626] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:30.666356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.666782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.667173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.694903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:30.696479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.705280 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 815/1627] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:30.705908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.707333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.721012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf32ce-8d89-4ad6-8c02-46dca0ba3c00 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.727847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe1f3-358f-4ba2-a1da-0b5c8ea82833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.728761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe1f3-358f-4ba2-a1da-0b5c8ea82833 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.729224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe1f3-358f-4ba2-a1da-0b5c8ea82833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.729668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe1f3-358f-4ba2-a1da-0b5c8ea82833 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.730684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe1f3-358f-4ba2-a1da-0b5c8ea82833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.732994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe1f3-358f-4ba2-a1da-0b5c8ea82833 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.766613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 813/1628] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/users => generated 305 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.767448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.784890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c646-7fdc-4815-bd22-bb918652a152 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.792257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.793577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.793577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.793577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.794369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.796551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.809838 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 814/1629] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:30.809838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.850381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe56ec-6f0d-4407-a3ba-07c4872f8b09 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.853549 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 816/1630] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:30.856719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.856892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.857178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.857420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.857520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.858142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.858259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.860056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.860460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.877728 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 815/1631] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:30.877728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:30.896795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74044-6b4e-46e8-8da8-edca7d0ea371 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:30.907358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:30.908049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:30.908330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:30.908604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] PATH_INFO: `/v3/projects/f40a2851e75044f4ae43bd99ea6022b3/users/83f14da006dd467e941c17c3434123a2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:30.916293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:30.917622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:30.933422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40a2851e75044f4ae43bd99ea6022b3, user_id=83f14da006dd467e941c17c3434123a2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:30.937685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:30.996307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:31.022446 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 817/1632] 10.222.0.78 () {58 vars in 1059 bytes} [Sun Aug 28 19:52:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:31.023631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.025043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:31.043562 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 816/1633] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:30 2022] PUT /identity/v3/projects/f40a2851e75044f4ae43bd99ea6022b3/users/83f14da006dd467e941c17c3434123a2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:31.044928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.122585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479411b1-e38c-4522-b2e0-b9c6dcb899a7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.149530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e95e-e577-4df7-a9c7-2e239a8eca69 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.154629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.155259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.155570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.155852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.156508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.158300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.173356 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 817/1634] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:31.174484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.187658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306f6a-836b-4e99-892f-d327267ff90f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.193502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.194533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.194908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.195373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] PATH_INFO: `/v3/projects/a26b8049d08a44ee9cba2ff7b589c6b1/users/b950e9e2bb014a7b88fc2f4ae4a1bb94/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.196054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.196775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.197129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.197642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.216259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26b8049d08a44ee9cba2ff7b589c6b1, user_id=b950e9e2bb014a7b88fc2f4ae4a1bb94, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.220608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.225451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.228228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.241098 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 818/1635] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:31.242621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.256442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0f96-3091-43fa-bac5-a92838f351ba service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.261730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.262712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.263001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.263277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.263931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.267182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.285399 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 819/1636] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:31.285399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.295998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bede8c-cf77-44f3-a70d-08b578ae8601 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.302251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.303168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.303682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.303967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] PATH_INFO: `/v3/projects/7340fd88bff442cda93f810ff2fea9fc/users/4680102665bc49a48e948d99ad739200/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.324184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7340fd88bff442cda93f810ff2fea9fc, user_id=4680102665bc49a48e948d99ad739200, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.327055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.365901 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 818/1637] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:31 2022] PUT /identity/v3/projects/a26b8049d08a44ee9cba2ff7b589c6b1/users/b950e9e2bb014a7b88fc2f4ae4a1bb94/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:31.367104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.470336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:31.517360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520762-f7d9-4f41-bc49-c8d6a98bff5c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.518566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 820/1638] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:31 2022] PUT /identity/v3/projects/7340fd88bff442cda93f810ff2fea9fc/users/4680102665bc49a48e948d99ad739200/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:31.519718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.632177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.632843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.633085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.633502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.637570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:31.674311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ddc5-fbfa-4062-8cae-cfcb1a65efa0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.682099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.682835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.683122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.683536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.685084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.691101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.708966 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 821/1639] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:31.713911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.737258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2504541-67fd-491b-b578-4baf09dd4c27 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.742920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.743776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.744058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.744511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] PATH_INFO: `/v3/projects/fb4dccf9d86342f38b0594027376ca47/users/379a6ee73a61459f8d9730862d40cd06/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.747543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:31.778340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.781005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.782513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4dccf9d86342f38b0594027376ca47, user_id=379a6ee73a61459f8d9730862d40cd06, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.786857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.799182 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 819/1640] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:31.799801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.816736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210fbe-18dc-4df4-947d-78ee863d855a service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:31.822076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:31.822942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.823361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.823641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] PATH_INFO: `/v3/projects/14123064f74442d9904b910fadf04a25/users/4f97f37b4ebf440cb237272dfe5adde5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.846479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14123064f74442d9904b910fadf04a25, user_id=4f97f37b4ebf440cb237272dfe5adde5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:31.856120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:31.892474 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 822/1641] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:31 2022] PUT /identity/v3/projects/fb4dccf9d86342f38b0594027376ca47/users/379a6ee73a61459f8d9730862d40cd06/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:31.896067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:31.993307 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 820/1642] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:31 2022] PUT /identity/v3/projects/14123064f74442d9904b910fadf04a25/users/4f97f37b4ebf440cb237272dfe5adde5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:31.997802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.037799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa585ac-fdc8-43a3-a65d-ac6198271b30 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.115124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:32.138813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.139448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.139774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.140850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.141688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.143606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.152160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2cc7-5dd7-4e98-be46-993a83c649bc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.158004 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 823/1643] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:32.159030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.164342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.164985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.165264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.166092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.167006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.173577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.176981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47afd-a153-456d-8310-facc810e6b92 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.186164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.187890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.188489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.189191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] PATH_INFO: `/v3/projects/f40a2851e75044f4ae43bd99ea6022b3/users/83f14da006dd467e941c17c3434123a2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.193188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40a2851e75044f4ae43bd99ea6022b3, user_id=83f14da006dd467e941c17c3434123a2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.199111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.205024 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 821/1644] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:32.205576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.229975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f18d8-36a3-44df-b306-263c06d5a148 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.255112 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 824/1645] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:32 2022] PUT /identity/v3/projects/f40a2851e75044f4ae43bd99ea6022b3/users/83f14da006dd467e941c17c3434123a2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:32.257233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.325972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.326629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.326909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.327821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.333385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.335105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.348769 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 822/1646] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:32.353707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.355730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.358645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c5b9-2f01-4daf-8485-4bb84dcc74f0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.363391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.364018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.364297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.364564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.365287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.367235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.380833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7e48-38dc-45f8-89f2-8d5764d32f08 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.383978 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 825/1647] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:32.385148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.387738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.388932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.389367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.390483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] PATH_INFO: `/v3/projects/07cace5396f94b9da735c3d6cd0e653c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.392438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cace5396f94b9da735c3d6cd0e653c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.393833 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:52:32.393833 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 19:52:32.393833 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 19:52:32.395221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.403357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6033-507a-448f-892a-69fdceacba46 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.412372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.413339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.413896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.414625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] PATH_INFO: `/v3/projects/a26b8049d08a44ee9cba2ff7b589c6b1/users/b950e9e2bb014a7b88fc2f4ae4a1bb94/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.417271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26b8049d08a44ee9cba2ff7b589c6b1, user_id=b950e9e2bb014a7b88fc2f4ae4a1bb94, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.421178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.435527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:32.450724 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 826/1648] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:32 2022] PUT /identity/v3/projects/a26b8049d08a44ee9cba2ff7b589c6b1/users/b950e9e2bb014a7b88fc2f4ae4a1bb94/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:32.452925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.561188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0becdb-9459-4e35-8afa-dd122c8d2be1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.568276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2b497-f3cd-4625-a34f-3271b06d25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.569111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b497-f3cd-4625-a34f-3271b06d25a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.569454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b497-f3cd-4625-a34f-3271b06d25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.570089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b497-f3cd-4625-a34f-3271b06d25a4 admin admin] PATH_INFO: `/v3/projects/7340fd88bff442cda93f810ff2fea9fc/users/4680102665bc49a48e948d99ad739200/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.573215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2b497-f3cd-4625-a34f-3271b06d25a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7340fd88bff442cda93f810ff2fea9fc, user_id=4680102665bc49a48e948d99ad739200, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.578118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2b497-f3cd-4625-a34f-3271b06d25a4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.601096 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 827/1649] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:32 2022] PUT /identity/v3/projects/7340fd88bff442cda93f810ff2fea9fc/users/4680102665bc49a48e948d99ad739200/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:32.602628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.603110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.603388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.637834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cace5396f94b9da735c3d6cd0e653c', 'request_id': 'req-36e2418d-c372-4249-b406-93fa78c3753b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:32.646818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] MFA Rules not processed for user `83f14da006dd467e941c17c3434123a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:32.648982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.657043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cace5396f94b9da735c3d6cd0e653c', 'request_id': 'req-36e2418d-c372-4249-b406-93fa78c3753b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:32.698782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cace5396f94b9da735c3d6cd0e653c', 'request_id': 'req-36e2418d-c372-4249-b406-93fa78c3753b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:32.812113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] The token cache is being invalidate because project 07cace5396f94b9da735c3d6cd0e653c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:32.812900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:32.816206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:32.838801 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 823/1650] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:32 2022] DELETE /identity/v3/projects/07cace5396f94b9da735c3d6cd0e653c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:32.842485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.849410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.861349 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 828/1651] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:32.865226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:33.011382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808563-4e67-4c0e-bced-292b94d7ee76 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.018732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cb2e1-911b-4747-afd8-7cb0a637e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.020851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cb2e1-911b-4747-afd8-7cb0a637e3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.021350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cb2e1-911b-4747-afd8-7cb0a637e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.021782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cb2e1-911b-4747-afd8-7cb0a637e3fe admin admin] PATH_INFO: `/v3/projects/14123064f74442d9904b910fadf04a25/users/4f97f37b4ebf440cb237272dfe5adde5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.025396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cb2e1-911b-4747-afd8-7cb0a637e3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=14123064f74442d9904b910fadf04a25, user_id=4f97f37b4ebf440cb237272dfe5adde5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:33.028810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cb2e1-911b-4747-afd8-7cb0a637e3fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.034945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2418d-c372-4249-b406-93fa78c3753b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.046944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1de61-22f4-45c5-8cb1-f78d9ff7d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.047635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1de61-22f4-45c5-8cb1-f78d9ff7d774 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.047992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1de61-22f4-45c5-8cb1-f78d9ff7d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.052391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1de61-22f4-45c5-8cb1-f78d9ff7d774 admin admin] PATH_INFO: `/v3/projects/fb4dccf9d86342f38b0594027376ca47/users/379a6ee73a61459f8d9730862d40cd06/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.052391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1de61-22f4-45c5-8cb1-f78d9ff7d774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4dccf9d86342f38b0594027376ca47, user_id=379a6ee73a61459f8d9730862d40cd06, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:33.053277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1de61-22f4-45c5-8cb1-f78d9ff7d774 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.056062 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 829/1652] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:32 2022] PUT /identity/v3/projects/14123064f74442d9904b910fadf04a25/users/4f97f37b4ebf440cb237272dfe5adde5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:33.064429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1df9-e858-4e1c-b97d-04efff8cb72d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.064429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1df9-e858-4e1c-b97d-04efff8cb72d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.064429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1df9-e858-4e1c-b97d-04efff8cb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.112596 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 824/1653] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:32 2022] PUT /identity/v3/projects/fb4dccf9d86342f38b0594027376ca47/users/379a6ee73a61459f8d9730862d40cd06/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:33.114457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b641102-651e-4c6d-b866-c979c359e4aa None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.117898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b641102-651e-4c6d-b866-c979c359e4aa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.117898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b641102-651e-4c6d-b866-c979c359e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.133438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ee4d1df9-e858-4e1c-b97d-04efff8cb72d None None] MFA Rules not processed for user `b950e9e2bb014a7b88fc2f4ae4a1bb94`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.134832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ee4d1df9-e858-4e1c-b97d-04efff8cb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.153777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:33.166683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6b641102-651e-4c6d-b866-c979c359e4aa None None] MFA Rules not processed for user `4680102665bc49a48e948d99ad739200`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.168276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6b641102-651e-4c6d-b866-c979c359e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.269318 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 830/1654] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.271106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1342c7a-e189-4ce2-b907-a66f8b73d97f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.271468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1342c7a-e189-4ce2-b907-a66f8b73d97f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.272157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1342c7a-e189-4ce2-b907-a66f8b73d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.303211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b1342c7a-e189-4ce2-b907-a66f8b73d97f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.307227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b1342c7a-e189-4ce2-b907-a66f8b73d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.339602 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 825/1655] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.344502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b018-5b4e-42c9-9345-d726bb5e0931 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.346006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b018-5b4e-42c9-9345-d726bb5e0931 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.346638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b018-5b4e-42c9-9345-d726bb5e0931 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.354873 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 826/1656] 10.222.0.78 () {54 vars in 962 bytes} [Sun Aug 28 19:52:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:33.355928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33557-3bc9-43c3-a34e-c3e8ea01aa22 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.356211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33557-3bc9-43c3-a34e-c3e8ea01aa22 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.356481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33557-3bc9-43c3-a34e-c3e8ea01aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.405997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-79b33557-3bc9-43c3-a34e-c3e8ea01aa22 None None] MFA Rules not processed for user `4f97f37b4ebf440cb237272dfe5adde5`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.407203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-79b33557-3bc9-43c3-a34e-c3e8ea01aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.434782 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 831/1657] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.442945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.443496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.443963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.484751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] MFA Rules not processed for user `379a6ee73a61459f8d9730862d40cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.486050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.550251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 827/1658] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.552987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12908-6420-4d5f-8293-9ae77ebbc376 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.553584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12908-6420-4d5f-8293-9ae77ebbc376 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.554826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12908-6420-4d5f-8293-9ae77ebbc376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.586110 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 832/1659] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.586110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:33.590907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.597322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a6d12908-6420-4d5f-8293-9ae77ebbc376 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.598063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6d12908-6420-4d5f-8293-9ae77ebbc376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.698269 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 828/1660] 10.222.0.78 () {58 vars in 1059 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.699800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.700155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.700499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.710272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534caf-9e60-4cbc-b4d7-fd5db1515387 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.717598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.719229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.719519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.719797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.729829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:33.730090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:33.731290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.731861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.743292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 829/1661] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:33.743292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:33.753351 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 833/1662] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:33.754564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:33.759027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119422-7bd1-4c8a-ae0e-cefb3ba22d64 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.771681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.772041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62097-d969-4e48-95f9-9d6dafb1cdc0 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.773673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.774885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.775503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.778905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.779732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.780023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.781006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.781801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:33.782288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:33.782505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:33.784251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:33.786874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.803206 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 834/1663] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:52:33.808359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:33.826070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47118492-57fc-4c95-9271-6503c60c728e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.836991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.836991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.836991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.836991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.837345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:33.837345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.895576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:33.897259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.911546 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 830/1664] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:33.923601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:33.950831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01771e5-8188-4f61-bf5f-95514ae2298c service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:33.971809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:33.973048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:33.975752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:33.976417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:33.984274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:34.019165 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 835/1665] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:33 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:34.025036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.191638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.192172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a710-8852-4cef-b9ac-8d0af7c6927d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.198901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.206213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.206847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.207138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.207422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.208083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.210091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.221010 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 831/1666] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:34.223178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.250688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999423-9798-4ad3-afdb-b717ed1cc873 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.325702 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 836/1667] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:34 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:52:34.326621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.328605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:34.337679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ebc78-e165-4189-a157-318432c0875e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.338685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ebc78-e165-4189-a157-318432c0875e service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.338972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ebc78-e165-4189-a157-318432c0875e service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.339243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ebc78-e165-4189-a157-318432c0875e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.342704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ba32-a5db-4322-ab33-3d7b6fdb6259 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.348951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.349619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.350193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.350988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] PATH_INFO: `/v3/users/f75659ea2eb9488682a691e1c1718ed3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.352174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75659ea2eb9488682a691e1c1718ed3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.354488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.448893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ebc78-e165-4189-a157-318432c0875e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.451509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ebc78-e165-4189-a157-318432c0875e service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.478112 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 832/1668] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:34.479317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:34.482504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ebc78-e165-4189-a157-318432c0875e service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.495835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ebc78-e165-4189-a157-318432c0875e service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.506802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.507675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.508043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.508381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.551130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75659ea2eb9488682a691e1c1718ed3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:34.587950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75659ea2eb9488682a691e1c1718ed3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:34.597134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:34.602410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.604505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.612463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75659ea2eb9488682a691e1c1718ed3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:34.614640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75659ea2eb9488682a691e1c1718ed3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:34.616462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-763bcf38-3ac9-4b88-a499-fd7b39c2ddf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75659ea2eb9488682a691e1c1718ed3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:34.632210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 833/1669] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:34.633440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.646290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f099dcb-6d6f-445a-ae14-709ca9aec9a6 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.653243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.653913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.654199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.655371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.656543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.658215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.680176 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 834/1670] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:34.682073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.695500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:34.698490 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 837/1671] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:34 2022] DELETE /identity/v3/users/f75659ea2eb9488682a691e1c1718ed3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:34.700111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.700345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.700905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.720248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac41501-3d01-4cc8-9926-4b9d3cb7c798 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.736383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:34.739468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:34.832726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.833432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.837603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.837937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.838947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.840393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 838/1672] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:34.841439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.851683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.858639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:34.861923 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 835/1673] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:34.866741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:34.888662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:34.895853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dadf3b-b1e1-4bbc-a320-1e21a944972e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:34.902999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47abda2-8bf0-4d7d-8b68-3ef822736d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:34.903696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47abda2-8bf0-4d7d-8b68-3ef822736d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:34.904045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47abda2-8bf0-4d7d-8b68-3ef822736d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:34.904535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47abda2-8bf0-4d7d-8b68-3ef822736d2e admin admin] PATH_INFO: `/v3/projects/98a61780768c4e0caebc4b396567d282/users/fc1c6ecce9314b868718b25ea81c1791/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:34.931102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47abda2-8bf0-4d7d-8b68-3ef822736d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a61780768c4e0caebc4b396567d282, user_id=fc1c6ecce9314b868718b25ea81c1791, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:34.936354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47abda2-8bf0-4d7d-8b68-3ef822736d2e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:34.960620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:35.025298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74d0d8-0cd7-4085-b44e-ec95dba2309e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:35.035865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:35.037075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.037797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.038437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.043030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 836/1674] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:34 2022] PUT /identity/v3/projects/98a61780768c4e0caebc4b396567d282/users/fc1c6ecce9314b868718b25ea81c1791/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:35.065549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90644186-a0da-4260-8f2a-0aa5e04ec2b2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.068096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90644186-a0da-4260-8f2a-0aa5e04ec2b2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.068546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90644186-a0da-4260-8f2a-0aa5e04ec2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.086738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:35.090506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:35.111929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-90644186-a0da-4260-8f2a-0aa5e04ec2b2 None None] MFA Rules not processed for user `fc1c6ecce9314b868718b25ea81c1791`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:35.113545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90644186-a0da-4260-8f2a-0aa5e04ec2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:35.127240 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 839/1675] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:35.235000 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 837/1676] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:35.239428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:35.277093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e75be-0530-4e97-80b2-df1b1235f3a1 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:35.440857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:35.443743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.445789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.451789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.451789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:35.451789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:35.508517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:35.522198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b22f-4990-4bd7-91c3-fd2030cc82b2 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.522561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b22f-4990-4bd7-91c3-fd2030cc82b2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.523365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b22f-4990-4bd7-91c3-fd2030cc82b2 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.525204 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 838/1677] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:35.532303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.532672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.533102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.558982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:35.560456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:35.625814 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 840/1678] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:35 2022] POST /identity/v3/projects => generated 385 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:35.629714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:35.719087 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 839/1679] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:35.730134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4ad3-610c-41f5-925c-c73143bcfa05 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:35.736085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:35.736798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.737368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.737368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.738196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:35.740661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:35.744138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:35.745628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:35.761172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4bee-5463-4610-9de5-9bbc395dae67 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:35.873728 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 841/1680] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:35 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:52:35.878565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:35.888061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a6d39-03e9-40f9-8347-332c992ab457 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:35.906145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6d39-03e9-40f9-8347-332c992ab457 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.906145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6d39-03e9-40f9-8347-332c992ab457 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.906145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6d39-03e9-40f9-8347-332c992ab457 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.907184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65547e-c313-445f-bb66-31aa5d55e49d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:35.912638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:35.913359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.913869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.914544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.915485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:35.917883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:35.927982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a6d39-03e9-40f9-8347-332c992ab457 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:35.929634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a6d39-03e9-40f9-8347-332c992ab457 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:35.952663 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 840/1681] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:52:35.955620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e446-850f-47f5-b155-961de565bd85 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:35.955915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e446-850f-47f5-b155-961de565bd85 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:35.956192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e446-850f-47f5-b155-961de565bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:35.974686 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 842/1682] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:35.990017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.010840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6247e446-850f-47f5-b155-961de565bd85 None None] MFA Rules not processed for user `548435e7f5d7476ea9cf0a226e5cc652`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:36.012626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6247e446-850f-47f5-b155-961de565bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.020529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade66c3-a2df-4bea-8ae6-bb7e5408e350 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.047159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.047848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.048131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.048410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] PATH_INFO: `/v3/projects/9fa08674ee1443fb9c29961b49a2b166/users/c76528180fb74f9588beb61a55b432b4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.067940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:36.085891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa08674ee1443fb9c29961b49a2b166, user_id=c76528180fb74f9588beb61a55b432b4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.092561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.099580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:36.135036 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 841/1683] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:36.135036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e446-850f-47f5-b155-961de565bd85 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.135036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6247e446-850f-47f5-b155-961de565bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.236891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e446-850f-47f5-b155-961de565bd85 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.243195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.243824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.244240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.244452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.246487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.248902 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 843/1684] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:35 2022] PUT /identity/v3/projects/9fa08674ee1443fb9c29961b49a2b166/users/c76528180fb74f9588beb61a55b432b4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:36.250093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.251970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.345037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.349895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.352366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a154c5-0528-4825-ab97-3fdedb990987 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.358979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.360007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.360007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.360832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] PATH_INFO: `/v3/projects/385e50ea590c4057b37c190f6510659c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.361701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=385e50ea590c4057b37c190f6510659c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.365086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.367753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 842/1685] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:36.368702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.370462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.386279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96b57a-47e1-43f2-ad5b-f6b5f0b2110a service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.392624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.392624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.392941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.393141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.393877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.395929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.511506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385e50ea590c4057b37c190f6510659c', 'request_id': 'req-c2609f3c-9fdb-470b-a249-30c83d6df83d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:36.518728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385e50ea590c4057b37c190f6510659c', 'request_id': 'req-c2609f3c-9fdb-470b-a249-30c83d6df83d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:36.528392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385e50ea590c4057b37c190f6510659c', 'request_id': 'req-c2609f3c-9fdb-470b-a249-30c83d6df83d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:36.537794 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 843/1686] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:36 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:36.538979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.583369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:36.630785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c04a97-0ffc-4e79-8e76-22fdf93236da admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.661236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] The token cache is being invalidate because project 385e50ea590c4057b37c190f6510659c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:36.661236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:36.661236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:36.661236 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 844/1687] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:36 2022] DELETE /identity/v3/projects/385e50ea590c4057b37c190f6510659c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:36.661236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.661641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.661708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.661708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.661708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.661708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.661994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.661994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.672872 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 844/1688] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:36.672872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.673240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.698090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60f437-c3d8-4e77-b551-a845d371ae13 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.704447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.705294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.705606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.706042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] PATH_INFO: `/v3/users/4680102665bc49a48e948d99ad739200` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.707451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4680102665bc49a48e948d99ad739200)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.709516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.765890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2609f3c-9fdb-470b-a249-30c83d6df83d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.774532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.775429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.777074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.777074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.777268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:36.779764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:36.966606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:36.973194 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 845/1689] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:36 2022] POST /identity/v3/users => generated 307 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:36.974186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:36.975824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:36.988582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3008f67-1af4-43a8-b96f-2924167bf7b1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:36.993904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:36.994605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:36.994841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:36.995145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] PATH_INFO: `/v3/projects/9fa08674ee1443fb9c29961b49a2b166/users/c76528180fb74f9588beb61a55b432b4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:36.997103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa08674ee1443fb9c29961b49a2b166, user_id=c76528180fb74f9588beb61a55b432b4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:37.000494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:37.038458 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 846/1690] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:36 2022] PUT /identity/v3/projects/9fa08674ee1443fb9c29961b49a2b166/users/c76528180fb74f9588beb61a55b432b4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:37.040655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:37.044647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:37.045422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4680102665bc49a48e948d99ad739200'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.046305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4680102665bc49a48e948d99ad739200'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.130646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4680102665bc49a48e948d99ad739200'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.149191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4680102665bc49a48e948d99ad739200'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.150483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4680102665bc49a48e948d99ad739200'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.174927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 845/1691] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:36 2022] DELETE /identity/v3/users/4680102665bc49a48e948d99ad739200 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:37.176574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:37.178450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:37.209425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332254-3813-47f4-8262-da0dfe985680 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:37.316345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed15ff3-80d2-44cc-bc03-acd9a96298ac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:37.327950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56337dad-14b5-4591-ab8c-bb8da7901169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:37.327950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56337dad-14b5-4591-ab8c-bb8da7901169 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:37.327950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56337dad-14b5-4591-ab8c-bb8da7901169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:37.327950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56337dad-14b5-4591-ab8c-bb8da7901169 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:37.328287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56337dad-14b5-4591-ab8c-bb8da7901169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:37.328287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56337dad-14b5-4591-ab8c-bb8da7901169 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:37.352913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 846/1692] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:37.357908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:37.359074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:37.359415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:37.375488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:37.376149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:37.376452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:37.376710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] PATH_INFO: `/v3/users/0dcc5c4f10704736bc29ed35c3b0f306` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:37.378007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcc5c4f10704736bc29ed35c3b0f306)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:37.380256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:37.394265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:37.422205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] MFA Rules not processed for user `c76528180fb74f9588beb61a55b432b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:37.423662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:37.454567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:37.548068 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 847/1693] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:37.549148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:37.569025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc56f99-b0b8-4d71-9a30-c46c29bb574d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:37.572218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:37.572534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:37.572889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:37.573230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] PATH_INFO: `/v3/projects/50fb8f5e5b324db4b4f5a1c131ed6fde/users/d1a3ccdf99474015b2a826604ae7a315/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:37.596305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fb8f5e5b324db4b4f5a1c131ed6fde, user_id=d1a3ccdf99474015b2a826604ae7a315, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:37.600250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:37.687429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcc5c4f10704736bc29ed35c3b0f306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.699481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcc5c4f10704736bc29ed35c3b0f306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.706547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcc5c4f10704736bc29ed35c3b0f306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.707365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcc5c4f10704736bc29ed35c3b0f306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.708215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcc5c4f10704736bc29ed35c3b0f306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:37.759999 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 848/1694] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:37 2022] PUT /identity/v3/projects/50fb8f5e5b324db4b4f5a1c131ed6fde/users/d1a3ccdf99474015b2a826604ae7a315/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:37.761406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:37.765033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:37.836982 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 847/1695] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:37 2022] DELETE /identity/v3/users/0dcc5c4f10704736bc29ed35c3b0f306 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:37.838987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:37.841491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:37.918998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7a4a9-cee5-4065-907b-8d41a4c7e770 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:37.949884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390693e-556c-43b1-af3f-ab2588a1a813 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:37.955941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:37.956611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:37.956891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:37.957213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:37.957912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:37.959516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:37.972551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 848/1696] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:37.973392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:37.977186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:37.995872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732cffe-d2f8-43e0-a996-70622516385c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:38.003173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.003844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.004178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.004463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] PATH_INFO: `/v3/projects/7340fd88bff442cda93f810ff2fea9fc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.005580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.005725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7340fd88bff442cda93f810ff2fea9fc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.006245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.006524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.006797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.007652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.009142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.085385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:38.127067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.129173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf73fd2-7749-4bb6-ac46-5ff49b95f798 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.142449 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 849/1697] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:38.147433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.148279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.148279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.172492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:38.174344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.197236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7340fd88bff442cda93f810ff2fea9fc', 'request_id': 'req-8db4b48a-b5b4-4d70-b4bd-acd951efb245'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:38.204723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7340fd88bff442cda93f810ff2fea9fc', 'request_id': 'req-8db4b48a-b5b4-4d70-b4bd-acd951efb245'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:38.217652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7340fd88bff442cda93f810ff2fea9fc', 'request_id': 'req-8db4b48a-b5b4-4d70-b4bd-acd951efb245'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:38.253542 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 850/1698] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:38.254519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.265329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2bfc4-4b22-441e-8f4d-b190ff85a066 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:38.272000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.272784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.273130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.273412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] PATH_INFO: `/v3/projects/50fb8f5e5b324db4b4f5a1c131ed6fde/users/d1a3ccdf99474015b2a826604ae7a315/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.277471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fb8f5e5b324db4b4f5a1c131ed6fde, user_id=d1a3ccdf99474015b2a826604ae7a315, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.279243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.313232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 851/1699] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:38 2022] PUT /identity/v3/projects/50fb8f5e5b324db4b4f5a1c131ed6fde/users/d1a3ccdf99474015b2a826604ae7a315/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:38.314298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.316196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.373363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] The token cache is being invalidate because project 7340fd88bff442cda93f810ff2fea9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:38.374012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:38.376112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8db4b48a-b5b4-4d70-b4bd-acd951efb245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:38.378772 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 849/1700] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:37 2022] DELETE /identity/v3/projects/7340fd88bff442cda93f810ff2fea9fc => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:38.387357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.387876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.388389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.400796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47022395-4379-4b33-9de2-d829cf2fcb04 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:38.408931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.409666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.410004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.410277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.412460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.416245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:38.427698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:38.429113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.536078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.537553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516c517-9152-4129-a7a5-001919aea6d4 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.566801 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 852/1701] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:38.589924 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 850/1702] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:52:38.593506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.593966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.594531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.614664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:38.629660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:38.630965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.646289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.652572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 853/1703] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:38.661157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b22e0-8fa2-47bc-a8fe-62b445d157b9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:38.662527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.665008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.670657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.671849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.672129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.672409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.673076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:38.673384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.675085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.692262 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 851/1704] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:38.693525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.705631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb941cf-9ce4-4144-a810-1093b128726e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:38.714477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.715152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.715435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.715713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.716352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.719134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.781203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43298dc-f9c3-4a4b-8845-21531651b07c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:38.800419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:38.801410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:38.801711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:38.802029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:38.812569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:38.939090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:38.940973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:38.964650 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 852/1705] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:38 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:52:38.964903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 854/1706] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:38.966694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.985029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:38.997201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542163e-e704-4eda-94eb-fbf341f1afef service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.104618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec7fa-3f33-4f42-a112-f4b9d29a6d94 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.118390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.119383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.119760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.120105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.120831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.127814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.128473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.128773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.132204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.132682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.132822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:39.225839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.228171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a0678-b053-4b39-9ef9-42300830f274 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.242219 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 855/1707] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:52:39.244504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31191f1-f163-4920-8afe-c80740cfece2 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.245892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31191f1-f163-4920-8afe-c80740cfece2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.246822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31191f1-f163-4920-8afe-c80740cfece2 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.250956 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 856/1708] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:39.259576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.259698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.259972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.282867 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 853/1709] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:38 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:39.286897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:39.293799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:39.297055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:39.309450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efc92-fa6e-42b4-982e-2272463184ec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.316309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.317059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.317566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.318303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.319110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.335168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.367207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 854/1710] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:52:39.368032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:39.369727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:39.386626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe013c-65e9-450c-af01-59d8afa26ec9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.392602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.393261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.393549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.393910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] PATH_INFO: `/v3/projects/bc8791c45b3d488c8478be6c749c13d9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.395256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8791c45b3d488c8478be6c749c13d9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.397566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.419550 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 857/1711] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:39.426181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:39.446242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379eb06f-ed81-4019-92b7-0618ac63b2ba None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.451941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.453378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.453662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.453993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.454724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.456365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.468235 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 858/1712] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:39.469019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:39.474294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:39.498731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977b3f8-6016-42c4-b640-b74c46af927f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.508383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.509195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.509671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.516146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.529266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.533988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.550280 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 859/1713] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:39.550848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:39.570885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae304-6f3d-4e8d-9d6e-8ae5e1d176af service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.573270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4917f-0691-47c3-9890-c23b5f5b5b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:39.574099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4917f-0691-47c3-9890-c23b5f5b5b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.574459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4917f-0691-47c3-9890-c23b5f5b5b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.574934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4917f-0691-47c3-9890-c23b5f5b5b9b admin admin] PATH_INFO: `/v3/projects/ee3d5296a50c469e945cb4a484bf4651/users/e947c9127486469d913a642b8e5de1e2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.607868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4917f-0691-47c3-9890-c23b5f5b5b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3d5296a50c469e945cb4a484bf4651, user_id=e947c9127486469d913a642b8e5de1e2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:39.612462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4917f-0691-47c3-9890-c23b5f5b5b9b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:39.651107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8791c45b3d488c8478be6c749c13d9', 'request_id': 'req-8929caef-39b4-4b34-b788-8f28ca2426f9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:39.660827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8791c45b3d488c8478be6c749c13d9', 'request_id': 'req-8929caef-39b4-4b34-b788-8f28ca2426f9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:39.678461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8791c45b3d488c8478be6c749c13d9', 'request_id': 'req-8929caef-39b4-4b34-b788-8f28ca2426f9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:39.752788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 860/1714] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:39 2022] PUT /identity/v3/projects/ee3d5296a50c469e945cb4a484bf4651/users/e947c9127486469d913a642b8e5de1e2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:39.767313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d7b1-4f06-45ba-9e81-063589f6613f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.767929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d7b1-4f06-45ba-9e81-063589f6613f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.770783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d7b1-4f06-45ba-9e81-063589f6613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:39.809531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] The token cache is being invalidate because project bc8791c45b3d488c8478be6c749c13d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:39.810064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:39.811068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:39.815396 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 855/1715] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:39 2022] DELETE /identity/v3/projects/bc8791c45b3d488c8478be6c749c13d9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:39.820329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:39.822109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:39.835640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5ee9d7b1-4f06-45ba-9e81-063589f6613f None None] MFA Rules not processed for user `e947c9127486469d913a642b8e5de1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:39.837054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ee9d7b1-4f06-45ba-9e81-063589f6613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:39.918468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:39.977674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929caef-39b4-4b34-b788-8f28ca2426f9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:39.990926 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 861/1716] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:39.993359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:39.995438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:39.995438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.019153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:40.036800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] MFA Rules not processed for user `dc619d72ea5348e3a1712eec0757e0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:40.038447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:40.121694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:40.134032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:40.134032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:40.134032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] PATH_INFO: `/v3/users/b950e9e2bb014a7b88fc2f4ae4a1bb94` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.134032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b950e9e2bb014a7b88fc2f4ae4a1bb94)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:40.134032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:40.172035 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 862/1717] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:40.173134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:40.174698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:40.196435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0457fe1-394d-4269-b426-8b645cac3db6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:40.202152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:40.202774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:40.203307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:40.203585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.204455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:40.206450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:40.405006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 863/1718] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:40 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:40.413346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:40.413346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:40.538624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b950e9e2bb014a7b88fc2f4ae4a1bb94'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:40.552674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4db7-3e5a-4210-a239-f9ce56359a02 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:40.559039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b950e9e2bb014a7b88fc2f4ae4a1bb94'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:40.560216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:40.561013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:40.561458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:40.561790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.564473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:40.572116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b950e9e2bb014a7b88fc2f4ae4a1bb94'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:40.572561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b950e9e2bb014a7b88fc2f4ae4a1bb94'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:40.573455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cefb1c58-b077-43a6-9715-f318353ff645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b950e9e2bb014a7b88fc2f4ae4a1bb94'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:40.658033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:40.661260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:40.677593 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 864/1719] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:40.677593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:40.697019 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 856/1720] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:39 2022] DELETE /identity/v3/users/b950e9e2bb014a7b88fc2f4ae4a1bb94 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:52:40.807867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:40.810985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97818e4f-6d63-46cd-b397-20b46cf1177a service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:40.843157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6168f-f193-4a99-93c4-0dfaed03b9f4 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:40.843906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6168f-f193-4a99-93c4-0dfaed03b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:40.844490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6168f-f193-4a99-93c4-0dfaed03b9f4 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.846418 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 857/1721] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:40.858798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:40.859238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:40.859581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.893443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:40.895764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:40.928606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:40.929304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:40.929590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:40.929878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:40.930643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:40.932902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.058779 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 865/1722] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:40 2022] POST /identity/v3/users => generated 299 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:41.069769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:41.073652 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 858/1723] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:41.080007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:41.110129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:41.113578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259ac2-c9f6-4124-b271-6599c42a6539 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:41.121809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:41.131018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:41.131018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.131018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.131018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.131600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:41.131600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.149284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 866/1724] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:41.151871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:41.174332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4894de-98ca-4778-b203-55694df4d512 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:41.206595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:41.207596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.208954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.209243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] PATH_INFO: `/v3/projects/1968ff8f60754c2a9a6ea897d1651a59/users/7cc979da9b354f4d8d5616999878dfeb/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.256374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1968ff8f60754c2a9a6ea897d1651a59, user_id=7cc979da9b354f4d8d5616999878dfeb, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:41.260883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.313595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa155c-0a69-44ed-8c32-d99d1868d363 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:41.329448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:41.330736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.331362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.331823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.363484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:41.366467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.382358 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 859/1725] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:41.397622 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 867/1726] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:41 2022] PUT /identity/v3/projects/1968ff8f60754c2a9a6ea897d1651a59/users/7cc979da9b354f4d8d5616999878dfeb/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:52:41.402177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:41.432731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80b026-e8b0-470f-8ae8-a264480eb278 service glance] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:41.552008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:41.552907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.553197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.553485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.554286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:41.556307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.574585 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 860/1727] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:41.579854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:41.599326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96161-f050-4496-80fe-c9eb878c31a0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:41.610216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a4549-0c94-4c3d-99bd-fa362819c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:41.612744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4549-0c94-4c3d-99bd-fa362819c2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.613136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4549-0c94-4c3d-99bd-fa362819c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.613516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4549-0c94-4c3d-99bd-fa362819c2b6 admin admin] PATH_INFO: `/v3/projects/1968ff8f60754c2a9a6ea897d1651a59/users/7cc979da9b354f4d8d5616999878dfeb/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.618629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a4549-0c94-4c3d-99bd-fa362819c2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1968ff8f60754c2a9a6ea897d1651a59, user_id=7cc979da9b354f4d8d5616999878dfeb, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:41.628669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a4549-0c94-4c3d-99bd-fa362819c2b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.637761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:41.645232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:41.656888 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 868/1728] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:41 2022] PUT /identity/v3/projects/1968ff8f60754c2a9a6ea897d1651a59/users/7cc979da9b354f4d8d5616999878dfeb/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:41.671816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996baf7c-4988-4893-908b-34d40c861646 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.672242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996baf7c-4988-4893-908b-34d40c861646 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.672622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996baf7c-4988-4893-908b-34d40c861646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.685577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599fa7c-b5ee-4c0d-8c74-2fa95297a07f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:41.719932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-996baf7c-4988-4893-908b-34d40c861646 None None] MFA Rules not processed for user `7cc979da9b354f4d8d5616999878dfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:41.722224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-996baf7c-4988-4893-908b-34d40c861646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:41.787064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:41.787903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:41.788195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:41.788610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] PATH_INFO: `/v3/projects/a26b8049d08a44ee9cba2ff7b589c6b1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:41.790013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26b8049d08a44ee9cba2ff7b589c6b1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:41.792483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:41.865793 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 869/1729] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:52:41.947210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26b8049d08a44ee9cba2ff7b589c6b1', 'request_id': 'req-47b17621-2f5b-460f-afdc-13ecf565ae5d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:41.960478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26b8049d08a44ee9cba2ff7b589c6b1', 'request_id': 'req-47b17621-2f5b-460f-afdc-13ecf565ae5d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:41.974335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26b8049d08a44ee9cba2ff7b589c6b1', 'request_id': 'req-47b17621-2f5b-460f-afdc-13ecf565ae5d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.112437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] The token cache is being invalidate because project a26b8049d08a44ee9cba2ff7b589c6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:42.112648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996baf7c-4988-4893-908b-34d40c861646 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:42.114798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-996baf7c-4988-4893-908b-34d40c861646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.118852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.122520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.126231 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 861/1730] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:41 2022] DELETE /identity/v3/projects/a26b8049d08a44ee9cba2ff7b589c6b1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:52:42.136372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:42.152448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.167687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996baf7c-4988-4893-908b-34d40c861646 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:42.174035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:42.224479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:42.300565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:42.302595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:42.303822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:42.304350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] PATH_INFO: `/v3/users/79946d2da3ef435093064a27e579e616` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:42.304507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17621-2f5b-460f-afdc-13ecf565ae5d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:42.308034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79946d2da3ef435093064a27e579e616)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:42.310726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:42.322873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:42.324173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:42.324703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:42.325102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:42.331561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.498478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:42.501457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5ecd-d429-4d08-ad56-c76e7dd1da88 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:42.517423 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 862/1731] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:42.532137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:42.532605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:42.534550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:42.607786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:42.610163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.623342 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 863/1732] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:42.624428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:42.626278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.644826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79946d2da3ef435093064a27e579e616'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.645720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79946d2da3ef435093064a27e579e616'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.654868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94676d0c-f2b9-4863-9c10-54e4818d5ee6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:42.662701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:42.664660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:42.665033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:42.665386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] PATH_INFO: `/v3/users/fc1c6ecce9314b868718b25ea81c1791` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:42.666857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1c6ecce9314b868718b25ea81c1791)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:42.669072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:42.755066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79946d2da3ef435093064a27e579e616'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.765973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79946d2da3ef435093064a27e579e616'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.766739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-114fa5b6-1f7b-4df0-9b7d-1c764135e128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79946d2da3ef435093064a27e579e616'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.793167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 870/1733] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:42 2022] DELETE /identity/v3/users/79946d2da3ef435093064a27e579e616 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:52:42.794464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:42.794818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:42.795164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:42.820407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:42.821963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.893629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 871/1734] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:42.895349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:42.897760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.983718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1c6ecce9314b868718b25ea81c1791'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:42.996940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef982-e252-489f-9eff-4cd5ecf0f68e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.005381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.007205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.007205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.007205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.008783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.030706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.030706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8e90e-73cf-4e5b-9a00-3f0fb5413d2b service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.040317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 872/1735] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:43.042341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c0f3-2503-42f9-9084-5918c6d350f0 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.043153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c0f3-2503-42f9-9084-5918c6d350f0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.043610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c0f3-2503-42f9-9084-5918c6d350f0 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.050474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1c6ecce9314b868718b25ea81c1791'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:43.051943 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 873/1736] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:43.053633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.054323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.054649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.078764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:43.080426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.085259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1c6ecce9314b868718b25ea81c1791'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:43.090663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1c6ecce9314b868718b25ea81c1791'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:43.095016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1c6ecce9314b868718b25ea81c1791'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:43.110162 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 874/1737] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:43.111439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.126400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd21cc3-c8e9-4a34-bf0f-7b732ba6fc73 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.143240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.147052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.147052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.147052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.147052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:43.147052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.150636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efde7e-e91b-4463-abdd-7261493cbb10 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.180785 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 875/1738] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:43.182871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.183462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.183945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.205000 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 864/1739] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:42 2022] DELETE /identity/v3/users/fc1c6ecce9314b868718b25ea81c1791 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:43.212428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.212428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.215916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:43.217645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.366857 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 876/1740] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:43.367895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.369525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.454157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed0abb-e5f9-4021-a2dd-fd856d44e9c8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.472261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.473537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800b2db-aaa8-4c3a-ab3b-2ed1f72ec66a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.474400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.475612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.476423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.479399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.480769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.480769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.480769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.481472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.484017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.488791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.523657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.525347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbfedb-6db8-4a14-aca3-925316caf00d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.539544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 865/1741] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:43.541035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.541517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.541799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.544518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:43.581310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:43.583520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.616863 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 866/1742] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:43.625262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.652699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc48f4-269a-4cb6-a6d9-98321b37fc40 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.660661 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 877/1743] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:43 2022] POST /identity/v3/projects => generated 395 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:43.662484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.663363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.663614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.664426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.665922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.673461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.700577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.700577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.733733 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 867/1744] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:43.737124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.773452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630b2de-ef51-4c20-b643-51c4e2447f0f service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.865541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979d6da-a3de-42a4-8f4f-fea7dff3fb1c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.872884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.874314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.874687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.875419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] PATH_INFO: `/v3/users/e947c9127486469d913a642b8e5de1e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.877725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e947c9127486469d913a642b8e5de1e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.880114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.885939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.887603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.887942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.888244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.891229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.894535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.040083 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 868/1745] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:43 2022] POST /identity/v3/users => generated 298 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:44.042760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:44.170031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83e9b-f160-40af-b9aa-acbb091178c1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:44.174686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:44.175839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.176280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.176683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.197392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e947c9127486469d913a642b8e5de1e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:44.198800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:44.200119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e947c9127486469d913a642b8e5de1e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:44.201644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.222641 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 869/1746] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:44.223740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:44.270178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeba1c-0224-4131-ba6f-9ab4f6c5e48a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:44.322207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:44.324297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.324789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.325437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.339646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e947c9127486469d913a642b8e5de1e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:44.357469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:44.372847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.382333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e947c9127486469d913a642b8e5de1e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:44.384038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d3f8244c-a7f7-41e6-833b-790797a918a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e947c9127486469d913a642b8e5de1e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:44.442222 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 870/1747] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:44.444404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:44.451282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:44.460637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:44.494033 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 878/1748] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:43 2022] DELETE /identity/v3/users/e947c9127486469d913a642b8e5de1e2 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:44.501007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.504702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.505687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.528818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69236f-3ef5-47f1-9415-f28159b322e6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:44.559285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:44.563918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:44.647660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:44.649790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.650312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.651057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.652248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:44.654966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.672208 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 871/1749] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:44.676001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:44.688543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7be7-fd4d-4d7e-b50c-003eee79485f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:44.694909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1286a65-4456-4a1e-a2cd-efdbbecbdaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:44.697891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 879/1750] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:44.698082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1286a65-4456-4a1e-a2cd-efdbbecbdaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.698082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1286a65-4456-4a1e-a2cd-efdbbecbdaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.698082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1286a65-4456-4a1e-a2cd-efdbbecbdaa4 admin admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9/users/56fc08151a3d4805a702a9b62cb08232/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.706881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:44.708279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:44.737057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1286a65-4456-4a1e-a2cd-efdbbecbdaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d47f6a8a534084b50da46d3eb0f1d9, user_id=56fc08151a3d4805a702a9b62cb08232, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:44.741832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1286a65-4456-4a1e-a2cd-efdbbecbdaa4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.747791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:44.846843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39f1d-107d-497d-bc10-7e28be397bef None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:44.854154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:44.854930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.855321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.855520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.866295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:44.867888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.881906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 880/1751] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:52:44.883059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:44.884790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:44.900011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0a9d-1eed-43a2-a9ad-1c21130474c5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:44.905553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:44.906172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.906461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.906835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] PATH_INFO: `/v3/projects/9391f58220a44c3b83399d625f33048c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.908697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9391f58220a44c3b83399d625f33048c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:44.909982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:44.949919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 872/1752] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:44 2022] PUT /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9/users/56fc08151a3d4805a702a9b62cb08232/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:44.961016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:44.961921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:44.963460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:44.970578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:45.032122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] MFA Rules not processed for user `56fc08151a3d4805a702a9b62cb08232`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:45.035518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:45.149460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9391f58220a44c3b83399d625f33048c', 'request_id': 'req-22249181-db6a-4187-a09f-3a4aecfa873e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.166327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9391f58220a44c3b83399d625f33048c', 'request_id': 'req-22249181-db6a-4187-a09f-3a4aecfa873e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.183212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9391f58220a44c3b83399d625f33048c', 'request_id': 'req-22249181-db6a-4187-a09f-3a4aecfa873e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.281486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] The token cache is being invalidate because project 9391f58220a44c3b83399d625f33048c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:45.284471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.285471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.289786 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 881/1753] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:44 2022] DELETE /identity/v3/projects/9391f58220a44c3b83399d625f33048c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:45.292813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:45.296750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:45.304190 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 873/1754] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:45.308129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:45.442973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22249181-db6a-4187-a09f-3a4aecfa873e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:45.456372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:45.458123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:45.459790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:45.460081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] PATH_INFO: `/v3/projects/98a61780768c4e0caebc4b396567d282` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:45.462882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a61780768c4e0caebc4b396567d282)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:45.463117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61115667-c27c-4a8b-9be3-7a5b071802dc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:45.469071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:45.473915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:45.474967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:45.475167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:45.475406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] PATH_INFO: `/v3/users/db0204c167364b9eb67e2fab564fdd22` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:45.490952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0204c167364b9eb67e2fab564fdd22)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:45.495483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:45.695074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a61780768c4e0caebc4b396567d282', 'request_id': 'req-d5cccea1-5716-47e9-ba6d-ae88d4b32527'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.711721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a61780768c4e0caebc4b396567d282', 'request_id': 'req-d5cccea1-5716-47e9-ba6d-ae88d4b32527'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.726170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a61780768c4e0caebc4b396567d282', 'request_id': 'req-d5cccea1-5716-47e9-ba6d-ae88d4b32527'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.926754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] The token cache is being invalidate because project 98a61780768c4e0caebc4b396567d282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:45.927114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.928329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.934506 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 882/1755] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:45 2022] DELETE /identity/v3/projects/98a61780768c4e0caebc4b396567d282 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:45.935508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:45.938534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:45.960040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0204c167364b9eb67e2fab564fdd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:45.993527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0204c167364b9eb67e2fab564fdd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.004284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0204c167364b9eb67e2fab564fdd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.005206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0204c167364b9eb67e2fab564fdd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.005938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0204c167364b9eb67e2fab564fdd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.057448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cccea1-5716-47e9-ba6d-ae88d4b32527 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:46.065048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:46.066253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:46.066660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:46.066985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:46.067933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:46.070341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:46.147105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 874/1756] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:45 2022] DELETE /identity/v3/users/db0204c167364b9eb67e2fab564fdd22 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:46.148223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:46.150865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:46.178993 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 883/1757] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:45 2022] POST /identity/v3/projects => generated 395 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:46.180702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:46.187200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:46.294990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edea7a-80df-4d63-bc02-ee58beb409d0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:46.359889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6c7b-277e-4fb9-8963-950d37c9834c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:46.365102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:46.365759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:46.366215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:46.366610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] PATH_INFO: `/v3/users/c76528180fb74f9588beb61a55b432b4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:46.368117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76528180fb74f9588beb61a55b432b4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:46.370618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:46.465701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:46.466501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:46.469404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:46.469404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] PATH_INFO: `/v3/projects/ee3d5296a50c469e945cb4a484bf4651` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:46.472101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3d5296a50c469e945cb4a484bf4651)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:46.478185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:46.630640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76528180fb74f9588beb61a55b432b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.633080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76528180fb74f9588beb61a55b432b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.684172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3d5296a50c469e945cb4a484bf4651', 'request_id': 'req-7bd8b300-5515-4539-b7a0-24a7c517c68b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.695282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3d5296a50c469e945cb4a484bf4651', 'request_id': 'req-7bd8b300-5515-4539-b7a0-24a7c517c68b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.710056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3d5296a50c469e945cb4a484bf4651', 'request_id': 'req-7bd8b300-5515-4539-b7a0-24a7c517c68b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.759462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76528180fb74f9588beb61a55b432b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.778472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76528180fb74f9588beb61a55b432b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.779595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76528180fb74f9588beb61a55b432b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.831245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 884/1758] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:46 2022] DELETE /identity/v3/users/c76528180fb74f9588beb61a55b432b4 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:46.831245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:46.836266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:46.869238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] The token cache is being invalidate because project ee3d5296a50c469e945cb4a484bf4651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:46.870738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.871251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:46.876033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 875/1759] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:46 2022] DELETE /identity/v3/projects/ee3d5296a50c469e945cb4a484bf4651 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:46.882058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:46.884132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:46.938501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8831-1c9e-45ab-8fca-9c31302eaf76 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:46.947994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:46.948730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:46.949081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:46.949426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:46.950261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:46.952655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:47.084530 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 885/1760] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:46 2022] POST /identity/v3/users => generated 304 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:47.085210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b300-5515-4539-b7a0-24a7c517c68b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:47.085692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:47.092227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:47.096939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:47.097535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:47.097816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:47.098155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] PATH_INFO: `/v3/users/7cc979da9b354f4d8d5616999878dfeb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:47.100854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc979da9b354f4d8d5616999878dfeb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:47.102928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:47.116386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ed58-0a91-4fba-94ca-ac73bb41555d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:47.130098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:47.131067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:47.134966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:47.134966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] PATH_INFO: `/v3/projects/79b461e596624f12a0f0755b9674758e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:47.135568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b461e596624f12a0f0755b9674758e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:47.139096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:47.158432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:47.345020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:47.410579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc979da9b354f4d8d5616999878dfeb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.430137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b461e596624f12a0f0755b9674758e', 'request_id': 'req-595464b4-879a-4baa-9d01-651cbc28bea2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.461156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc979da9b354f4d8d5616999878dfeb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.473397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc979da9b354f4d8d5616999878dfeb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.474128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b461e596624f12a0f0755b9674758e', 'request_id': 'req-595464b4-879a-4baa-9d01-651cbc28bea2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.475054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc979da9b354f4d8d5616999878dfeb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.479550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc979da9b354f4d8d5616999878dfeb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.511157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b461e596624f12a0f0755b9674758e', 'request_id': 'req-595464b4-879a-4baa-9d01-651cbc28bea2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.568606 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 876/1761] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:46 2022] DELETE /identity/v3/users/7cc979da9b354f4d8d5616999878dfeb => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:52:47.568606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:47.570855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:47.679430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] The token cache is being invalidate because project 79b461e596624f12a0f0755b9674758e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:47.680075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.680884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:47.682908 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 886/1762] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:47 2022] DELETE /identity/v3/projects/79b461e596624f12a0f0755b9674758e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:47.688043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:47.690056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:47.694834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429586-a940-47ba-b3ea-b5eb2b599440 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:47.700579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80ce1-5c92-4b96-998d-0ef7555011f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:47.702817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80ce1-5c92-4b96-998d-0ef7555011f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:47.704146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80ce1-5c92-4b96-998d-0ef7555011f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:47.704974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80ce1-5c92-4b96-998d-0ef7555011f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:47.716531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e80ce1-5c92-4b96-998d-0ef7555011f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:47.719807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e80ce1-5c92-4b96-998d-0ef7555011f6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:47.740981 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 877/1763] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:47.744014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:47.746358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:47.746804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:47.772277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:47.773764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:47.786805 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 878/1764] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:47.787926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:47.789716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:47.801147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595464b4-879a-4baa-9d01-651cbc28bea2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:47.805790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127803d2-e176-4ddc-86a1-b90ae62d618c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:47.806702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:47.807371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:47.807663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:47.807932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] PATH_INFO: `/v3/projects/9fa08674ee1443fb9c29961b49a2b166` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:47.809125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa08674ee1443fb9c29961b49a2b166)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:47.811916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:47.817996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257df4f-2086-4aeb-93b1-d2c65a526161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:47.819094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257df4f-2086-4aeb-93b1-d2c65a526161 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:47.819702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257df4f-2086-4aeb-93b1-d2c65a526161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:47.820212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257df4f-2086-4aeb-93b1-d2c65a526161 admin admin] PATH_INFO: `/v3/projects/340860f388c8427097069a306b00fa90/users/221092dca5ca493c9d07c6ff805bd553/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:47.844201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257df4f-2086-4aeb-93b1-d2c65a526161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340860f388c8427097069a306b00fa90, user_id=221092dca5ca493c9d07c6ff805bd553, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:47.847910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257df4f-2086-4aeb-93b1-d2c65a526161 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.007920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 879/1765] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:47 2022] PUT /identity/v3/projects/340860f388c8427097069a306b00fa90/users/221092dca5ca493c9d07c6ff805bd553/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:48.012776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7907-7113-4c87-8f64-37f6c4edfe95 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.012776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7907-7113-4c87-8f64-37f6c4edfe95 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.012776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7907-7113-4c87-8f64-37f6c4edfe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.021122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa08674ee1443fb9c29961b49a2b166', 'request_id': 'req-dd7ef0e5-a581-4942-a225-186b0e2b92d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.038104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa08674ee1443fb9c29961b49a2b166', 'request_id': 'req-dd7ef0e5-a581-4942-a225-186b0e2b92d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.056647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4b4b7907-7113-4c87-8f64-37f6c4edfe95 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:48.057596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa08674ee1443fb9c29961b49a2b166', 'request_id': 'req-dd7ef0e5-a581-4942-a225-186b0e2b92d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.059582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b4b7907-7113-4c87-8f64-37f6c4edfe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.166388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] The token cache is being invalidate because project 9fa08674ee1443fb9c29961b49a2b166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:48.166718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.168194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.172158 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 887/1766] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:47 2022] DELETE /identity/v3/projects/9fa08674ee1443fb9c29961b49a2b166 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:48.172490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.174701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.202806 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 880/1767] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:48.202806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.203441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef0e5-a581-4942-a225-186b0e2b92d8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.203533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.203884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.216270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.217973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.218643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.219513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.220837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.223639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.241012 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 888/1768] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:48.242743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.256865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:48.258162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.267711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f12a0-7642-4aa6-8233-c302d6e87c6b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.276405 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 881/1769] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:48.277570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.285295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.286588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.287246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.288145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.289344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:48.292231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.294459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6f82-c736-4735-9e36-98f4d4870768 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.310394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103289c-db23-4d2c-ad77-5d4a780ad490 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.313102 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 889/1770] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:48.315186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.315795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.316338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.323638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.324344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.324790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.325204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] PATH_INFO: `/v3/projects/340860f388c8427097069a306b00fa90/users/221092dca5ca493c9d07c6ff805bd553/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.328551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340860f388c8427097069a306b00fa90, user_id=221092dca5ca493c9d07c6ff805bd553, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.334722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.352182 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 882/1771] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:48 2022] PUT /identity/v3/projects/340860f388c8427097069a306b00fa90/users/221092dca5ca493c9d07c6ff805bd553/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:48.355058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.407577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:48.409226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.495805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208398-a604-4646-af7b-486c73b27365 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.501325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4993ac-24b9-4850-bcf4-01d76f91a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.501755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4993ac-24b9-4850-bcf4-01d76f91a32f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.502490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4993ac-24b9-4850-bcf4-01d76f91a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.502772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4993ac-24b9-4850-bcf4-01d76f91a32f admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.511670 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 890/1772] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:48.514612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.516777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4993ac-24b9-4850-bcf4-01d76f91a32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.518548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.521234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4993ac-24b9-4850-bcf4-01d76f91a32f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.540449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dedb78-fbf0-4896-ba96-10b68c3e5a70 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.550984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.551642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.551915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.552190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] PATH_INFO: `/v3/projects/1968ff8f60754c2a9a6ea897d1651a59` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.553485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1968ff8f60754c2a9a6ea897d1651a59)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.555482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.671001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 883/1773] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/projects => generated 373 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:48.674281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.675888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.676287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.723596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] MFA Rules not processed for user `221092dca5ca493c9d07c6ff805bd553`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:48.724886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.744308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1968ff8f60754c2a9a6ea897d1651a59', 'request_id': 'req-313c029f-c79f-4b40-9e40-b740ca586109'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.751234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1968ff8f60754c2a9a6ea897d1651a59', 'request_id': 'req-313c029f-c79f-4b40-9e40-b740ca586109'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.762089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1968ff8f60754c2a9a6ea897d1651a59', 'request_id': 'req-313c029f-c79f-4b40-9e40-b740ca586109'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.850173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 884/1774] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:48.850847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.858143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:48.869462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] The token cache is being invalidate because project 1968ff8f60754c2a9a6ea897d1651a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:48.869952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.872552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:48.878222 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 891/1775] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:48 2022] DELETE /identity/v3/projects/1968ff8f60754c2a9a6ea897d1651a59 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:48.879518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:48.881072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:48.959028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25bb95-3566-4717-9836-ec0856da6339 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.964179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c029f-c79f-4b40-9e40-b740ca586109 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:48.965006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.965966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.966436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.966749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.968052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:48.969512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.970108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3517e47-8542-4d64-b49e-ab18f8cab5fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.970790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:48.971458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.971990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.972271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:48.973067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:48.975128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:48.985947 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 885/1776] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:48.985947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62815f-995c-4208-b627-d158dccf9435 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:48.985947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62815f-995c-4208-b627-d158dccf9435 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:48.985947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62815f-995c-4208-b627-d158dccf9435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.071307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6d62815f-995c-4208-b627-d158dccf9435 None None] MFA Rules not processed for user `d1a3ccdf99474015b2a826604ae7a315`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:49.077702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6d62815f-995c-4208-b627-d158dccf9435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.114166 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 892/1777] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:49.115312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:49.120280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.141509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6bbf7-f619-4ff4-8c72-d9b17bf25563 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:49.155476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5ddba-8619-44b8-b77f-63b00aa4c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:49.156123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5ddba-8619-44b8-b77f-63b00aa4c00c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.156520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5ddba-8619-44b8-b77f-63b00aa4c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.156804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5ddba-8619-44b8-b77f-63b00aa4c00c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.157509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5ddba-8619-44b8-b77f-63b00aa4c00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:49.159683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5ddba-8619-44b8-b77f-63b00aa4c00c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:49.247919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 886/1778] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:49.250556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.251006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.251376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.294689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:49.297585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.303244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 893/1779] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:49 2022] POST /identity/v3/projects => generated 395 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:49.304851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.305613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.305613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.403899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:49.405557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.475652 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 887/1780] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:49.476776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:49.482510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.520229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455f49d-4552-486d-b6b3-6e4090f81d81 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:49.522093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 894/1781] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:49.523459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:49.544102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4feb4b-500c-4aaa-83a3-e1cdd716af63 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:49.553839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:49.554656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.555789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.556589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.558090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:49.560135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:49.573476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:49.574289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.574559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.575190 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 895/1782] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:49.576349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:49.578150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.578717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.579008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:49.585364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:49.662135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:49.694380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9f4a-5ffa-4db8-8955-156f3a028a77 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:49.707496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:49.708690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.709966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.710554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.715156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.763555 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 888/1783] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:49 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:49.764055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:49.860930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:49.863960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171066-3add-4ace-a740-7af66868adfd service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:49.890039 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 896/1784] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:49 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:49.893151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.893440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.893764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.901813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb24ba-5df4-462c-afc2-c61c750204db admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:49.938385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:49.939045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.939360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.942065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.944635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:49.944760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:49.944846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:49.945595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:49.967573 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 897/1785] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:49.969507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:49.986436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9175a2-5769-4c5c-b7b3-b53f8532a489 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:49.993209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:49.995161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:49.995161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:49.995161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:49.996409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:49.997896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.018231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 898/1786] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:50.019259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.031057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294034b9-fe5f-4c2a-9515-7d6a000ca317 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.036508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.037143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.037419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.037719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.038393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.042386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.091416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 889/1787] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:49 2022] POST /identity/v3/users => generated 298 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:50.092926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.096417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:50.184020 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 899/1788] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:50 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:50.184020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.198916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae2c5-9897-4835-a252-babfae71caf9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.227178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.230018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.230695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.230989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.242076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:50.242076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.242076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.242287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670fd07-b727-401d-bdf0-6694e6651226 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.247180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.248085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.249768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.250411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.266411 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 900/1789] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:50.268118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.270967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:50.418937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.421107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.437551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 890/1790] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:50 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:50.438766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.458353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48a27-6ed9-4448-a757-e283ccc37fb6 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.460759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ff08-2463-4189-a109-421eb2979991 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.465484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.466364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.466778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.467082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] PATH_INFO: `/v3/projects/8387155c79d4432987f54bd8df9a8a78/users/26e8227b10c44f6ba0c9584a7bb4cfea/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.469009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.469965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.470314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.471578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.492253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8387155c79d4432987f54bd8df9a8a78, user_id=26e8227b10c44f6ba0c9584a7bb4cfea, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.495402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.558180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.560656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.571074 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 901/1791] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:52:50.591763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.607470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137cec-efe3-4791-8a7f-de2866012e67 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.614488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.615348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.616196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.616196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.616697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.618740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.635991 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 902/1792] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:50.637205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.645125 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 891/1793] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:50 2022] PUT /identity/v3/projects/8387155c79d4432987f54bd8df9a8a78/users/26e8227b10c44f6ba0c9584a7bb4cfea/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:50.646394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:50.660109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:50.667799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210994f3-1d4d-4bfd-a778-628e89757032 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.776921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b689c5-c3e9-47e2-b05c-d132f5e65bcc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:50.788464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbec3b-7608-4e1f-8ab8-9e5ef238d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.795121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbec3b-7608-4e1f-8ab8-9e5ef238d253 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.795121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbec3b-7608-4e1f-8ab8-9e5ef238d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.795121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbec3b-7608-4e1f-8ab8-9e5ef238d253 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.795121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbec3b-7608-4e1f-8ab8-9e5ef238d253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.795121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbec3b-7608-4e1f-8ab8-9e5ef238d253 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.798848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:50.802428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.803156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.803781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.805695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:50.816588 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 903/1794] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:50.818339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c3f22-2817-4bc8-b010-245102345aaf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:50.818634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c3f22-2817-4bc8-b010-245102345aaf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:50.818912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c3f22-2817-4bc8-b010-245102345aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:50.834757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:50.854417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:50.926970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bf1c3f22-2817-4bc8-b010-245102345aaf None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:50.930172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bf1c3f22-2817-4bc8-b010-245102345aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:51.053995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 892/1795] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:50 2022] POST /identity/v3/projects => generated 375 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:51.053995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:51.082295 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 904/1796] 10.222.0.89 () {58 vars in 1015 bytes} [Sun Aug 28 19:52:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:51.091726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.091726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.091726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.174216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] MFA Rules not processed for user `26e8227b10c44f6ba0c9584a7bb4cfea`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:51.175640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:51.196316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f46af-a61a-478a-adde-c92f4d9d49dc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:51.208179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:51.208826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.209141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.209450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.210679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:51.212178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:51.252429 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 893/1797] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:51.254566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:51.274472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6ce0-25b9-4721-9f13-cce9f1c58c36 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:51.281220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:51.282074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.282675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.283271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.284683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:51.286646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:51.302436 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 894/1798] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:51.303647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:51.348331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20571a3-e4f2-4e9b-9d66-fa0687acd27d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:51.397645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:51.398498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.406203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.406203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.406203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:51.407193 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 905/1799] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:51.407193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:51.418992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:51.420171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:51.671113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb051-0d2a-48e0-be36-3c5a49632504 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:51.671113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:51.671113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.671113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.671911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.671911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:51.671911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:51.671911 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 906/1800] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:51.671911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:51.680688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24cdb-bca2-49c7-a1dc-f5496ec924c7 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:51.689781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:51.690898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.691664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.692149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] PATH_INFO: `/v3/projects/ee8ea837f2a4498f8adcf825bdc9240e/users/70a78ec42efe4937a48b6f287d62841f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.754802 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 895/1801] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:51 2022] POST /identity/v3/users => generated 288 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:51.754802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:51.761796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8ea837f2a4498f8adcf825bdc9240e, user_id=70a78ec42efe4937a48b6f287d62841f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:51.762542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845eee-89ef-4b07-af75-fcabc648359b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:51.765787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:51.769237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:51.769988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:51.771045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:51.771305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] PATH_INFO: `/v3/projects/71bcbc84be0843f7af80e07a2c4ba6e5/users/3add080246514458a5345150fa5dcd35/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:51.796871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bcbc84be0843f7af80e07a2c4ba6e5, user_id=3add080246514458a5345150fa5dcd35, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:51.804436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:52.254900 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 896/1802] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:51 2022] PUT /identity/v3/projects/71bcbc84be0843f7af80e07a2c4ba6e5/users/3add080246514458a5345150fa5dcd35/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:52.256070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 907/1803] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:51 2022] PUT /identity/v3/projects/ee8ea837f2a4498f8adcf825bdc9240e/users/70a78ec42efe4937a48b6f287d62841f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:52.257401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:52.277810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:52.481164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa467d4-df36-40f5-824a-9970fccb2e18 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:52.498329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd4c9-67ef-49c7-af85-0882c4344854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:52.499010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd4c9-67ef-49c7-af85-0882c4344854 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:52.499334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd4c9-67ef-49c7-af85-0882c4344854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:52.499645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd4c9-67ef-49c7-af85-0882c4344854 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:52.500376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd4c9-67ef-49c7-af85-0882c4344854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:52.502422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd4c9-67ef-49c7-af85-0882c4344854 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:52.505887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61f14-4c15-4577-bf25-af1b9a2e92b8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:52.519474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b3296-96e6-4d07-893c-05dabc2d51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:52.520503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b3296-96e6-4d07-893c-05dabc2d51de admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:52.521969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b3296-96e6-4d07-893c-05dabc2d51de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:52.522445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b3296-96e6-4d07-893c-05dabc2d51de admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:52.527779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b3296-96e6-4d07-893c-05dabc2d51de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:52.532078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b3296-96e6-4d07-893c-05dabc2d51de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:52.559821 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 908/1804] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:52.563475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:52.563783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:52.564065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:52.602044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] MFA Rules not processed for user `3add080246514458a5345150fa5dcd35`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:52.603969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:52.632710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 897/1805] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:52 2022] POST /identity/v3/projects => generated 375 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:52.632710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:52.632710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:52.632710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:52.697283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] MFA Rules not processed for user `70a78ec42efe4937a48b6f287d62841f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:52.701364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:52.803744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:52.813817 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 909/1806] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:52.814865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:52.846293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba83905-6ff0-4fa4-8b6c-ddc521257ab2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:52.848048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:52.864041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 898/1807] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:52.865173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:53.018904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef6bc-5606-4356-a408-5c2cc50523ef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:53.055636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.057530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.058984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.059134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.069140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.071198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.074935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.076103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.077364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.077880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.081291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.087175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.106248 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 910/1808] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:53.107251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:53.134481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63b7f3-e65b-4529-ae52-fd72b82c3c9d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:53.140402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.140908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.141239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.141577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.142515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.144548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.207708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 899/1809] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:52 2022] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:53.218143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:53.320110 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 911/1810] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:53 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:53.321797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:53.384485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4d607-85d4-47ef-96c8-25111737162a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:53.461656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c4de2-c680-4fff-9d88-b3812ee0ec5b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:53.475230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a398-a507-4d9d-b281-a758a51e45aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.475923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a398-a507-4d9d-b281-a758a51e45aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.476334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a398-a507-4d9d-b281-a758a51e45aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.476513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a398-a507-4d9d-b281-a758a51e45aa admin admin] PATH_INFO: `/v3/projects/d9377829c3d0497f97a230d52d87c937/users/8a46bfe2cae646c5a88bfdf29cdf004e/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.512078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91a398-a507-4d9d-b281-a758a51e45aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9377829c3d0497f97a230d52d87c937, user_id=8a46bfe2cae646c5a88bfdf29cdf004e, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.517445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91a398-a507-4d9d-b281-a758a51e45aa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.534145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.534814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.536862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.537363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.539820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:53.608640 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 912/1811] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:53 2022] PUT /identity/v3/projects/d9377829c3d0497f97a230d52d87c937/users/8a46bfe2cae646c5a88bfdf29cdf004e/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:53.608640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40ce9-9d02-4990-8fff-4405504ca921 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.608640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40ce9-9d02-4990-8fff-4405504ca921 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.608640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40ce9-9d02-4990-8fff-4405504ca921 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.612259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 913/1812] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:52:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:53.614477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce40ce9-9d02-4990-8fff-4405504ca921 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:53.722586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.724370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.758927 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 900/1813] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:53.760325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:53.766451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce40ce9-9d02-4990-8fff-4405504ca921 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:53.773989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d03d5-2717-4cb8-8da9-45d89be32047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.774921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d03d5-2717-4cb8-8da9-45d89be32047 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.775211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d03d5-2717-4cb8-8da9-45d89be32047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.776119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d03d5-2717-4cb8-8da9-45d89be32047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.777403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d03d5-2717-4cb8-8da9-45d89be32047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.781376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d03d5-2717-4cb8-8da9-45d89be32047 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.793879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c3fa5-4dcd-448c-aea3-4eaf0359075e service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:53.808039 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 914/1814] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:53.810177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.810577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.811520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.814682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b469a-eb4e-459b-ac16-36b333c514c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:53.815439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b469a-eb4e-459b-ac16-36b333c514c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.817640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b469a-eb4e-459b-ac16-36b333c514c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.817640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b469a-eb4e-459b-ac16-36b333c514c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.817640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b469a-eb4e-459b-ac16-36b333c514c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:53.819568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b469a-eb4e-459b-ac16-36b333c514c0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:53.868066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:53.890138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] MFA Rules not processed for user `8a46bfe2cae646c5a88bfdf29cdf004e`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:53.891692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:53.928030 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 901/1815] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:53 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:53.929544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2da755-275e-4792-81f9-e491d0195b37 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:53.934152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2da755-275e-4792-81f9-e491d0195b37 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:53.934152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2da755-275e-4792-81f9-e491d0195b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:53.984621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5d2da755-275e-4792-81f9-e491d0195b37 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:53.986115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5d2da755-275e-4792-81f9-e491d0195b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:54.069447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:54.137843 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 915/1816] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:54.140140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.165823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c88266-149a-4e64-b640-1b5818bfa667 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:54.167629 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 902/1817] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:52:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:54.169059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747961-404d-467f-98f4-bbe90943be1e None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:54.169913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747961-404d-467f-98f4-bbe90943be1e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:54.170227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747961-404d-467f-98f4-bbe90943be1e None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:54.174890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 903/1818] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:54.175996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7747961-404d-467f-98f4-bbe90943be1e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.181769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:54.182776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:54.183318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:54.183897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] PATH_INFO: `/v3/projects/72f7aa7eaac145be8fe4356a07d4d8e3/users/493cc1cc5157481ebb7d2b2dc926870b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:54.214935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f7aa7eaac145be8fe4356a07d4d8e3, user_id=493cc1cc5157481ebb7d2b2dc926870b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:54.216552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7747961-404d-467f-98f4-bbe90943be1e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:54.220988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:54.228528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:54.233586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:54.233586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:54.233586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:54.233586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:54.233586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:54.251101 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 904/1819] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:54.252154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.272068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4d74-ce86-42df-88f6-6dfd03b0f78d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:54.307083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:54.307083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:54.307083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:54.307083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:54.307566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:54.307566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:54.347101 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 916/1820] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:54 2022] PUT /identity/v3/projects/72f7aa7eaac145be8fe4356a07d4d8e3/users/493cc1cc5157481ebb7d2b2dc926870b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:54.351404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:52:54.454192 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 905/1821] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:54 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:54.458503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.554333 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 19:52:54.554979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.626187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3e932-422d-4fed-8dab-00339022e43b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:54.634497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:54.635480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:54.635873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:54.636869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] PATH_INFO: `/v3/projects/1a3c83d8f15e43f487fb53e4e0b7e793/users/2e5a678fd8594dc19c695a95a8ffef4f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:54.661057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c83d8f15e43f487fb53e4e0b7e793, user_id=2e5a678fd8594dc19c695a95a8ffef4f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:54.665908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:54.696254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:54.741771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43323c5c-20b5-47b9-8a37-18b10772525c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:54.819850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221092dca5ca493c9d07c6ff805bd553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '340860f388c8427097069a306b00fa90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:54.820460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:54.820864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:54.821012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:54.833831 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 906/1822] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:54 2022] PUT /identity/v3/projects/1a3c83d8f15e43f487fb53e4e0b7e793/users/2e5a678fd8594dc19c695a95a8ffef4f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:54.836288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.836955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorizing `identity:get_project(project_id=07d47f6a8a534084b50da46d3eb0f1d9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:54.841220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:54.862860 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 917/1823] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:52:54 2022] GET /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9 => generated 395 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:54.863881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:54.875237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:54.891425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713959-a891-4a59-9e1b-0ecc2886ea23 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.002289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db0e8-954f-4e5f-8b52-67ce0759d963 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.014879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.017308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.017308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.017308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.017308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.024587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.041442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.042631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.043112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.043828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.044704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.051554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.057712 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 907/1824] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:55.058980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.228441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddfef9-c9e1-4654-9a55-467c5b35c5a9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.239468 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 918/1825] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:54 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:55.242944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.246655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.247238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.247765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.249535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.265523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.274846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.275160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5fe7-ba29-45c7-a16f-4e695b176440 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.275550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc21d25-0edc-46d5-98c6-7160cdceade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.276770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21d25-0edc-46d5-98c6-7160cdceade9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.276770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21d25-0edc-46d5-98c6-7160cdceade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.277120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21d25-0edc-46d5-98c6-7160cdceade9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.278871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc21d25-0edc-46d5-98c6-7160cdceade9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.280666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc21d25-0edc-46d5-98c6-7160cdceade9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.298543 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 919/1826] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:55.303458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f468b4-7a41-482d-ba87-5ca96c10c439 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.304302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f468b4-7a41-482d-ba87-5ca96c10c439 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.305156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f468b4-7a41-482d-ba87-5ca96c10c439 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.309167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 920/1827] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:55.310191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f468b4-7a41-482d-ba87-5ca96c10c439 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.323822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 908/1828] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:55.326347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.326464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f468b4-7a41-482d-ba87-5ca96c10c439 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.343043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd980b-02c4-4857-91bd-86f5a28969c4 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.348066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.349467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.349928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.350374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] PATH_INFO: `/v3/projects/72f7aa7eaac145be8fe4356a07d4d8e3/users/493cc1cc5157481ebb7d2b2dc926870b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.350962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.351284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.351785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.352857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.353968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.354977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f7aa7eaac145be8fe4356a07d4d8e3, user_id=493cc1cc5157481ebb7d2b2dc926870b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.357522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.359349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.378080 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 909/1829] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:55.378080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.391739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5983f-8062-4c9e-b393-e16ddc766b31 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.391947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 921/1830] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:55 2022] PUT /identity/v3/projects/72f7aa7eaac145be8fe4356a07d4d8e3/users/493cc1cc5157481ebb7d2b2dc926870b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:55.403952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:52:55.540307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:55.556294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.557028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.557553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.558315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] PATH_INFO: `/v3/projects/1a3c83d8f15e43f487fb53e4e0b7e793/users/2e5a678fd8594dc19c695a95a8ffef4f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.562194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c83d8f15e43f487fb53e4e0b7e793, user_id=2e5a678fd8594dc19c695a95a8ffef4f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.566657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.586030 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 910/1831] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:55 2022] PUT /identity/v3/projects/1a3c83d8f15e43f487fb53e4e0b7e793/users/2e5a678fd8594dc19c695a95a8ffef4f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:55.594699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.644751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:55.757981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6daf-bdca-455f-a5cd-5e93e299598b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.773370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de903ce-a712-4e15-8135-cc55dab63ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.775437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de903ce-a712-4e15-8135-cc55dab63ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.775736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de903ce-a712-4e15-8135-cc55dab63ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.777601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de903ce-a712-4e15-8135-cc55dab63ea6 admin admin] PATH_INFO: `/v3/projects/4249b3c5a4f549e09ec7d4a03de290d0/users/c0be5018364f4f729bf343b4604f3466/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.818383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:55.820695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6efd0-19fd-4804-abad-6455490a0ff3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:55.827150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de903ce-a712-4e15-8135-cc55dab63ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4249b3c5a4f549e09ec7d4a03de290d0, user_id=c0be5018364f4f729bf343b4604f3466, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.830045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de903ce-a712-4e15-8135-cc55dab63ea6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.916604 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 911/1832] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:55 2022] PUT /identity/v3/projects/4249b3c5a4f549e09ec7d4a03de290d0/users/c0be5018364f4f729bf343b4604f3466/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:55.918284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b10ec1-d8de-4598-af8c-11795ed22791 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.920302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b10ec1-d8de-4598-af8c-11795ed22791 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.920302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b10ec1-d8de-4598-af8c-11795ed22791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.951100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1c65-093a-4462-a45d-1b8073403c72 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221092dca5ca493c9d07c6ff805bd553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '340860f388c8427097069a306b00fa90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:55.956496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1c65-093a-4462-a45d-1b8073403c72 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.956496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1c65-093a-4462-a45d-1b8073403c72 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.956496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1c65-093a-4462-a45d-1b8073403c72 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:55.956496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1c65-093a-4462-a45d-1b8073403c72 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorizing `identity:get_project(project_id=07d47f6a8a534084b50da46d3eb0f1d9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:55.956884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1c65-093a-4462-a45d-1b8073403c72 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:55.958928 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 922/1833] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:52:55 2022] GET /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9 => generated 395 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:55.960165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:55.960520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:55.960831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.003301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b8b10ec1-d8de-4598-af8c-11795ed22791 None None] MFA Rules not processed for user `493cc1cc5157481ebb7d2b2dc926870b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:56.005566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b8b10ec1-d8de-4598-af8c-11795ed22791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:56.026606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] MFA Rules not processed for user `2e5a678fd8594dc19c695a95a8ffef4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:56.027981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:56.156301 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 923/1834] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:56.157164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:56.184401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 912/1835] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:56.187190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380b010-f346-4e26-97ed-f0a375f53e4d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.188051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380b010-f346-4e26-97ed-f0a375f53e4d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.188438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380b010-f346-4e26-97ed-f0a375f53e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.216941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6380b010-f346-4e26-97ed-f0a375f53e4d None None] MFA Rules not processed for user `548435e7f5d7476ea9cf0a226e5cc652`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:56.219883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6380b010-f346-4e26-97ed-f0a375f53e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:56.308617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92d49d-b3c8-42b4-ad1a-87ca2528727e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:56.316140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:56.316828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.317472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.318178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.318467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:56.320114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:56.328073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 913/1836] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:56.329590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ecd4e-d5cd-4de9-82ad-d82c26ac51ea None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.330287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ecd4e-d5cd-4de9-82ad-d82c26ac51ea None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.331222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ecd4e-d5cd-4de9-82ad-d82c26ac51ea None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.334993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:56.335886 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 914/1837] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:56.337332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ecd4e-d5cd-4de9-82ad-d82c26ac51ea None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:56.347702 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 924/1838] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:56.348899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:52:56.462283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ecd4e-d5cd-4de9-82ad-d82c26ac51ea None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:56.463713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:56.471899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:56.473041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.473984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.479874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.496865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:56.502916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:56.513071 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 915/1839] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:56.514764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:56.537052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0245c3-f3e2-4903-87fa-b5eb63f362e1 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:56.545036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:56.546632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.547128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.550706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] PATH_INFO: `/v3/projects/4249b3c5a4f549e09ec7d4a03de290d0/users/c0be5018364f4f729bf343b4604f3466/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.550706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4249b3c5a4f549e09ec7d4a03de290d0, user_id=c0be5018364f4f729bf343b4604f3466, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:56.553128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:56.566648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 916/1840] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:56 2022] PUT /identity/v3/projects/4249b3c5a4f549e09ec7d4a03de290d0/users/c0be5018364f4f729bf343b4604f3466/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:56.584104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:56.586205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:56.605208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9451c-bdba-4c71-b18e-af910c39a1ec admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:56.669755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:56.685227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491427d7-345a-4fd7-b615-58302d99dd3c tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221092dca5ca493c9d07c6ff805bd553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '340860f388c8427097069a306b00fa90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:56.686436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491427d7-345a-4fd7-b615-58302d99dd3c tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.686756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491427d7-345a-4fd7-b615-58302d99dd3c tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.687055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491427d7-345a-4fd7-b615-58302d99dd3c tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.688758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491427d7-345a-4fd7-b615-58302d99dd3c tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorizing `identity:get_project(project_id=07d47f6a8a534084b50da46d3eb0f1d9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:56.691095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491427d7-345a-4fd7-b615-58302d99dd3c tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:56.693184 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 925/1841] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:52:56 2022] GET /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9 => generated 395 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:56.694238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.694526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.694847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.714936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b80550-acf7-4471-8ccb-7e4a33b71d0f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:56.726265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:56.727819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:56.728315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:56.728784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:56.731074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] MFA Rules not processed for user `c0be5018364f4f729bf343b4604f3466`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:56.733584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:56.830843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:56.833443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:56.855488 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 917/1842] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:56.925492 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 926/1843] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:56.986237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.008098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:57.047862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cfc1c-a82f-49f8-8925-120a5a386a8b service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:57.066413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92518c8-f658-44ff-a70f-8a1b6c8e0684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:57.067100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92518c8-f658-44ff-a70f-8a1b6c8e0684 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:57.067703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92518c8-f658-44ff-a70f-8a1b6c8e0684 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:57.068172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92518c8-f658-44ff-a70f-8a1b6c8e0684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:57.071772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.106187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.187702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.208155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92518c8-f658-44ff-a70f-8a1b6c8e0684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:57.211998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92518c8-f658-44ff-a70f-8a1b6c8e0684 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:57.216311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.230804 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 918/1844] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:57.367180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:57.377816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.382830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6acf6-9717-4068-8919-67d3ff00fd9b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:57.390627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0757d-094c-4f8a-aeb4-5d40e7c8433d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:57.391266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0757d-094c-4f8a-aeb4-5d40e7c8433d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:57.391541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0757d-094c-4f8a-aeb4-5d40e7c8433d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:57.391882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0757d-094c-4f8a-aeb4-5d40e7c8433d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:57.409920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0757d-094c-4f8a-aeb4-5d40e7c8433d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:57.411888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0757d-094c-4f8a-aeb4-5d40e7c8433d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:57.443971 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 927/1845] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:57.467983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.476006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357fb88-8093-4ccc-91f0-38d2dd247f4d None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:57.476892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357fb88-8093-4ccc-91f0-38d2dd247f4d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:57.477448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357fb88-8093-4ccc-91f0-38d2dd247f4d None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:57.479383 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 919/1846] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:52:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:52:57.487282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:57.487842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:57.499721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:57.517220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:57.519401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:57.591263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357fb88-8093-4ccc-91f0-38d2dd247f4d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:57.614081 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 928/1847] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:57.617414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357fb88-8093-4ccc-91f0-38d2dd247f4d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:57.624172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:57.624868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:57.625187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:57.625495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:57.631274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:57.633082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:57.646257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437ff0-9d9c-4daa-a269-1938cb21e98a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:57.652756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:57.657428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:57.657428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:57.657428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:57.669178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:57.671126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:57.682758 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 929/1848] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:52:57.726317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:57.728243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:57.739744 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 920/1849] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:57.862919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:57.921413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:58.083164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:58.102617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00d8e2-f1bb-4c94-9ee2-61d72b2fc3cf service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:58.111223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:58.111903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:58.112194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:58.112475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:58.199216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:58.200978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:58.224250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:58.227397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 930/1850] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:58.334473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:58.704366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:59.127632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:59.162640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:59.245799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d42da-a309-4a7a-96f6-31fc8946d507 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:59.252207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:59.253241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:59.253771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:59.254849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] PATH_INFO: `/v3/users/26e8227b10c44f6ba0c9584a7bb4cfea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:59.256378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e8227b10c44f6ba0c9584a7bb4cfea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:59.258717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:59.282398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:59.286360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75780-9b32-4a43-9b1b-3283fa258b5e service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:59.294307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:59.294932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:59.295750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:59.296030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:59.303174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:59.332343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:59.474592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:59.474592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:59.505330 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 931/1851] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:52:59.506517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:59.527562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85489c33-cdf1-47ef-b370-5119623e51c5 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:59.534806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:59.535714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:59.535995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:59.536621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] PATH_INFO: `/v3/users/8a46bfe2cae646c5a88bfdf29cdf004e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:59.538343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a46bfe2cae646c5a88bfdf29cdf004e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:59.540993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:59.548943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e8227b10c44f6ba0c9584a7bb4cfea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.576461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e8227b10c44f6ba0c9584a7bb4cfea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.586520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e8227b10c44f6ba0c9584a7bb4cfea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.587341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e8227b10c44f6ba0c9584a7bb4cfea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.588494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e8227b10c44f6ba0c9584a7bb4cfea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.724907 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 921/1852] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:59 2022] DELETE /identity/v3/users/26e8227b10c44f6ba0c9584a7bb4cfea => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:59.726069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:59.734826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:59.800546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a46bfe2cae646c5a88bfdf29cdf004e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.803078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a46bfe2cae646c5a88bfdf29cdf004e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.918647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cacffe-62e8-4092-8d43-df694ca7892c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:59.925889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a46bfe2cae646c5a88bfdf29cdf004e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.927582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:59.928705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:59.929044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:59.929348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] PATH_INFO: `/v3/users/3add080246514458a5345150fa5dcd35` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:59.930980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3add080246514458a5345150fa5dcd35)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:59.933197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:59.952596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a46bfe2cae646c5a88bfdf29cdf004e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.954315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-422895d7-86f8-4cde-814e-72a682768a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a46bfe2cae646c5a88bfdf29cdf004e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:59.992265 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 932/1853] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:59 2022] DELETE /identity/v3/users/8a46bfe2cae646c5a88bfdf29cdf004e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:59.995698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073218d7-e278-4a0f-a95e-8ba84adce43a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:59.995698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073218d7-e278-4a0f-a95e-8ba84adce43a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:59.995698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073218d7-e278-4a0f-a95e-8ba84adce43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.019790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-073218d7-e278-4a0f-a95e-8ba84adce43a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:00.021141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-073218d7-e278-4a0f-a95e-8ba84adce43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.066771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:00.105833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 933/1854] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:00.105833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9053f-ea87-447a-8474-3d7e4bc86146 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.105833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9053f-ea87-447a-8474-3d7e4bc86146 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.105833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9053f-ea87-447a-8474-3d7e4bc86146 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.106229 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 934/1855] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:00.107948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.107948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.107948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.119109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:00.125709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3add080246514458a5345150fa5dcd35'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:00.136348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:00.140732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3add080246514458a5345150fa5dcd35'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:00.142820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.152455 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 935/1856] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:00.153557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:00.155898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.163802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3add080246514458a5345150fa5dcd35'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:00.167119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3add080246514458a5345150fa5dcd35'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:00.168024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3add080246514458a5345150fa5dcd35'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:00.236887 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 922/1857] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:59 2022] DELETE /identity/v3/users/3add080246514458a5345150fa5dcd35 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:00.238197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:00.239900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.280769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:00.282245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.336363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b49d09-cf63-4c92-8713-d3c7618247ac admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:00.344716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:00.345356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.345632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.345931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.353613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.370201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be0fbc-9d68-437a-afab-bfc3aed27db0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:00.540123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:00.543554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:00.562710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b6f3-351c-4acc-8618-6d0122d7ecee tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221092dca5ca493c9d07c6ff805bd553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '340860f388c8427097069a306b00fa90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:00.562710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b6f3-351c-4acc-8618-6d0122d7ecee tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.562710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b6f3-351c-4acc-8618-6d0122d7ecee tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.563113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b6f3-351c-4acc-8618-6d0122d7ecee tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.566215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b6f3-351c-4acc-8618-6d0122d7ecee tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorizing `identity:get_project(project_id=07d47f6a8a534084b50da46d3eb0f1d9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:00.566975 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 923/1858] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:00.568038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:00.578666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec285bc3-efed-43a1-9f2d-b6e40c26b198 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:00.583539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:00.583772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b6f3-351c-4acc-8618-6d0122d7ecee tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:00.584420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.584709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.585005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.587092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 936/1859] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:00 2022] GET /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9 => generated 395 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:00.588894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.592963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a5a78-ff44-4243-92a0-b9881e188385 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.592963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a5a78-ff44-4243-92a0-b9881e188385 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.593237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a5a78-ff44-4243-92a0-b9881e188385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.620453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:00.629323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:00.638863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c30a5a78-ff44-4243-92a0-b9881e188385 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:00.640675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c30a5a78-ff44-4243-92a0-b9881e188385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:00.659230 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 924/1860] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:00.665377 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 937/1861] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:00.690150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:00.700322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514910cd-763b-4483-a338-c260559be2d2 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:00.704704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:00.705426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:00.705748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:00.706004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:00.718520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:00.720363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:00.733795 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 925/1862] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:01.021298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee446-3885-47e0-b861-787ef0a0a0e0 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:01.021911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee446-3885-47e0-b861-787ef0a0a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:01.021911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee446-3885-47e0-b861-787ef0a0a0e0 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:01.023777 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 938/1863] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:01.029069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:01.030919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:01.110020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:01.156851 n-d-854121-7 devstack@keystone.service[82299]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 19:53:01.157780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:01.159684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:01.174286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afadb-cd55-4558-b440-ce6fb1fb200a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:01.185546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221092dca5ca493c9d07c6ff805bd553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '340860f388c8427097069a306b00fa90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:01.187024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:01.188119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:01.188119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:01.189044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorizing `identity:get_project(project_id=07d47f6a8a534084b50da46d3eb0f1d9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:01.191703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:01.194471 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 926/1864] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:01 2022] GET /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9 => generated 395 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:01.434415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee446-3885-47e0-b861-787ef0a0a0e0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:01.434415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90cee446-3885-47e0-b861-787ef0a0a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:01.434705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee446-3885-47e0-b861-787ef0a0a0e0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:01.440796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:01.441446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:01.441720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:01.442190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] PATH_INFO: `/v3/projects/71bcbc84be0843f7af80e07a2c4ba6e5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:01.446332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bcbc84be0843f7af80e07a2c4ba6e5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:01.451289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:01.462138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:01.581324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:01.583836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:01.600576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206713a-be02-4a7b-b8b2-e5d9ce09c708 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:01.609795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:01.610791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:01.611104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:01.611652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] PATH_INFO: `/v3/projects/d9377829c3d0497f97a230d52d87c937` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:01.613055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9377829c3d0497f97a230d52d87c937)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:01.615271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:01.669441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bcbc84be0843f7af80e07a2c4ba6e5', 'request_id': 'req-a73bab83-d538-43b5-8a58-2c5c3fe61d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.676999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bcbc84be0843f7af80e07a2c4ba6e5', 'request_id': 'req-a73bab83-d538-43b5-8a58-2c5c3fe61d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.684478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bcbc84be0843f7af80e07a2c4ba6e5', 'request_id': 'req-a73bab83-d538-43b5-8a58-2c5c3fe61d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.774979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9377829c3d0497f97a230d52d87c937', 'request_id': 'req-76d27c42-c124-426e-89af-d72a5ab034b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.782196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9377829c3d0497f97a230d52d87c937', 'request_id': 'req-76d27c42-c124-426e-89af-d72a5ab034b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.795154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9377829c3d0497f97a230d52d87c937', 'request_id': 'req-76d27c42-c124-426e-89af-d72a5ab034b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.830152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] The token cache is being invalidate because project 71bcbc84be0843f7af80e07a2c4ba6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:01.830441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.831238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.832799 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 939/1865] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:01 2022] DELETE /identity/v3/projects/71bcbc84be0843f7af80e07a2c4ba6e5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:01.833630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:01.835465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:01.903117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] The token cache is being invalidate because project d9377829c3d0497f97a230d52d87c937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:01.903659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.905116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76d27c42-c124-426e-89af-d72a5ab034b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:01.910644 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 927/1866] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:01 2022] DELETE /identity/v3/projects/d9377829c3d0497f97a230d52d87c937 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:01.912377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5017a-8d7e-4e09-849a-69479097b671 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:01.912927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5017a-8d7e-4e09-849a-69479097b671 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:01.913354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5017a-8d7e-4e09-849a-69479097b671 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:01.914895 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 928/1867] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:01.915792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5017a-8d7e-4e09-849a-69479097b671 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:01.917987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31b5017a-8d7e-4e09-849a-69479097b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:01.951084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bab83-d538-43b5-8a58-2c5c3fe61d09 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:02.020318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5017a-8d7e-4e09-849a-69479097b671 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:02.026267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:02.026815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:02.027176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:02.027448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] PATH_INFO: `/v3/users/2e5a678fd8594dc19c695a95a8ffef4f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:02.028696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5a678fd8594dc19c695a95a8ffef4f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:02.031605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:02.035018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:02.035858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:02.036128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:02.036412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] PATH_INFO: `/v3/projects/8387155c79d4432987f54bd8df9a8a78` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:02.040156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8387155c79d4432987f54bd8df9a8a78)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:02.042167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:02.225088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:02.228377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5a678fd8594dc19c695a95a8ffef4f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.228882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8387155c79d4432987f54bd8df9a8a78', 'request_id': 'req-75bdc984-bf11-40f5-80fe-a30234753c9a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.237030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8387155c79d4432987f54bd8df9a8a78', 'request_id': 'req-75bdc984-bf11-40f5-80fe-a30234753c9a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.240857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:02.242855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5a678fd8594dc19c695a95a8ffef4f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.243893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8387155c79d4432987f54bd8df9a8a78', 'request_id': 'req-75bdc984-bf11-40f5-80fe-a30234753c9a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.249859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5a678fd8594dc19c695a95a8ffef4f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.252657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5a678fd8594dc19c695a95a8ffef4f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.252657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5a678fd8594dc19c695a95a8ffef4f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.360688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] The token cache is being invalidate because project 8387155c79d4432987f54bd8df9a8a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:02.364842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.364842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.364842 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 940/1868] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:01 2022] DELETE /identity/v3/projects/8387155c79d4432987f54bd8df9a8a78 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:02.364842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:02.365421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:02.418075 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 929/1869] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:01 2022] DELETE /identity/v3/users/2e5a678fd8594dc19c695a95a8ffef4f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:02.418952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:02.420360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:02.453211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc984-bf11-40f5-80fe-a30234753c9a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:02.516039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:02.517844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:02.519264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:02.520089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:02.520407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:02.520760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] PATH_INFO: `/v3/users/c0be5018364f4f729bf343b4604f3466` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:02.522192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0be5018364f4f729bf343b4604f3466)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:02.524175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:02.615048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7040-9dca-4bf8-b924-c0b763d087a1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:02.620015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221092dca5ca493c9d07c6ff805bd553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '340860f388c8427097069a306b00fa90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:02.620664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:02.621247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:02.621247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] PATH_INFO: `/v3/projects/ee8ea837f2a4498f8adcf825bdc9240e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:02.622444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee8ea837f2a4498f8adcf825bdc9240e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:02.625036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:02.627101 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 930/1870] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:02 2022] GET /identity/v3/projects/ee8ea837f2a4498f8adcf825bdc9240e => generated 395 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:02.627831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:02.636072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:02.657203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe2e83-3e82-4b56-957e-bd0e2bcbc215 tempest-FlavorsAccessNegativeTestJSON-1546990578 tempest-FlavorsAccessNegativeTestJSON-1546990578-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:02.662485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:02.662969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:02.663252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:02.663839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] PATH_INFO: `/v3/users/493cc1cc5157481ebb7d2b2dc926870b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:02.664934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493cc1cc5157481ebb7d2b2dc926870b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:02.667081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:02.801605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0be5018364f4f729bf343b4604f3466'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.802506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0be5018364f4f729bf343b4604f3466'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.871640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493cc1cc5157481ebb7d2b2dc926870b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.884324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493cc1cc5157481ebb7d2b2dc926870b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.884550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0be5018364f4f729bf343b4604f3466'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.893300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493cc1cc5157481ebb7d2b2dc926870b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.894343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493cc1cc5157481ebb7d2b2dc926870b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.895060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493cc1cc5157481ebb7d2b2dc926870b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.897606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0be5018364f4f729bf343b4604f3466'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.898771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0be5018364f4f729bf343b4604f3466'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:02.922018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:02.927804 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 941/1871] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:02 2022] DELETE /identity/v3/users/c0be5018364f4f729bf343b4604f3466 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:02.928805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:02.930337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:02.944296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:02.990466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 931/1872] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:02 2022] DELETE /identity/v3/users/493cc1cc5157481ebb7d2b2dc926870b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:02.992277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:02.994940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:03.049048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2575002-5cbe-4632-88ca-4d762657b51c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:03.134042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:03.134697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:03.135028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:03.135680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] PATH_INFO: `/v3/users/56fc08151a3d4805a702a9b62cb08232` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:03.137171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fc08151a3d4805a702a9b62cb08232)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:03.139457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:03.175248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13334ef-c87e-45b2-bdfd-047b9132e1d3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:03.189335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:03.189335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:03.189335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:03.189335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] PATH_INFO: `/v3/projects/1a3c83d8f15e43f487fb53e4e0b7e793` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:03.190889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3c83d8f15e43f487fb53e4e0b7e793)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:03.193224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:03.495988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fc08151a3d4805a702a9b62cb08232'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.498575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fc08151a3d4805a702a9b62cb08232'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.507070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3c83d8f15e43f487fb53e4e0b7e793', 'request_id': 'req-0ed4b21b-275f-4a78-950c-d29d2e8026e8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.524839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3c83d8f15e43f487fb53e4e0b7e793', 'request_id': 'req-0ed4b21b-275f-4a78-950c-d29d2e8026e8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.544768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3c83d8f15e43f487fb53e4e0b7e793', 'request_id': 'req-0ed4b21b-275f-4a78-950c-d29d2e8026e8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.587400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fc08151a3d4805a702a9b62cb08232'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.598699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fc08151a3d4805a702a9b62cb08232'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.600443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05cd0ad7-dd4d-448d-993a-60f993f4b94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fc08151a3d4805a702a9b62cb08232'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.645585 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 942/1873] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:02 2022] DELETE /identity/v3/users/56fc08151a3d4805a702a9b62cb08232 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:03.651928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:03.653245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:03.653245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:03.681411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:03.683278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:03.708885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:03.732449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] The token cache is being invalidate because project 1a3c83d8f15e43f487fb53e4e0b7e793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:03.733032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.733984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ed4b21b-275f-4a78-950c-d29d2e8026e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:03.742792 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 932/1874] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:02 2022] DELETE /identity/v3/projects/1a3c83d8f15e43f487fb53e4e0b7e793 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:03.744409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:03.744868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:03.745435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:03.811856 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 943/1875] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:03.812236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:03.813684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:03.824397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:03.827119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:03.843333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae0fbc-5e80-47bc-bfae-6f8a278957a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:03.847760 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 933/1876] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:03.849137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:03.850149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:03.851194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:03.851559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:03.851890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:03.852356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] PATH_INFO: `/v3/projects/4249b3c5a4f549e09ec7d4a03de290d0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:03.854467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4249b3c5a4f549e09ec7d4a03de290d0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:03.856902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:03.865304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2062d-dcb8-4529-8f09-8c8e18fd6b5c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:03.870508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:03.871180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:03.871456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:03.871724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] PATH_INFO: `/v3/projects/72f7aa7eaac145be8fe4356a07d4d8e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:03.872922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f7aa7eaac145be8fe4356a07d4d8e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:03.875348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.018226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4249b3c5a4f549e09ec7d4a03de290d0', 'request_id': 'req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.027396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4249b3c5a4f549e09ec7d4a03de290d0', 'request_id': 'req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.038210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4249b3c5a4f549e09ec7d4a03de290d0', 'request_id': 'req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.041320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f7aa7eaac145be8fe4356a07d4d8e3', 'request_id': 'req-ebf0b13b-a5d1-49d2-8723-1cf4470af360'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.049441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f7aa7eaac145be8fe4356a07d4d8e3', 'request_id': 'req-ebf0b13b-a5d1-49d2-8723-1cf4470af360'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.051264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:04.056672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f7aa7eaac145be8fe4356a07d4d8e3', 'request_id': 'req-ebf0b13b-a5d1-49d2-8723-1cf4470af360'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.132945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] The token cache is being invalidate because project 4249b3c5a4f549e09ec7d4a03de290d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:04.133511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.134203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.139537 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 944/1877] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:03 2022] DELETE /identity/v3/projects/4249b3c5a4f549e09ec7d4a03de290d0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:04.139537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.142234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.207609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] The token cache is being invalidate because project 72f7aa7eaac145be8fe4356a07d4d8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:04.208724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.210002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebf0b13b-a5d1-49d2-8723-1cf4470af360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.213663 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 934/1878] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:03 2022] DELETE /identity/v3/projects/72f7aa7eaac145be8fe4356a07d4d8e3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:04.223341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f684b1-d507-44ab-b2d7-19053c86998f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.223650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f684b1-d507-44ab-b2d7-19053c86998f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.224110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f684b1-d507-44ab-b2d7-19053c86998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.224982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35fbf2-5ccc-4b14-8f58-5c9f24a4d3a4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.247711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-14f684b1-d507-44ab-b2d7-19053c86998f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:04.249551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14f684b1-d507-44ab-b2d7-19053c86998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.287559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.288475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.288891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.289102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.291541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.334911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:04.367401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 935/1879] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:04.367401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d0ab4-1038-46f5-ac26-e432b1b959be None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.367401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d0ab4-1038-46f5-ac26-e432b1b959be None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.367401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d0ab4-1038-46f5-ac26-e432b1b959be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.397102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1a6d0ab4-1038-46f5-ac26-e432b1b959be None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:04.398433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a6d0ab4-1038-46f5-ac26-e432b1b959be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.408141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 936/1880] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:04.409514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4217-5e43-48c7-8a9f-6af2f3c3254b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.409879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4217-5e43-48c7-8a9f-6af2f3c3254b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.410187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4217-5e43-48c7-8a9f-6af2f3c3254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.421897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.425899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.441274 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 945/1881] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:04.442647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.456296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a88a4217-5e43-48c7-8a9f-6af2f3c3254b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:04.459611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777514f-0535-4d3f-bf48-040353e2ce1a service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.459721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a88a4217-5e43-48c7-8a9f-6af2f3c3254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.463104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.463942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.464420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.464874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.465739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:04.466225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.466573 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 937/1882] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:04.468427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.468677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.468950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.470095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc914c-635b-4951-bb8e-591134502952 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.488198 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 946/1883] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:04.489913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.490428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.490947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.499346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:04.501492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.511002 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 938/1884] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:04.511959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.531994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0513b0-7d4e-490e-b0ab-41a17e5d30e4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.532108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:04.532108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.533698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.534441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.534725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.534998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.535641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.537683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.539861 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 947/1885] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:04.540926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.551861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb546aa3-010c-460a-9db2-0d4a34b1714d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.557346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.560518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.560518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.560518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.560518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:04.560518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.561643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.577527 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 948/1886] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:04.578733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.594707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76a3f-8158-4a04-9758-134d2cdc3629 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.611392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.612048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.612387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.612676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.613547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:04.614221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.615824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.638601 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 949/1887] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:04.640461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.652643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4d3e-e55c-4466-9dcc-0ceca77de56e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.673557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.674227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.674513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.674893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.675879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.677517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.690656 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 939/1888] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:04.691641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.793844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed58097-d516-436e-8e47-402764f1638a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.806861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.813415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.814324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.815298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.817105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.822654 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 950/1889] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/projects => generated 389 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:04.823668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.826025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.940065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce18cf3-178d-4f92-92a8-c11fe62c96ef admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.946180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.946806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.947257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.947422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.948038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.950609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.971564 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 940/1890] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/projects => generated 399 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:04.973403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.028320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:05.067757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83698-2654-47bf-be89-0dfa3bdba866 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.072765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.073417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.073677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.074141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.074939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.080341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.099782 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 951/1891] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:05.100808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.112208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571ad2-338a-4c20-a1ce-30a0d6a3a47a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.123441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.123441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.123441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.123441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.123751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.123751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.202151 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 941/1892] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:04 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:05.203114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.223990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88189-8f60-4cff-b560-22c472f082e8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.233839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.233839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.233839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.233839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.234587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.234587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.244328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 952/1893] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:05 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:05.245186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.249492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.256560 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 942/1894] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.257903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.263374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc49b1-7461-421c-a833-b947e8f9fd17 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.268863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.269508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.271972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.271972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] PATH_INFO: `/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.272160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569213-05fd-45b6-b5df-1da02fe93e41 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.272250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d47f6a8a534084b50da46d3eb0f1d9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.273362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.276268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.276873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.277155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.277431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.278107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.280384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.288256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:05.292494 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 943/1895] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.293456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.310277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dbb56-c98a-42b1-b110-32f7aa8fcb78 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.316471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.317133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.317420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.317722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.318642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.323754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.333000 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 944/1896] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.334006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.350293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81eb0-8651-4fbe-bde2-d4c77a37d713 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.357073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.357914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.358273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.358795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.359483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.361342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.373942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 945/1897] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.374588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.387185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b3be-6a4d-40ad-9d56-269a2cce92f9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.398273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.400647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.400647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.400647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.400647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.401632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.414380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 946/1898] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.418519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.422367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d47f6a8a534084b50da46d3eb0f1d9', 'request_id': 'req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.429564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcdd63-a8c7-4031-b8e3-d84c210c793b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.430456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d47f6a8a534084b50da46d3eb0f1d9', 'request_id': 'req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.440353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d47f6a8a534084b50da46d3eb0f1d9', 'request_id': 'req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.498657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.499515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.500187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.500551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.501298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.503234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.515573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] The token cache is being invalidate because project 07d47f6a8a534084b50da46d3eb0f1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:05.515573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.515889 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 947/1899] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.517888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.519538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.521906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.522542 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 953/1900] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:05 2022] DELETE /identity/v3/projects/07d47f6a8a534084b50da46d3eb0f1d9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:05.523724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.524948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.535883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3559bd-2d3b-4c7f-bbb2-74ef3463a2e7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.537727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3089bf-8f3c-46ee-804e-3457bbf4e25f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.540831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.541484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.541791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.542101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] PATH_INFO: `/v3/projects/9db888ae52464f218e8bbe0f70be57cd/users/8622cc85c4aa4363ab15288b8e5e34a8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.544512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.545892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.545892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.545892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] PATH_INFO: `/v3/projects/5b3134014adb466dae19fe5ad93f780c/users/f6856d6af5324be083893b47533b5c59/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.565474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db888ae52464f218e8bbe0f70be57cd, user_id=8622cc85c4aa4363ab15288b8e5e34a8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.566230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3134014adb466dae19fe5ad93f780c, user_id=f6856d6af5324be083893b47533b5c59, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.568179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.569019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.663325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 948/1901] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:05 2022] PUT /identity/v3/projects/9db888ae52464f218e8bbe0f70be57cd/users/8622cc85c4aa4363ab15288b8e5e34a8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:05.663325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.668167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.734867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:05.761982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a0012-d487-4d84-93ce-435e4a4e2aee admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.776740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95e860-f339-49cc-a243-9565c8c6ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.777464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95e860-f339-49cc-a243-9565c8c6ee89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.777888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95e860-f339-49cc-a243-9565c8c6ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.778213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95e860-f339-49cc-a243-9565c8c6ee89 admin admin] PATH_INFO: `/v3/projects/d273d41d844e48bdb9c0aef3eb27a8b3/users/862680f716114792b995b877e7be422f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.795217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95e860-f339-49cc-a243-9565c8c6ee89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d273d41d844e48bdb9c0aef3eb27a8b3, user_id=862680f716114792b995b877e7be422f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.798741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95e860-f339-49cc-a243-9565c8c6ee89 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:06.125812 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 954/1902] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:05 2022] PUT /identity/v3/projects/5b3134014adb466dae19fe5ad93f780c/users/f6856d6af5324be083893b47533b5c59/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:06.128503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:06.130936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:06.208929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04cb1-3e80-4b4c-964b-a0b72776f5c1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:06.214195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:06.214851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:06.215131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:06.215403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] PATH_INFO: `/v3/users/221092dca5ca493c9d07c6ff805bd553` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:06.216558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221092dca5ca493c9d07c6ff805bd553)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:06.219098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:06.480367 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 949/1903] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:05 2022] PUT /identity/v3/projects/d273d41d844e48bdb9c0aef3eb27a8b3/users/862680f716114792b995b877e7be422f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:06.480367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19a7e-5729-4efc-88e8-b8b5791661e3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:06.480367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19a7e-5729-4efc-88e8-b8b5791661e3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:06.480367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19a7e-5729-4efc-88e8-b8b5791661e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:06.507957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-18e19a7e-5729-4efc-88e8-b8b5791661e3 None None] MFA Rules not processed for user `8622cc85c4aa4363ab15288b8e5e34a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:06.509195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-18e19a7e-5729-4efc-88e8-b8b5791661e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:06.588318 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 950/1904] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:06.589592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821662-77c2-4adc-8de7-f792ffe0c245 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:06.589913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821662-77c2-4adc-8de7-f792ffe0c245 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:06.590193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821662-77c2-4adc-8de7-f792ffe0c245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:06.622589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4d821662-77c2-4adc-8de7-f792ffe0c245 None None] MFA Rules not processed for user `f6856d6af5324be083893b47533b5c59`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:06.624817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4d821662-77c2-4adc-8de7-f792ffe0c245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:06.697817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221092dca5ca493c9d07c6ff805bd553'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:06.698614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221092dca5ca493c9d07c6ff805bd553'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:06.703193 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 951/1905] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:06.704753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:06.705092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:06.705369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:06.737830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] MFA Rules not processed for user `862680f716114792b995b877e7be422f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:06.739015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:06.778623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:06.788736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221092dca5ca493c9d07c6ff805bd553'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:06.804968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221092dca5ca493c9d07c6ff805bd553'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:06.805734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221092dca5ca493c9d07c6ff805bd553'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:06.819933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:06.827415 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 955/1906] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:06 2022] DELETE /identity/v3/users/221092dca5ca493c9d07c6ff805bd553 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:06.828345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:06.833238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:06.834041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 952/1907] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:06.834041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:06.834041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:06.923479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fd441-9560-40f7-b246-dcc184ee56f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:06.933392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:06.935181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:06.935181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:06.942492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:06.943571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:06.945605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:06.955879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb524-50bc-4795-9f6e-81865d85c882 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:06.968625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:06.969259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:06.969570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:06.970088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:06.970655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:06.972699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.138408 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 953/1908] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:06 2022] POST /identity/v3/projects => generated 391 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:07.141435 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 956/1909] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:06 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:07.142458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.143244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.146851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:07.281258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9328-12b6-46e1-bd29-e771624069c3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.314231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420932-823a-4f03-b1d6-1e72226c7032 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.328145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024082-6327-4476-ae65-556c5c38533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.333761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024082-6327-4476-ae65-556c5c38533b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.334956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024082-6327-4476-ae65-556c5c38533b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.335517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024082-6327-4476-ae65-556c5c38533b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.336542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66024082-6327-4476-ae65-556c5c38533b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.353598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66024082-6327-4476-ae65-556c5c38533b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.375203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.375909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.376262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.376594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.377475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.379849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.515194 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 957/1910] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:07 2022] POST /identity/v3/users => generated 295 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:07.516318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.518711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 954/1911] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:07 2022] POST /identity/v3/projects => generated 397 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:07.520093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980fba-b06e-4992-b39d-0aa8d7a81fb0 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.520910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980fba-b06e-4992-b39d-0aa8d7a81fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.521259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980fba-b06e-4992-b39d-0aa8d7a81fb0 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.523039 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 955/1912] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:07.523956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980fba-b06e-4992-b39d-0aa8d7a81fb0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.526549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2c980fba-b06e-4992-b39d-0aa8d7a81fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:07.533010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea6afe-e174-43dc-9d00-6276ab24e898 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.547060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:07.594291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:07.610615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.612251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.612449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.612736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.614160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.616571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.619821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980fba-b06e-4992-b39d-0aa8d7a81fb0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.625616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.627132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.627738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.628283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] PATH_INFO: `/v3/projects/340860f388c8427097069a306b00fa90` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.630530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340860f388c8427097069a306b00fa90)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.634308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.727612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 958/1913] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:07 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:07.728784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.743855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b09a-cfce-468d-b51e-eb9b92c8a9d6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.749334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.749979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.750279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.750531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.751299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.752774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.766460 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 959/1914] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:07.767451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.774603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340860f388c8427097069a306b00fa90', 'request_id': 'req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:07.777247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133250-c6ae-4f73-9aa7-865736ccc257 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.781091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340860f388c8427097069a306b00fa90', 'request_id': 'req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:07.789557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340860f388c8427097069a306b00fa90', 'request_id': 'req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:07.844557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.845173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.845457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.845734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.846454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.848392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.897077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] The token cache is being invalidate because project 340860f388c8427097069a306b00fa90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:07.897587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:07.898323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89cb6584-9b66-4f98-8708-a6eaa6d2c0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:07.900032 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 956/1915] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:07 2022] DELETE /identity/v3/projects/340860f388c8427097069a306b00fa90 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:07.901239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.901521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.901799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.923684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:07.925463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:07.957822 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 960/1916] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:07 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:07.957822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.957822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:07.971941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524575d-b158-4853-bf79-f60299c0eb75 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:07.976932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:07.977544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:07.977916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:07.978268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:07.979125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:07.980748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:07.995338 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 961/1917] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:07.995338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:07.995338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.006462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 957/1918] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:53:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:08.007416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.008449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746697-2e71-4fdc-9599-1bd9ad636dbd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.010378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.016272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.017098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.017273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.017498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] PATH_INFO: `/v3/projects/be31a6fe3fe54a17bd6cfef576360950/users/a8321961e82a42c081f11dcfacd87ca2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.025257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d8495-3063-4147-9af2-b17654dd5d32 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.031425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.032065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.032343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.032617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] PATH_INFO: `/v3/users/70a78ec42efe4937a48b6f287d62841f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.034165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a78ec42efe4937a48b6f287d62841f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.036282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.037418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=be31a6fe3fe54a17bd6cfef576360950, user_id=a8321961e82a42c081f11dcfacd87ca2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.040583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.108162 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 962/1919] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:07 2022] PUT /identity/v3/projects/be31a6fe3fe54a17bd6cfef576360950/users/a8321961e82a42c081f11dcfacd87ca2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:08.108983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.110743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.165282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:08.179713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3567030-0c1f-4768-8a42-45d07a274fab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.184568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.185192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.185474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.185747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.186436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.188035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.201708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 963/1920] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:08.203185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.218760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1740ff-8603-460c-9b9d-8402c0349984 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.226475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.227167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.227447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.227718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] PATH_INFO: `/v3/projects/5872874a78a449768e4f59ce8fca34be/users/c4630845c242474da36232a67a9da352/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.234444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a78ec42efe4937a48b6f287d62841f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:08.247385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5872874a78a449768e4f59ce8fca34be, user_id=c4630845c242474da36232a67a9da352, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.250136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:08.251100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.258231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a78ec42efe4937a48b6f287d62841f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:08.270404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a78ec42efe4937a48b6f287d62841f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:08.272667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a78ec42efe4937a48b6f287d62841f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:08.280333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a78ec42efe4937a48b6f287d62841f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:08.362721 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 964/1921] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:08 2022] PUT /identity/v3/projects/5872874a78a449768e4f59ce8fca34be/users/c4630845c242474da36232a67a9da352/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:08.363612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.365626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.392496 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 958/1922] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:08 2022] DELETE /identity/v3/users/70a78ec42efe4937a48b6f287d62841f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:08.395080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.396041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.494042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facb17-a8a6-4664-ba64-9c20ae9a0142 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.506721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142acf2a-9ef8-4f52-b3b2-6c3880dadf8d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.516909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.517583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.517898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.518194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.518918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.521637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.536004 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 959/1923] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:08.537050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.538841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.568432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5e82a-5a49-42d2-bc49-2a724ca018ac admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.573793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a94516-fe78-46ec-9633-b935b01b62a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.574622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a94516-fe78-46ec-9633-b935b01b62a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.575111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a94516-fe78-46ec-9633-b935b01b62a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.575647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a94516-fe78-46ec-9633-b935b01b62a5 admin admin] PATH_INFO: `/v3/projects/3a5616749e4f49f4a799de31d215c619/users/0d0fdb2efbe74ecc8c9841af2d323e05/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.602957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a94516-fe78-46ec-9633-b935b01b62a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5616749e4f49f4a799de31d215c619, user_id=0d0fdb2efbe74ecc8c9841af2d323e05, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.608638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a94516-fe78-46ec-9633-b935b01b62a5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.637778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.639549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.639892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.640351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.644554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.670988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.676053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.684426 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 960/1924] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:08 2022] PUT /identity/v3/projects/3a5616749e4f49f4a799de31d215c619/users/0d0fdb2efbe74ecc8c9841af2d323e05/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:08.687249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.692802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.693346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.721346 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 965/1925] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:08.722935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.725605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.738216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:08.740863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.754664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4c6d-8a21-4c67-b479-7fa2c47d8775 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.829963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:08.831470 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 961/1926] 10.222.0.84 () {58 vars in 1015 bytes} [Sun Aug 28 19:53:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:08.833200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.852945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.855503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.856008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.856487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.857657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.859881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.874218 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 966/1927] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:08.875113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.886501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dadf4-bbb5-49ea-b6d6-972d44828378 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.894438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.895269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.895534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.895812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.896716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.898375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.917222 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 967/1928] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:08.917222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:08.920440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:08.936414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea493d-4f5b-4e49-b4a8-c69efa8fadb6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.940446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.941307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.941445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.941800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.953961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.955856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:08.975800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.976171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4502f6-79b6-41f6-9c81-5ea49514f8fb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:08.976171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:08.976171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:08.976171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:08.976457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] PATH_INFO: `/v3/projects/be31a6fe3fe54a17bd6cfef576360950/users/a8321961e82a42c081f11dcfacd87ca2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:08.976457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be31a6fe3fe54a17bd6cfef576360950, user_id=a8321961e82a42c081f11dcfacd87ca2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:08.981777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:08.984368 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 968/1929] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:08.987016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:09.015373 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 962/1930] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:08 2022] PUT /identity/v3/projects/be31a6fe3fe54a17bd6cfef576360950/users/a8321961e82a42c081f11dcfacd87ca2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:09.016435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:09.023273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eede15-f68f-4580-a8aa-93fee762fc7c service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:09.109089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4be09-8a87-4104-97bf-45f4e4375b8e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:09.115005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effdc3-4e8b-449e-b03a-bd5778795087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:09.115788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effdc3-4e8b-449e-b03a-bd5778795087 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.116138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effdc3-4e8b-449e-b03a-bd5778795087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.116483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effdc3-4e8b-449e-b03a-bd5778795087 admin admin] PATH_INFO: `/v3/projects/3a5616749e4f49f4a799de31d215c619/users/0d0fdb2efbe74ecc8c9841af2d323e05/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.118560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effdc3-4e8b-449e-b03a-bd5778795087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5616749e4f49f4a799de31d215c619, user_id=0d0fdb2efbe74ecc8c9841af2d323e05, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:09.120253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5caa61-10d9-40c7-80f8-1e76821dadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:09.121703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5caa61-10d9-40c7-80f8-1e76821dadd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.121703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5caa61-10d9-40c7-80f8-1e76821dadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.122073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effdc3-4e8b-449e-b03a-bd5778795087 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:09.122203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5caa61-10d9-40c7-80f8-1e76821dadd7 admin admin] PATH_INFO: `/v3/projects/5872874a78a449768e4f59ce8fca34be/users/c4630845c242474da36232a67a9da352/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.125775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5caa61-10d9-40c7-80f8-1e76821dadd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5872874a78a449768e4f59ce8fca34be, user_id=c4630845c242474da36232a67a9da352, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:09.128723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5caa61-10d9-40c7-80f8-1e76821dadd7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:09.145968 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 963/1931] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:09 2022] PUT /identity/v3/projects/3a5616749e4f49f4a799de31d215c619/users/0d0fdb2efbe74ecc8c9841af2d323e05/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:09.145968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6d649-f02d-42c5-8b4b-006d5ba7a9cf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.145968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6d649-f02d-42c5-8b4b-006d5ba7a9cf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.145968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6d649-f02d-42c5-8b4b-006d5ba7a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.154612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 969/1932] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:08 2022] PUT /identity/v3/projects/5872874a78a449768e4f59ce8fca34be/users/c4630845c242474da36232a67a9da352/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:09.156752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.157031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.157365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.187607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-44f6d649-f02d-42c5-8b4b-006d5ba7a9cf None None] MFA Rules not processed for user `a8321961e82a42c081f11dcfacd87ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:09.190926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-44f6d649-f02d-42c5-8b4b-006d5ba7a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.209589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] MFA Rules not processed for user `0d0fdb2efbe74ecc8c9841af2d323e05`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:09.210923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.331793 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 964/1933] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:09.333010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.333419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.333863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.345255 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 970/1934] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:09.346259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:09.350216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.395656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] MFA Rules not processed for user `c4630845c242474da36232a67a9da352`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:09.398351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.437844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:09.483629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d33263-2af3-4b63-9ba9-23ef55de291d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:09.489598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:09.490763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.491052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.491405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] PATH_INFO: `/v3/projects/ee8ea837f2a4498f8adcf825bdc9240e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.492643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8ea837f2a4498f8adcf825bdc9240e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:09.494631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:09.540600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 965/1935] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:09.541659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:09.543573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.629492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8ea837f2a4498f8adcf825bdc9240e', 'request_id': 'req-a79a5a4f-181f-4bec-b25b-4fb582583698'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:09.641933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8ea837f2a4498f8adcf825bdc9240e', 'request_id': 'req-a79a5a4f-181f-4bec-b25b-4fb582583698'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:09.658688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed3361-22b7-4450-9011-2905b59ee5f2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:09.671811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8ea837f2a4498f8adcf825bdc9240e', 'request_id': 'req-a79a5a4f-181f-4bec-b25b-4fb582583698'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:09.697775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:09.771681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:09.772601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.772887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.773165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.775046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.840802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:09.843316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:09.848012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] The token cache is being invalidate because project ee8ea837f2a4498f8adcf825bdc9240e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:09.849291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:09.851513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a79a5a4f-181f-4bec-b25b-4fb582583698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:09.851706 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 971/1936] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:09 2022] DELETE /identity/v3/projects/ee8ea837f2a4498f8adcf825bdc9240e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:09.856766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff842f13-c841-472d-b0a5-3f2b45842d5d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.856766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff842f13-c841-472d-b0a5-3f2b45842d5d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.856766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff842f13-c841-472d-b0a5-3f2b45842d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.861791 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 966/1937] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:09.862562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:09.876287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cc1c-cba4-41cd-9b8d-3d8b75c629c6 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:09.884716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:09.885501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.885790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.886399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.888270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.890648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ff842f13-c841-472d-b0a5-3f2b45842d5d None None] MFA Rules not processed for user `8622cc85c4aa4363ab15288b8e5e34a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:09.891961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ff842f13-c841-472d-b0a5-3f2b45842d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:09.979121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 972/1938] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:09.979121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:09.979121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:09.979121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:09.996074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:09.997675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.005869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.008120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff59f54-8ec0-4ca0-bdbb-d74ab5ff2c55 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.023965 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 967/1939] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:10.088908 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 973/1940] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:10.098333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.098940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.099318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.123967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:10.126084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.139927 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 968/1941] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:10.141011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.154886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2892-47ab-4642-b03c-75827c00a65b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:10.161909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:10.164737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.164737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.164737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.164737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:10.164737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.166154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.202499 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 974/1942] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:10.202499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:10.203609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.215695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.215985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc451a0-f4ec-40b7-ad2a-b751f50b0cc0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:10.218200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.222767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:10.223394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.223690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.224085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.224925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.226681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.236795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffaa91-79ed-4dfb-840f-46189441c673 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:10.244561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:10.245682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.246054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.246568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.249201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.274831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.277703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.292935 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 975/1943] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:53:10.355248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:10.355771 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 969/1944] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:10 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:10.356793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.374529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04340f-7384-4f4f-a124-4036b62aa23e service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:10.463376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.465394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.493235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:10.494051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.494347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.494626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.495607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.498336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.560581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488e724-6b3c-4839-ad0e-5ec40e6214b0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:10.567348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:10.567992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.568794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.569077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] PATH_INFO: `/v3/users/f6856d6af5324be083893b47533b5c59` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.570330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6856d6af5324be083893b47533b5c59)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.572488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.634591 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 976/1945] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:10 2022] POST /identity/v3/users => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:10.635486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.637294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.743614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633cea3-dfe6-48b3-9b6f-8629a9976d50 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:10.752402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:10.753169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.753537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.753997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.756079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.799872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6856d6af5324be083893b47533b5c59'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:10.812467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6856d6af5324be083893b47533b5c59'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:10.821116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6856d6af5324be083893b47533b5c59'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:10.822017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6856d6af5324be083893b47533b5c59'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:10.823177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63a7d437-3cd6-4e7c-9bd1-9610b06fcc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6856d6af5324be083893b47533b5c59'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:10.845597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:10.847245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762e00a-cc45-4542-88a4-72da2aef4447 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:10.858872 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 977/1946] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:10 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:10.875239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbaf44-0d73-437d-bc9f-1db2c796a4aa None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.875575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbaf44-0d73-437d-bc9f-1db2c796a4aa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.875797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbaf44-0d73-437d-bc9f-1db2c796a4aa None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.877332 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 978/1947] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:53:10 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:10.877952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbaf44-0d73-437d-bc9f-1db2c796a4aa None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:10.884729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d8bbaf44-0d73-437d-bc9f-1db2c796a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.897134 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 970/1948] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:10 2022] DELETE /identity/v3/users/f6856d6af5324be083893b47533b5c59 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:10.898838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72ede-3280-43b9-b315-d948e8d18c90 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:10.899130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72ede-3280-43b9-b315-d948e8d18c90 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:10.899405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72ede-3280-43b9-b315-d948e8d18c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:10.941018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-93d72ede-3280-43b9-b315-d948e8d18c90 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:10.941018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-93d72ede-3280-43b9-b315-d948e8d18c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:10.960818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:11.048492 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 971/1949] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:11.048492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.048660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.048936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.058996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbaf44-0d73-437d-bc9f-1db2c796a4aa None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.077443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.078641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.079074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.088538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.088538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.088789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:11.088885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.088968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:11.099620 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 979/1950] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:11.101064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.103795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:11.229402 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 972/1951] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:53:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:11.232097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.247096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f816-9f6e-4e0f-96ac-5dd0d7430fef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.252954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.254159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.254652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.255153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.257370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.259399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.273130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1559-d2eb-450a-b744-0057301f4253 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.273130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.273130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.273130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.275005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.283122 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 973/1952] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:11.283122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.283122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:11.291788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.294127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.304798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3c04e-6310-4081-b6c6-598bc769cca1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.314926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.315327 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 980/1953] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:11.316253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.329910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.330502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.331373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.342363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4249-4591-48df-96b5-84b3fa4392f6 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.351433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.354598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.355871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41fcd-bb35-4eb8-9242-7d903c3fb429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.356771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41fcd-bb35-4eb8-9242-7d903c3fb429 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.357121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41fcd-bb35-4eb8-9242-7d903c3fb429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.357497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41fcd-bb35-4eb8-9242-7d903c3fb429 admin admin] PATH_INFO: `/v3/projects/e5ac1580031b4e33bbaca6afe9b93319/users/aa21a059944b4a3f9041752069a8c395/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.369444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 974/1954] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:11.391199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae41fcd-bb35-4eb8-9242-7d903c3fb429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ac1580031b4e33bbaca6afe9b93319, user_id=aa21a059944b4a3f9041752069a8c395, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.394158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae41fcd-bb35-4eb8-9242-7d903c3fb429 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.472804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.473690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:11.491935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a884b-9df3-4ef4-b5c1-8b93d716a5ed service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.499679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 981/1955] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:11 2022] PUT /identity/v3/projects/e5ac1580031b4e33bbaca6afe9b93319/users/aa21a059944b4a3f9041752069a8c395/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:11.513334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.514828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.515113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.568220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.568853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.569132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.569406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] PATH_INFO: `/v3/users/862680f716114792b995b877e7be422f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.570098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] MFA Rules not processed for user `aa21a059944b4a3f9041752069a8c395`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:11.570569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862680f716114792b995b877e7be422f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.571310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:11.572503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.606907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:11.642343 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 982/1956] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:11.646746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.657050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe49f6c-ca1b-4618-b4f5-4d1b2e6dd94a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.661601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.662299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.662572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.662847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.663475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.665342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.777004 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 983/1957] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:11 2022] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:11.778445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.837421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862680f716114792b995b877e7be422f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:11.855143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d788642-b32b-470e-8aa1-1b81443c0daa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:11.860367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:11.861011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:11.861588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:11.861588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:11.862290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:11.864140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862680f716114792b995b877e7be422f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:11.864485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:11.872084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862680f716114792b995b877e7be422f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:11.872819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862680f716114792b995b877e7be422f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:11.874119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862680f716114792b995b877e7be422f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:11.973652 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 984/1958] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:11 2022] POST /identity/v3/users => generated 307 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:11.975098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.983393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:11.984284 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 975/1959] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:11 2022] DELETE /identity/v3/users/862680f716114792b995b877e7be422f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:11.985338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:11.989026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.000400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68be8-5143-4f42-b076-b04b95dec49a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.066032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.066678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.066955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.067228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] PATH_INFO: `/v3/projects/5b3134014adb466dae19fe5ad93f780c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.068421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3134014adb466dae19fe5ad93f780c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.070347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.073810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589dc5-d08c-4468-ac5b-a8f77c522074 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.079008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9c74d-644a-4690-847e-5a63c7869838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.079694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c74d-644a-4690-847e-5a63c7869838 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.079976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c74d-644a-4690-847e-5a63c7869838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.080249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c74d-644a-4690-847e-5a63c7869838 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.080933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c74d-644a-4690-847e-5a63c7869838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.082970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c74d-644a-4690-847e-5a63c7869838 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.093895 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 976/1960] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:12.095213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.095562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.095781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.117429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:12.118664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.127491 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 977/1961] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:12.128352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.138436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251d89-f237-49a1-8c79-fb723c356032 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.143397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.144073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.144345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.144917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] PATH_INFO: `/v3/projects/330e4fcc8ace4f03833e5ce20ea4a146/users/73d5a41f97044c489a71b5dd16e0cb33/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.162595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330e4fcc8ace4f03833e5ce20ea4a146, user_id=73d5a41f97044c489a71b5dd16e0cb33, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.166062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.281289 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 978/1962] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:12 2022] PUT /identity/v3/projects/330e4fcc8ace4f03833e5ce20ea4a146/users/73d5a41f97044c489a71b5dd16e0cb33/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:12.282229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.285838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.296619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3134014adb466dae19fe5ad93f780c', 'request_id': 'req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.315929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3134014adb466dae19fe5ad93f780c', 'request_id': 'req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.323038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3134014adb466dae19fe5ad93f780c', 'request_id': 'req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.347272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c7ac-e1c4-4de4-9324-c1639077d027 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.387859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] The token cache is being invalidate because project 5b3134014adb466dae19fe5ad93f780c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:12.388166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.388857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.390937 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 985/1963] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:11 2022] DELETE /identity/v3/projects/5b3134014adb466dae19fe5ad93f780c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:12.391863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.393291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.403020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.403642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.403923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.404727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.406576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.465036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72a92-77a3-4928-a9d6-5e9c7bfaf910 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.471547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.472168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.472371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.472959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.473680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.474960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.476627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:12.477759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.479583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.486825 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 986/1964] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:12.490021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.490021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.490785 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 979/1965] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:12.491518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.501632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a4c7-5016-47f3-afc3-da7148177380 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.502800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4225-af0c-4cf5-b204-110f30f3770a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.507297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492001a-1464-4f5c-a7d9-b294e6363969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.507974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492001a-1464-4f5c-a7d9-b294e6363969 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.508260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492001a-1464-4f5c-a7d9-b294e6363969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.508538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492001a-1464-4f5c-a7d9-b294e6363969 admin admin] PATH_INFO: `/v3/projects/330e4fcc8ace4f03833e5ce20ea4a146/users/73d5a41f97044c489a71b5dd16e0cb33/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.510578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492001a-1464-4f5c-a7d9-b294e6363969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330e4fcc8ace4f03833e5ce20ea4a146, user_id=73d5a41f97044c489a71b5dd16e0cb33, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.513702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492001a-1464-4f5c-a7d9-b294e6363969 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.519630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.519630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.519630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.519630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] PATH_INFO: `/v3/users/c4630845c242474da36232a67a9da352` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.521053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4630845c242474da36232a67a9da352)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.523024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.526768 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 980/1966] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:12 2022] PUT /identity/v3/projects/330e4fcc8ace4f03833e5ce20ea4a146/users/73d5a41f97044c489a71b5dd16e0cb33/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:12.538489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.538923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.539290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.572310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] MFA Rules not processed for user `73d5a41f97044c489a71b5dd16e0cb33`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:12.573708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.584233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:12.660494 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 981/1967] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:12.668126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.670845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:12.732169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4630845c242474da36232a67a9da352'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.733243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4630845c242474da36232a67a9da352'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.751622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e5a5-665f-4a3d-a659-9e3fd009de9b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:12.757815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:12.758479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:12.764851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:12.764851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:12.769915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:12.771661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:12.785304 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 982/1968] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:12 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:53:12.840269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4630845c242474da36232a67a9da352'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.850784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4630845c242474da36232a67a9da352'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.851954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4630845c242474da36232a67a9da352'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:12.871804 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 987/1969] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:12 2022] DELETE /identity/v3/users/c4630845c242474da36232a67a9da352 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:12.945881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:12.957782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228dae-d3bc-4fad-8108-c29f92feb8d9 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:13.050990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:13.053644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:13.053644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:13.053644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:13.057143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:13.126055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:13.158586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:13.162088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:13.191392 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 983/1970] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:13.225644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:13.227143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:13.318259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78f42-4ff5-430d-a91c-bdf31c20bc19 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:13.322284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:13.327196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:13.328326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:13.328675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:13.329045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] PATH_INFO: `/v3/projects/d273d41d844e48bdb9c0aef3eb27a8b3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:13.330696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d273d41d844e48bdb9c0aef3eb27a8b3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:13.332840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:13.447270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd273d41d844e48bdb9c0aef3eb27a8b3', 'request_id': 'req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.453650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd273d41d844e48bdb9c0aef3eb27a8b3', 'request_id': 'req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.461439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd273d41d844e48bdb9c0aef3eb27a8b3', 'request_id': 'req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.588949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] The token cache is being invalidate because project d273d41d844e48bdb9c0aef3eb27a8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:13.589474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.590101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.593910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 988/1971] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:13 2022] DELETE /identity/v3/projects/d273d41d844e48bdb9c0aef3eb27a8b3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:13.596341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:13.614506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3694-537e-4e93-983b-1ff198561665 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:13.684104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:13.685028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:13.685484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:13.685965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] PATH_INFO: `/v3/users/0d0fdb2efbe74ecc8c9841af2d323e05` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:13.687662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d0fdb2efbe74ecc8c9841af2d323e05)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:13.690965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:13.904912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d0fdb2efbe74ecc8c9841af2d323e05'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.980893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d0fdb2efbe74ecc8c9841af2d323e05'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.996360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d0fdb2efbe74ecc8c9841af2d323e05'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.997474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d0fdb2efbe74ecc8c9841af2d323e05'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:13.999129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d0fdb2efbe74ecc8c9841af2d323e05'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.039561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:14.041533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:14.074984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1a5c-ec59-4a77-94a1-60c5d27ef7bb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:14.094602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:14.095267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.095579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.095831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] PATH_INFO: `/v3/projects/5872874a78a449768e4f59ce8fca34be` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.106225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5872874a78a449768e4f59ce8fca34be)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:14.106225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:14.147105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 984/1972] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:13 2022] DELETE /identity/v3/users/0d0fdb2efbe74ecc8c9841af2d323e05 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:14.249014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5872874a78a449768e4f59ce8fca34be', 'request_id': 'req-74011380-42a6-4e17-8b7e-0bb350a2b0b0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.256242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5872874a78a449768e4f59ce8fca34be', 'request_id': 'req-74011380-42a6-4e17-8b7e-0bb350a2b0b0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.264360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5872874a78a449768e4f59ce8fca34be', 'request_id': 'req-74011380-42a6-4e17-8b7e-0bb350a2b0b0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.285714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:14.338183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:14.339603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:14.349256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] The token cache is being invalidate because project 5872874a78a449768e4f59ce8fca34be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:14.350836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.351887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74011380-42a6-4e17-8b7e-0bb350a2b0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.355003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 989/1973] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:14 2022] DELETE /identity/v3/projects/5872874a78a449768e4f59ce8fca34be => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:14.362331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1103b6-eabd-40d5-ac17-ad0d7d9a01f0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.362896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1103b6-eabd-40d5-ac17-ad0d7d9a01f0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.364159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1103b6-eabd-40d5-ac17-ad0d7d9a01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.399134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ed1103b6-eabd-40d5-ac17-ad0d7d9a01f0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:14.400810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ed1103b6-eabd-40d5-ac17-ad0d7d9a01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:14.492672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedb663-380f-4bb8-a21d-48f3b476eab5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:14.558265 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 990/1974] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:14.568565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.569427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.570319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.586819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:14.587910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.588192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.590096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] PATH_INFO: `/v3/users/aa21a059944b4a3f9041752069a8c395` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.591887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa21a059944b4a3f9041752069a8c395)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:14.594693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:14.601583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:14.603216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:14.613977 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 991/1975] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:14.618654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:14.634806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697675a-d15e-411c-8a2e-5b808520200e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:14.640469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:14.641287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.641641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.642018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.642745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:14.643117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:14.644966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:14.662821 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 992/1976] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:53:14.670566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:14.681645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c7831-cc42-41a1-af0c-d5f2b3c71dce admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:14.687100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:14.687722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.688018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.688295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.688931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:14.690962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:14.771138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:14.858002 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 993/1977] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:14 2022] POST /identity/v3/projects => generated 395 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:14.859273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:14.866145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:14.902069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa21a059944b4a3f9041752069a8c395'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.920743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa21a059944b4a3f9041752069a8c395'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.930510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa21a059944b4a3f9041752069a8c395'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.931730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa21a059944b4a3f9041752069a8c395'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.932411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa21a059944b4a3f9041752069a8c395'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:14.951598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088a186-6e43-446d-8765-a502e5da799e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:14.956567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:14.957325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:14.957540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:14.957810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] PATH_INFO: `/v3/projects/3a5616749e4f49f4a799de31d215c619` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:14.958995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5616749e4f49f4a799de31d215c619)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:14.961296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.032231 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 985/1978] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:14 2022] DELETE /identity/v3/users/aa21a059944b4a3f9041752069a8c395 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:15.033273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.036870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.110210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2a131-e3d4-4d41-abfc-7ef653592721 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.139299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5616749e4f49f4a799de31d215c619', 'request_id': 'req-a52de52b-385e-4da2-a57d-d2ac9a5bc457'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:15.150454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5616749e4f49f4a799de31d215c619', 'request_id': 'req-a52de52b-385e-4da2-a57d-d2ac9a5bc457'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:15.163032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5616749e4f49f4a799de31d215c619', 'request_id': 'req-a52de52b-385e-4da2-a57d-d2ac9a5bc457'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:15.200828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.201573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.201966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.202904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.203723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.205937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.276159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] The token cache is being invalidate because project 3a5616749e4f49f4a799de31d215c619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:15.276516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:15.278417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a52de52b-385e-4da2-a57d-d2ac9a5bc457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:15.291077 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 994/1979] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:14 2022] DELETE /identity/v3/projects/3a5616749e4f49f4a799de31d215c619 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:15.292931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7c4a-cad0-4b81-a92a-d2d0a2b61a78 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.293413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7c4a-cad0-4b81-a92a-d2d0a2b61a78 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.293697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7c4a-cad0-4b81-a92a-d2d0a2b61a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.316808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6edb7c4a-cad0-4b81-a92a-d2d0a2b61a78 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:15.318173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6edb7c4a-cad0-4b81-a92a-d2d0a2b61a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.326692 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 995/1980] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:15.328154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.328525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.328718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.351937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 986/1981] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:15.351937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.354256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.378362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:15.380098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.390555 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 996/1982] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:15.391911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.393759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.407319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530a48-da02-4797-ad53-7f9311d2b495 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.420369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3aee8-d625-4cb4-b475-3246f5a4d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.421085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3aee8-d625-4cb4-b475-3246f5a4d916 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.421364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3aee8-d625-4cb4-b475-3246f5a4d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.421639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3aee8-d625-4cb4-b475-3246f5a4d916 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.422500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3aee8-d625-4cb4-b475-3246f5a4d916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.424105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3aee8-d625-4cb4-b475-3246f5a4d916 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.443174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3003d-ec0b-4717-aa60-9ff905e87ef3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.443404 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 997/1983] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:15.444819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.445108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.445382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.447999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.448653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.453431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.453431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.472513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:15.473070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.481030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.481030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.490287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 987/1984] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:15.491496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.493573 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 998/1985] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:15.499061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.505813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5574d9-849b-4f20-8cb0-f9951cf8db31 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.511759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0260-c4b9-484d-9d9f-55fd95ca12ae None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.513657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.517563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.521038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.521038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.521038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.521342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.521342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.521342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.521342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.522194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.522852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:15.523949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.526402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.549696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 988/1986] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:15.550595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.565300 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 999/1987] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:15.566873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.573442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8216-2884-490e-a6c0-ff7fc6b5ab2d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.590166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e2f8d-880d-4b47-9c56-b800223f71e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.590946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2f8d-880d-4b47-9c56-b800223f71e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.591300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2f8d-880d-4b47-9c56-b800223f71e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.592210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2f8d-880d-4b47-9c56-b800223f71e9 admin admin] PATH_INFO: `/v3/projects/722e7cf4482747a98836d2a4a1761042/users/122174705b7e43ac8f85a8b0160cd693/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.593634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6f0cb-21b7-42b8-bc87-966f03b94b5d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.611478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.616121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.616554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.616978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.617651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.622677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.630932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e2f8d-880d-4b47-9c56-b800223f71e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722e7cf4482747a98836d2a4a1761042, user_id=122174705b7e43ac8f85a8b0160cd693, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.634338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e2f8d-880d-4b47-9c56-b800223f71e9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:15.734405 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 989/1988] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:15 2022] PUT /identity/v3/projects/722e7cf4482747a98836d2a4a1761042/users/122174705b7e43ac8f85a8b0160cd693/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:15.742365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.743233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.744091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.758473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:15.787930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:15.790846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.798675 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1000/1989] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:15.803907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.926922 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 990/1990] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:15.950458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:15.953019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:15.957144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbe6a5-2902-4b81-a03d-54e37b8fdf9e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:15.975865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:15.975865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:15.975865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:15.975865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:15.976197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:15.980442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.068525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a8d54-10cc-459f-bd22-8372ccf85b4e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.088762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.091936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.092222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.092647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.117210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.120759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.128881 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1001/1991] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:15 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:16.135300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.146115 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 991/1992] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:16.155111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f434c79-c4d2-449e-b8cb-82afeaf0b497 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.162808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.164849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.165649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.166228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.167147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.169348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.184623 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1002/1993] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:16.190193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.201749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920912-0318-494c-b395-c7c5d0723374 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.207596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8412f4-3105-4ff4-83de-36860679ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.209108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8412f4-3105-4ff4-83de-36860679ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.209108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8412f4-3105-4ff4-83de-36860679ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.209108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8412f4-3105-4ff4-83de-36860679ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.209943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8412f4-3105-4ff4-83de-36860679ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.211295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8412f4-3105-4ff4-83de-36860679ad9e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.225896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 992/1994] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:16.228806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.244730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576c1ef-ffe3-40d1-9c67-809e216af969 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.255652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.255652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.255652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.256012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] PATH_INFO: `/v3/projects/4fddc9a2293a464c96194c53aa8d4ef2/users/d0becfb3ce834310802d5a152e7de5ee/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.273230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fddc9a2293a464c96194c53aa8d4ef2, user_id=d0becfb3ce834310802d5a152e7de5ee, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.287663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.435165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:16.463694 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1003/1995] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:16 2022] PUT /identity/v3/projects/4fddc9a2293a464c96194c53aa8d4ef2/users/d0becfb3ce834310802d5a152e7de5ee/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:16.469378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.470014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.474305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.535591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.537951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:16.539939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] MFA Rules not processed for user `d0becfb3ce834310802d5a152e7de5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:16.546461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:16.643855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161ef88-298e-4bcf-8dc1-dcf72f790ba6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.650054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.650774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.651057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.651401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] PATH_INFO: `/v3/projects/e5ac1580031b4e33bbaca6afe9b93319` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.653280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ac1580031b4e33bbaca6afe9b93319)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.656218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.666300 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 993/1996] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:16.670493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.682550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771d1e-d10e-4105-b943-db688cf03f0f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.689758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.690464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.690733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.691007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.691656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.693609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.797334 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 994/1997] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:16 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:16.801577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.853461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ac1580031b4e33bbaca6afe9b93319', 'request_id': 'req-77751473-fc0e-4159-a764-1f282047d4cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:16.870529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ac1580031b4e33bbaca6afe9b93319', 'request_id': 'req-77751473-fc0e-4159-a764-1f282047d4cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:16.880927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ac1580031b4e33bbaca6afe9b93319', 'request_id': 'req-77751473-fc0e-4159-a764-1f282047d4cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:16.942612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8107ed-625a-45bd-bd65-7e4952bb6b94 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.946318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:16.968356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] The token cache is being invalidate because project e5ac1580031b4e33bbaca6afe9b93319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:16.969264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:16.971551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:16.975889 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1004/1998] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:16 2022] DELETE /identity/v3/projects/e5ac1580031b4e33bbaca6afe9b93319 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:17.001994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:17.006900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:17.104702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.108812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.109089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.116717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.121239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.126321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.223318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77751473-fc0e-4159-a764-1f282047d4cc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:17.233658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.234101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.234393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.234672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] PATH_INFO: `/v3/users/73d5a41f97044c489a71b5dd16e0cb33` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.236594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d5a41f97044c489a71b5dd16e0cb33)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.238700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.323173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 995/1999] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:16 2022] POST /identity/v3/users => generated 294 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:17.325775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:17.328077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:17.341418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0516eb-f156-4f4a-9850-c701c5424f1b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:17.346590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.355950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.355950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.355950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.355950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.355950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.365913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 996/2000] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:17.369015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:17.380629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13107e90-ce06-4e40-a943-d3012588877f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:17.385271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.385962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.386244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.386586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] PATH_INFO: `/v3/projects/241ad903721446d4b69b2b289c9cd052/users/c5d3c25f451f4dd6900d45d643081fe2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.406032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241ad903721446d4b69b2b289c9cd052, user_id=c5d3c25f451f4dd6900d45d643081fe2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.408870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.505425 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 997/2001] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:17 2022] PUT /identity/v3/projects/241ad903721446d4b69b2b289c9cd052/users/c5d3c25f451f4dd6900d45d643081fe2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:17.515115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:17.634009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d5a41f97044c489a71b5dd16e0cb33'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:17.635816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d5a41f97044c489a71b5dd16e0cb33'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:17.659017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893edd-0217-4a52-a4ec-152f3fa74726 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:17.667025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.667878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.668248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.669044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.669144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.671565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.685472 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 998/2002] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:17.689499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:17.702589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b995e-41a6-44c1-811b-dc1e4b7b84ec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:17.718285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903d74-1070-4c37-ac43-fd4c305b075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.719041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903d74-1070-4c37-ac43-fd4c305b075b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.719328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903d74-1070-4c37-ac43-fd4c305b075b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.719602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903d74-1070-4c37-ac43-fd4c305b075b admin admin] PATH_INFO: `/v3/projects/241ad903721446d4b69b2b289c9cd052/users/c5d3c25f451f4dd6900d45d643081fe2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.720218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d5a41f97044c489a71b5dd16e0cb33'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:17.723753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903d74-1070-4c37-ac43-fd4c305b075b admin admin] RBAC: Authorizing `identity:create_grant(project_id=241ad903721446d4b69b2b289c9cd052, user_id=c5d3c25f451f4dd6900d45d643081fe2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.728970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903d74-1070-4c37-ac43-fd4c305b075b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.729720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d5a41f97044c489a71b5dd16e0cb33'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:17.730761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-048d9888-8ba1-40c1-bb58-abde3f67e3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d5a41f97044c489a71b5dd16e0cb33'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:17.748214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 999/2003] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:17 2022] PUT /identity/v3/projects/241ad903721446d4b69b2b289c9cd052/users/c5d3c25f451f4dd6900d45d643081fe2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:17.759320 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1005/2004] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:16 2022] DELETE /identity/v3/users/73d5a41f97044c489a71b5dd16e0cb33 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:17.765572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.766218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.766810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.804747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] MFA Rules not processed for user `c5d3c25f451f4dd6900d45d643081fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:17.807704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:17.913740 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1000/2005] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:17.924511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.924962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.925255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.946886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] MFA Rules not processed for user `d0becfb3ce834310802d5a152e7de5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:17.948158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:18.038023 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1006/2006] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:18.048528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:18.050183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:18.152158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad691d8-b2c8-4c8f-ad50-a90e5ff46559 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:18.162258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:18.162902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:18.163186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:18.163530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:18.165461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:18.178039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:18.180609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41df53-b114-474f-98f4-a12d80496cbe service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:18.195574 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1001/2007] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:18.261610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:18.264770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:18.382200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d740baa-2672-47f3-9007-07e4bb5d4003 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:18.393088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:18.394934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:18.395778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:18.396603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] PATH_INFO: `/v3/projects/330e4fcc8ace4f03833e5ce20ea4a146` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:18.399152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330e4fcc8ace4f03833e5ce20ea4a146)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:18.404593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:18.491977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:18.567397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330e4fcc8ace4f03833e5ce20ea4a146', 'request_id': 'req-7383c245-3ca4-412d-bbb7-1106863a5f46'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:18.578616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330e4fcc8ace4f03833e5ce20ea4a146', 'request_id': 'req-7383c245-3ca4-412d-bbb7-1106863a5f46'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:18.582025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330e4fcc8ace4f03833e5ce20ea4a146', 'request_id': 'req-7383c245-3ca4-412d-bbb7-1106863a5f46'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:18.704174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] The token cache is being invalidate because project 330e4fcc8ace4f03833e5ce20ea4a146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:18.704480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:18.706379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7383c245-3ca4-412d-bbb7-1106863a5f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:18.709948 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1007/2008] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:18 2022] DELETE /identity/v3/projects/330e4fcc8ace4f03833e5ce20ea4a146 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:18.715221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:18.715514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:18.715782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:18.738238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:18.739500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:18.851192 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1002/2009] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:18.860178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:18.860534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:18.860858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:18.895603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:18.897423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:18.907560 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1008/2010] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:18.911779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:18.930859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6a85-0b53-4a83-8a7c-d8b727348a57 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:18.932136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:18.932962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:18.933242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:18.933772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:18.934463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:18.934886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:18.937571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:18.967660 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1003/2011] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:18.972214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:18.981921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9edb4-6d10-4a78-bc8f-cfec2e867922 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:18.990463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:18.991144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:18.991652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:18.992290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:18.992629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:18.995364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:19.166368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:19.176181 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1009/2012] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:18 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:19.181412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:19.194861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3ca00-88aa-49e6-a46b-79773addf915 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:19.266816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:19.267426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:19.267712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:19.267986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:19.268772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:19.270837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:19.418261 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1004/2013] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:19 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:19.422741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:19.433953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44e6e-9f1e-4447-a768-8a942f8ddd2f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:19.438571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:19.439177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:19.444113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:19.444113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:19.444113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:19.444113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:19.453432 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1010/2014] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:19.457656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:19.476212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d716cae-1209-48d7-b818-ce029e49b50f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:19.481728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf491f1a-16ee-431d-ab5c-f145b7e136d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:19.482386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491f1a-16ee-431d-ab5c-f145b7e136d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:19.482668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491f1a-16ee-431d-ab5c-f145b7e136d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:19.482946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491f1a-16ee-431d-ab5c-f145b7e136d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:19.483611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf491f1a-16ee-431d-ab5c-f145b7e136d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:19.485237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf491f1a-16ee-431d-ab5c-f145b7e136d2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:19.497096 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1005/2015] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:19.501281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:19.513217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacd46a-3535-4f59-a361-42e34d7d1e51 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:19.518816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:19.519634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:19.519916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:19.520258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] PATH_INFO: `/v3/projects/1e9c25b15d39410b92cf209ab4e32785/users/bfa5d6aa58b240f997a4fe2bab0efeb2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:19.538223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9c25b15d39410b92cf209ab4e32785, user_id=bfa5d6aa58b240f997a4fe2bab0efeb2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:19.550953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:19.652767 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1011/2016] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:19 2022] PUT /identity/v3/projects/1e9c25b15d39410b92cf209ab4e32785/users/bfa5d6aa58b240f997a4fe2bab0efeb2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:19.664449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:19.664917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:19.665348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:19.713036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] MFA Rules not processed for user `bfa5d6aa58b240f997a4fe2bab0efeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:19.714314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:19.798178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1006/2017] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:19.802933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:19.919687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79b220-defb-43b7-8157-bc9bf3caebaf admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:19.929343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:19.930121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:19.930599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:19.930984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:19.931782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:19.934189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.036801 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1012/2018] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:19 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:20.040927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.054966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7d28-b957-45d4-84fd-163de3986092 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.164922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.166358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.166799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.167239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.168054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.172034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.316328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1007/2019] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:20 2022] POST /identity/v3/users => generated 303 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:20.320428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.346312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5feccb-715e-4f14-8086-6c6eed543420 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.351451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.352287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.352578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.352852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.353538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.355361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.370049 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1013/2020] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:20.372501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.385891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3df0b-40e0-4698-8af2-30b7d60401a1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.391025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.391693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.391980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.392406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] PATH_INFO: `/v3/projects/b7a5f0a764a845ddbeb1451706b0cd76/users/cfc94c72b28d4dacb0ba179800c217c6/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.410359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a5f0a764a845ddbeb1451706b0cd76, user_id=cfc94c72b28d4dacb0ba179800c217c6, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.413109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.516436 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1008/2021] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:20 2022] PUT /identity/v3/projects/b7a5f0a764a845ddbeb1451706b0cd76/users/cfc94c72b28d4dacb0ba179800c217c6/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:20.520466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.532405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ec16-5993-4e0e-b93b-963bea76c359 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.628096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b1812-490e-4c42-8106-c707c3c5c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.628717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b1812-490e-4c42-8106-c707c3c5c56f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.629163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b1812-490e-4c42-8106-c707c3c5c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.629568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b1812-490e-4c42-8106-c707c3c5c56f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.631025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b1812-490e-4c42-8106-c707c3c5c56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.632942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b1812-490e-4c42-8106-c707c3c5c56f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.645118 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1014/2022] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:20.650110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.661484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa425f-7bf2-4dd0-9b3b-088720eb79b9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.666648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.668039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.669000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.669000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] PATH_INFO: `/v3/projects/b7a5f0a764a845ddbeb1451706b0cd76/users/cfc94c72b28d4dacb0ba179800c217c6/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.671561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a5f0a764a845ddbeb1451706b0cd76, user_id=cfc94c72b28d4dacb0ba179800c217c6, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.678355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.689897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1009/2023] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:20 2022] PUT /identity/v3/projects/b7a5f0a764a845ddbeb1451706b0cd76/users/cfc94c72b28d4dacb0ba179800c217c6/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:20.700925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.701898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.702173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.737408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] MFA Rules not processed for user `cfc94c72b28d4dacb0ba179800c217c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:20.738870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.840633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:20.938186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.940401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.944954 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1015/2024] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:21.100811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c169d-e943-4375-ad6b-33c3b3416bff admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.114316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ecfe-5d4a-4c94-b69d-d9a045c94aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.115233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ecfe-5d4a-4c94-b69d-d9a045c94aa0 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.115702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ecfe-5d4a-4c94-b69d-d9a045c94aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.118072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ecfe-5d4a-4c94-b69d-d9a045c94aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.153428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ecfe-5d4a-4c94-b69d-d9a045c94aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.155393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ecfe-5d4a-4c94-b69d-d9a045c94aa0 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.195328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1010/2025] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:53:21.432604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:21.634013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.797339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0caa5-4440-4b8a-982e-282d37d3990e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.810709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.811392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.811673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.811951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] PATH_INFO: `/v3/users/bfa5d6aa58b240f997a4fe2bab0efeb2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.816900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa5d6aa58b240f997a4fe2bab0efeb2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.816900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:22.135329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa5d6aa58b240f997a4fe2bab0efeb2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.136395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa5d6aa58b240f997a4fe2bab0efeb2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.254776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa5d6aa58b240f997a4fe2bab0efeb2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.263096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa5d6aa58b240f997a4fe2bab0efeb2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.264655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa5d6aa58b240f997a4fe2bab0efeb2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.308664 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1016/2026] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:21 2022] DELETE /identity/v3/users/bfa5d6aa58b240f997a4fe2bab0efeb2 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:22.314142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:22.314656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:22.314763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:22.339489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:22.345793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:22.420572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1011/2027] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:22.433284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:22.435703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:22.456837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:22.460838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:22.505741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15721418-0ba7-4bcb-a0e2-f08380244b2d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:22.525239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:22.526198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:22.526685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:22.527717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] PATH_INFO: `/v3/users/a6cd2e91843a4370967481cf4d866759` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:22.530064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cd2e91843a4370967481cf4d866759)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:22.532223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:22.620674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005d0ea-72e6-418b-b972-31302859c8fb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:22.626037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:22.626841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:22.627118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:22.627388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:22.630875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:22.678313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:22.680390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:22.709556 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1017/2028] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:22.711216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:22.716201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:22.754915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4501f-946a-4fc2-aa01-1c08245993b4 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:22.766700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:22.767364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:22.767646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:22.768049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] PATH_INFO: `/v3/users/cd4b791e7ffb420c867a880c1320f269` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:22.771901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4b791e7ffb420c867a880c1320f269)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:22.777279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:22.800619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cd2e91843a4370967481cf4d866759'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.840337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cd2e91843a4370967481cf4d866759'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.861309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cd2e91843a4370967481cf4d866759'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.862919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cd2e91843a4370967481cf4d866759'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.863592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e64d61ac-9d6e-4adb-8be7-ddea9e99007f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cd2e91843a4370967481cf4d866759'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:22.988288 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1012/2029] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:22 2022] DELETE /identity/v3/users/a6cd2e91843a4370967481cf4d866759 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:22.990141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:22.990447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:22.990728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:23.037007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:23.038289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:23.141701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4b791e7ffb420c867a880c1320f269'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:23.143848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4b791e7ffb420c867a880c1320f269'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:23.145957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1013/2030] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:23.197519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:23.199929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:23.262045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4b791e7ffb420c867a880c1320f269'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:23.274912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4b791e7ffb420c867a880c1320f269'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:23.276648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74cd8e69-e52f-474d-a5b2-d55afd872751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4b791e7ffb420c867a880c1320f269'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:23.320102 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1018/2031] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:22 2022] DELETE /identity/v3/users/cd4b791e7ffb420c867a880c1320f269 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:23.324617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:23.324980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:23.325247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:23.340164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5021645-d5ab-44ae-8091-60e6e866ecac None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:23.411521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:23.424085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:23.433029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:23.433575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:23.433883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:23.434158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:23.447266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:23.651987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:23.654598 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1019/2032] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:23.655593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:23.682888 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1014/2033] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:23.703476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:23.705704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:23.722834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f708eab-21df-4b6f-9995-46c2115e4d80 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:23.732379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:23.732379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:23.732379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:23.732379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:23.749639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:23.752779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:23.774837 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1020/2034] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:23.971196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:23.973673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:24.027107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c23da-83e0-46cb-8b22-441cb1fe0a33 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:24.057785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:24.059311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:24.061093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:24.061721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] PATH_INFO: `/v3/projects/1e9c25b15d39410b92cf209ab4e32785` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:24.067518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9c25b15d39410b92cf209ab4e32785)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:24.082096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:24.376229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9c25b15d39410b92cf209ab4e32785', 'request_id': 'req-b135d53f-4819-4f62-b7af-25f879a7a334'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:24.383287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9c25b15d39410b92cf209ab4e32785', 'request_id': 'req-b135d53f-4819-4f62-b7af-25f879a7a334'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:24.390874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9c25b15d39410b92cf209ab4e32785', 'request_id': 'req-b135d53f-4819-4f62-b7af-25f879a7a334'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:24.581716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] The token cache is being invalidate because project 1e9c25b15d39410b92cf209ab4e32785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:24.582052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:24.584668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:24.588440 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1015/2035] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:23 2022] DELETE /identity/v3/projects/1e9c25b15d39410b92cf209ab4e32785 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:24.593242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:24.606083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffbaad-e621-4271-be73-ed7ef4942744 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:24.760170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:24.789938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:24.791082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:24.791082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:24.793992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] PATH_INFO: `/v3/users/cfc94c72b28d4dacb0ba179800c217c6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:24.793992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc94c72b28d4dacb0ba179800c217c6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:24.795519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:24.832488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:25.103694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc94c72b28d4dacb0ba179800c217c6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.104923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc94c72b28d4dacb0ba179800c217c6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.177140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc94c72b28d4dacb0ba179800c217c6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.192059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc94c72b28d4dacb0ba179800c217c6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.192832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc94c72b28d4dacb0ba179800c217c6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.263019 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1021/2036] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:24 2022] DELETE /identity/v3/users/cfc94c72b28d4dacb0ba179800c217c6 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:26.156963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.164459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.177624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.179276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.200367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135d53f-4819-4f62-b7af-25f879a7a334 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.457612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5ddcc-203f-4f58-b38d-b19e43aad697 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.460524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.461201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.461485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.461779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] PATH_INFO: `/v3/projects/b7a5f0a764a845ddbeb1451706b0cd76` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.463257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a5f0a764a845ddbeb1451706b0cd76)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.465203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.467475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.480208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.480704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.481178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] PATH_INFO: `/v3/projects/bbda0fedca8f4509b6b079fcb2091a0a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.483189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbda0fedca8f4509b6b079fcb2091a0a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.487413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.664050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbda0fedca8f4509b6b079fcb2091a0a', 'request_id': 'req-1d8683da-7907-4e0f-ad50-437e48b12db6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.664829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a5f0a764a845ddbeb1451706b0cd76', 'request_id': 'req-45791ba2-949b-4320-b389-12538f22270d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.683866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a5f0a764a845ddbeb1451706b0cd76', 'request_id': 'req-45791ba2-949b-4320-b389-12538f22270d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.690873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbda0fedca8f4509b6b079fcb2091a0a', 'request_id': 'req-1d8683da-7907-4e0f-ad50-437e48b12db6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.708197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a5f0a764a845ddbeb1451706b0cd76', 'request_id': 'req-45791ba2-949b-4320-b389-12538f22270d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.711275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbda0fedca8f4509b6b079fcb2091a0a', 'request_id': 'req-1d8683da-7907-4e0f-ad50-437e48b12db6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.858743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] The token cache is being invalidate because project b7a5f0a764a845ddbeb1451706b0cd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:26.859331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.860720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.863073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1016/2037] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:26 2022] DELETE /identity/v3/projects/b7a5f0a764a845ddbeb1451706b0cd76 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:26.867176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.867176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.995231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] The token cache is being invalidate because project bbda0fedca8f4509b6b079fcb2091a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:26.995900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.996955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1d8683da-7907-4e0f-ad50-437e48b12db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.001823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45791ba2-949b-4320-b389-12538f22270d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:27.003049 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1022/2038] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:26 2022] DELETE /identity/v3/projects/bbda0fedca8f4509b6b079fcb2091a0a => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:27.004806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.005979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.006262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.079187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:27.081407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:27.130048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:27.131018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.131623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.131883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] PATH_INFO: `/v3/projects/fabc9dcb56594525a6388dc5a71a5bcc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.133199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabc9dcb56594525a6388dc5a71a5bcc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:27.135373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:27.201828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1023/2039] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:27.203344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:27.204915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:27.226017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add728-1c30-4b22-9783-60e19ff07853 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:27.233219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:27.234236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.237237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.237237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] PATH_INFO: `/v3/users/83f14da006dd467e941c17c3434123a2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.237237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f14da006dd467e941c17c3434123a2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:27.239411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:27.344664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabc9dcb56594525a6388dc5a71a5bcc', 'request_id': 'req-f07ff506-3c62-4400-aa6f-6c0f808aa64a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.354224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabc9dcb56594525a6388dc5a71a5bcc', 'request_id': 'req-f07ff506-3c62-4400-aa6f-6c0f808aa64a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.363463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabc9dcb56594525a6388dc5a71a5bcc', 'request_id': 'req-f07ff506-3c62-4400-aa6f-6c0f808aa64a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.400684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:27.452660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] The token cache is being invalidate because project fabc9dcb56594525a6388dc5a71a5bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:27.453359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.454271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f07ff506-3c62-4400-aa6f-6c0f808aa64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.464057 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1017/2040] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:26 2022] DELETE /identity/v3/projects/fabc9dcb56594525a6388dc5a71a5bcc => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:27.466649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.467125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.467623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.494761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:27.499272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:27.513190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f14da006dd467e941c17c3434123a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.516568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f14da006dd467e941c17c3434123a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.593288 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1018/2041] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:27.594435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:27.596239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:27.622324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a3ba-d045-48eb-aff4-2aa4a30e9473 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:27.628445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f14da006dd467e941c17c3434123a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.633005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:27.633863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.634170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.634454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] PATH_INFO: `/v3/users/379a6ee73a61459f8d9730862d40cd06` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.635780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379a6ee73a61459f8d9730862d40cd06)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:27.638555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:27.643061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f14da006dd467e941c17c3434123a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.643885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f14da006dd467e941c17c3434123a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.694165 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1024/2042] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:27 2022] DELETE /identity/v3/users/83f14da006dd467e941c17c3434123a2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:27.705886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:27.711723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:27.901361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379a6ee73a61459f8d9730862d40cd06'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.909755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfa59-c189-4f2c-9937-82935f762bab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:27.916068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:27.917023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.917307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.917582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.918363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:27.919517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:27.921331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:27.939159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379a6ee73a61459f8d9730862d40cd06'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.940667 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1025/2043] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:27.945745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:27.965686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379a6ee73a61459f8d9730862d40cd06'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.967496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379a6ee73a61459f8d9730862d40cd06'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.967951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a7e7200e-7333-44bc-8a97-6d51e37317c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379a6ee73a61459f8d9730862d40cd06'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:27.971888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e01cb-cc7d-42d3-9350-5ac824ba78ed admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:27.980549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:27.981394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.981993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.982273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.983098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:27.985371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:28.099051 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1026/2044] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:27 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:28.104439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.109453 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1019/2045] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:27 2022] DELETE /identity/v3/users/379a6ee73a61459f8d9730862d40cd06 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:28.112360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:28.189415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:28.238828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d6268-9522-41f1-9c0a-b8c80b9197b8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:28.317391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:28.318332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:28.318614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:28.318893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:28.319543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:28.321865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:28.395225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:28.396179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:28.396657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:28.451395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] MFA Rules not processed for user `122174705b7e43ac8f85a8b0160cd693`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:28.453659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:28.473123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1027/2046] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:28 2022] POST /identity/v3/users => generated 289 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:28.476703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.508930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e8f3d-e910-4f5e-95b8-ae4a4f5f548a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:28.529297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:28.531060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:28.531347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:28.531628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:28.532326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:28.541890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:28.571127 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1020/2048] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:28.575132 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1028/2048] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:28.576144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.581470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.589490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:28.602836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddde8b-a5a7-47aa-b713-73322eaae065 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:28.614771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:28.615456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:28.616787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807888b-e071-46fb-a764-aeff8819eaac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:28.618450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:28.618763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:28.624398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:28.626163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:28.635160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:28.636085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:28.636421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:28.636760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:28.638251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:28.640309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:28.651048 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1021/2049] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:28.652313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.663997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af45de-3c7a-41b2-b83b-4445d1de2d32 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:28.671589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:28.672515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:28.672815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:28.673147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] PATH_INFO: `/v3/projects/a15f24443fde4ce6b99f55dfae1dc5b9/users/d3d9c3f50fbf42fb94714d3238b6886b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:28.696920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15f24443fde4ce6b99f55dfae1dc5b9, user_id=d3d9c3f50fbf42fb94714d3238b6886b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:28.700439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:28.785631 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1029/2050] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:28 2022] POST /identity/v3/projects => generated 397 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:28.791117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.842284 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1022/2051] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:28 2022] PUT /identity/v3/projects/a15f24443fde4ce6b99f55dfae1dc5b9/users/d3d9c3f50fbf42fb94714d3238b6886b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:28.850086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:28.857680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:28.926804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0d5f-b110-4587-bbd2-718f91218a28 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.027127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8bd10-fdef-4f7f-a001-75969d3f227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.028255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8bd10-fdef-4f7f-a001-75969d3f227a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.029810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8bd10-fdef-4f7f-a001-75969d3f227a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.030323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8bd10-fdef-4f7f-a001-75969d3f227a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.031234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8bd10-fdef-4f7f-a001-75969d3f227a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:29.037673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb2b3-3c5f-4382-909c-0ad4850585cf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.038427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8bd10-fdef-4f7f-a001-75969d3f227a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:29.046303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.047248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.047741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.048216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] PATH_INFO: `/v3/projects/f40a2851e75044f4ae43bd99ea6022b3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.049517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40a2851e75044f4ae43bd99ea6022b3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:29.053627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:29.198960 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1030/2052] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:28 2022] POST /identity/v3/users => generated 305 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:29.201904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.202187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.202636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.249203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] MFA Rules not processed for user `d3d9c3f50fbf42fb94714d3238b6886b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:29.250468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.268459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40a2851e75044f4ae43bd99ea6022b3', 'request_id': 'req-0838f0bb-1714-4c37-8789-7922194315cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.276690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40a2851e75044f4ae43bd99ea6022b3', 'request_id': 'req-0838f0bb-1714-4c37-8789-7922194315cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.295134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40a2851e75044f4ae43bd99ea6022b3', 'request_id': 'req-0838f0bb-1714-4c37-8789-7922194315cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.355422 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1031/2053] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:29.355422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:29.358398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.475007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440f22c-ab45-4083-be9b-1d7be8ca63d6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.482022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.482775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.483131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.483761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] PATH_INFO: `/v3/projects/fb4dccf9d86342f38b0594027376ca47` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.485237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb4dccf9d86342f38b0594027376ca47)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:29.487531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:29.507364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] The token cache is being invalidate because project f40a2851e75044f4ae43bd99ea6022b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:29.507811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.509289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.512683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1023/2054] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:28 2022] DELETE /identity/v3/projects/f40a2851e75044f4ae43bd99ea6022b3 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:29.515023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:29.517493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.528606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:29.543613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f0bb-1714-4c37-8789-7922194315cc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.551179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.552029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.552273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.553440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.553440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:29.555540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:29.571485 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1024/2055] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:29.571485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:29.571485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.585144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f7c3-a2ce-4b21-9294-bae40b807ed2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.590954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032c68-6fa2-4e35-83cd-1f7f080f970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.591764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032c68-6fa2-4e35-83cd-1f7f080f970f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.591911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032c68-6fa2-4e35-83cd-1f7f080f970f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.592182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032c68-6fa2-4e35-83cd-1f7f080f970f admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.592833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa032c68-6fa2-4e35-83cd-1f7f080f970f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:29.594775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa032c68-6fa2-4e35-83cd-1f7f080f970f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:29.684170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4dccf9d86342f38b0594027376ca47', 'request_id': 'req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.696393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4dccf9d86342f38b0594027376ca47', 'request_id': 'req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.703822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4dccf9d86342f38b0594027376ca47', 'request_id': 'req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.713690 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1025/2056] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:29 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:29.715227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.715518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.715792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.747822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:29.750101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.777824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] The token cache is being invalidate because project fb4dccf9d86342f38b0594027376ca47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:29.778721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.780958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:29.783397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1032/2057] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:29 2022] DELETE /identity/v3/projects/fb4dccf9d86342f38b0594027376ca47 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:29.787375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:29.791153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.861920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1026/2058] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:29.864045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:29.866595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:29.906819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6988c-2bc9-47ab-8dec-2246a0c75ca4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.912496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.913267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.913553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.913825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] PATH_INFO: `/v3/projects/84c7175ddb9b4afb90a388c22813b629/users/1e9d23f811c74800ba53ae611844a8d0/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.931460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c7175ddb9b4afb90a388c22813b629, user_id=1e9d23f811c74800ba53ae611844a8d0, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:29.935545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:29.964110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a0c3-4050-4312-bc8e-054b09f023fc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:29.970447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:29.971283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:29.971576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:29.971894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:29.973773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.033208 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1033/2059] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:29 2022] PUT /identity/v3/projects/84c7175ddb9b4afb90a388c22813b629/users/1e9d23f811c74800ba53ae611844a8d0/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:30.033208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.033518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.056990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.058891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443c5ce-9db2-4668-895e-95b108d60317 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.070967 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1027/2060] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:30.072372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5fc2c-fe1f-4844-8cd6-33efa6bd44c8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.072733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5fc2c-fe1f-4844-8cd6-33efa6bd44c8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.073078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5fc2c-fe1f-4844-8cd6-33efa6bd44c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.100653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3df5fc2c-fe1f-4844-8cd6-33efa6bd44c8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:30.101937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3df5fc2c-fe1f-4844-8cd6-33efa6bd44c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.172641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073cf7-5e15-4733-92e5-0a638206cb4a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.177702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d9be0-2850-4d83-be0b-6621ec5cdbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.186438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9be0-2850-4d83-be0b-6621ec5cdbdb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.186664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9be0-2850-4d83-be0b-6621ec5cdbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.186943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9be0-2850-4d83-be0b-6621ec5cdbdb admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.187784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d9be0-2850-4d83-be0b-6621ec5cdbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.190032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d9be0-2850-4d83-be0b-6621ec5cdbdb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.213916 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1028/2061] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:30.213916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.213916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.213916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.237277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:30.238787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.248961 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1029/2062] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:30.250161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.265352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c444d-6ff1-421c-8d92-8646a3db9e07 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.268696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.269383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.269645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.269946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.270603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.272293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.284116 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1030/2063] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:30.288061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.289647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.303580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1e8a-c17c-418c-a859-df2c08543cd5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.308456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.309097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.309799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.309799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] PATH_INFO: `/v3/users/dc619d72ea5348e3a1712eec0757e0d2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.311380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc619d72ea5348e3a1712eec0757e0d2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.313416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.323017 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1034/2064] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:30 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:30.324542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.324897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.325235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.371375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:30.373707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.389241 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1035/2065] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:30.389784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.414760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51cfa0-9a55-4980-9e46-d1452e0f6498 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.431536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.432587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.433089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.433508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.434353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:30.434809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.437315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.451831 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1036/2066] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:30.452986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.469886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0e0f-b403-4ef7-bbc5-a9b032405a1a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.476171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.476849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.477297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.477581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] PATH_INFO: `/v3/projects/84c7175ddb9b4afb90a388c22813b629/users/1e9d23f811c74800ba53ae611844a8d0/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.480573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c7175ddb9b4afb90a388c22813b629, user_id=1e9d23f811c74800ba53ae611844a8d0, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.483886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.500335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1037/2067] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:30 2022] PUT /identity/v3/projects/84c7175ddb9b4afb90a388c22813b629/users/1e9d23f811c74800ba53ae611844a8d0/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:30.501917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.567926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc619d72ea5348e3a1712eec0757e0d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:30.591786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc619d72ea5348e3a1712eec0757e0d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:30.607646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc619d72ea5348e3a1712eec0757e0d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:30.608961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc619d72ea5348e3a1712eec0757e0d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:30.608961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc619d72ea5348e3a1712eec0757e0d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:30.632614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6a0c1-4b59-467c-a661-9bf20fa47caa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.638753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.639378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.639663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.639947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.640601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.642445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.653436 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1038/2068] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:30.658167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.660135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.674982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e55bfb-3a9f-4919-8139-2e1d0b038ddd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.680403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.681021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.681305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.681574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.682295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:30.682606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.684351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.703293 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1039/2069] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:30.703293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.704895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.721554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c54c-e076-490b-8b14-267933fb83d5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.725832 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1031/2070] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:30 2022] DELETE /identity/v3/users/dc619d72ea5348e3a1712eec0757e0d2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:30.728033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.729073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.729887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.730296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.730599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.731327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.733324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:30.733844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.824220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943492e3-e2ac-450d-bdf4-01b97213c279 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.829657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203666d-5760-468f-8387-bcf7bc052b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.830492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203666d-5760-468f-8387-bcf7bc052b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.832656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203666d-5760-468f-8387-bcf7bc052b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.832656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203666d-5760-468f-8387-bcf7bc052b1f admin admin] PATH_INFO: `/v3/projects/7f4172f61bc143f7bb4b05c8175d21d4/users/1e93cd3ff16349a990c231345c79b569/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.845625 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1040/2071] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:30 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:30.846703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:30.858466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203666d-5760-468f-8387-bcf7bc052b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4172f61bc143f7bb4b05c8175d21d4, user_id=1e93cd3ff16349a990c231345c79b569, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.861879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203666d-5760-468f-8387-bcf7bc052b1f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:30.958875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7a496-2d90-46b6-8eff-f809e83d4e2a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:30.965466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:30.966701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:30.966900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:30.967179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:30.967896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:30.969832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.025480 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1032/2072] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:30 2022] PUT /identity/v3/projects/7f4172f61bc143f7bb4b05c8175d21d4/users/1e93cd3ff16349a990c231345c79b569/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:31.029927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.031411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.031706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.084666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:31.088081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:31.102537 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1041/2073] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:30 2022] POST /identity/v3/projects => generated 369 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:31.102537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.198378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb9eb-cab6-4778-82dc-7302ce7ce71e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.206319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.207519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.207805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.208082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.208701 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1033/2074] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:31.209028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.210922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.224563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.224563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8474-2be1-44c2-9274-6bf8c1a4d4b8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.230068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.230785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.231132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.231416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.232164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.233728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.248561 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1034/2075] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:31.249445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.267396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b77e4-6459-4760-8773-e238572e09c8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.273243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.273982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.274328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.274823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.275529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.278748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.333250 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1042/2076] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:31 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:31.334302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.336626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:31.413159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29268-c542-4d0e-9fab-a6d05c43b4b6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.425894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.426653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.426938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.427210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.438329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.439865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.451043 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1043/2077] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:31.451900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.466481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d27eb-001d-4e22-8011-86818aa559a7 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.476385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.477955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.477955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.481302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] PATH_INFO: `/v3/projects/7f4172f61bc143f7bb4b05c8175d21d4/users/1e93cd3ff16349a990c231345c79b569/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.483815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4172f61bc143f7bb4b05c8175d21d4, user_id=1e93cd3ff16349a990c231345c79b569, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.485941 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1035/2078] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:31 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:31.487046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.489961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.503850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9f5dd-c6fd-4c67-be5c-f6a1a4c4e38a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.506702 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1044/2079] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:31 2022] PUT /identity/v3/projects/7f4172f61bc143f7bb4b05c8175d21d4/users/1e93cd3ff16349a990c231345c79b569/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:31.507862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.662053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf67e5-1325-44e5-8167-e6b06212a74e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.662214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbe5e4-3a6e-4532-a597-f48cf7384209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.662214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbe5e4-3a6e-4532-a597-f48cf7384209 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.662214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbe5e4-3a6e-4532-a597-f48cf7384209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.662214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbe5e4-3a6e-4532-a597-f48cf7384209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.663136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbe5e4-3a6e-4532-a597-f48cf7384209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.663272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbe5e4-3a6e-4532-a597-f48cf7384209 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.664286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.665120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.665471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.665814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.666598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.668558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.675688 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1036/2080] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:31.677824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.678208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.678716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.682343 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1045/2081] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:31.687808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.701713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee75cb-1617-4ad4-b9b8-4e3ecf8c6c6d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.707627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.708449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.713195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.713195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.713195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.713195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.729471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1046/2082] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:31.732470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.735539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] MFA Rules not processed for user `1e93cd3ff16349a990c231345c79b569`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:31.737569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:31.751769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21519bc1-acae-49fb-9d04-49aac1d7493a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.766122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.767367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.767758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.768132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.770595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.772941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.804689 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1047/2083] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:31.804689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.820520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510c83-cf21-4cfe-a61e-16cc55dff9ae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.831559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.832343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.832754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.833948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] PATH_INFO: `/v3/projects/f3ade3395dc94951a0071f8855712202/users/0fff56a5bab1465893a3fb73cb14b1db/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.859096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ade3395dc94951a0071f8855712202, user_id=0fff56a5bab1465893a3fb73cb14b1db, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.877069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:31.891235 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1037/2084] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:31.891235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:31.905452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a02e3-48f3-44dc-9c65-f03cea03a761 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:31.910804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:31.911556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.911836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.912106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] PATH_INFO: `/v3/projects/5a1a7fbaeb33496cbc900f9eff65a66e/users/52f0490e551e41f281c9219a093a5464/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.945724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1a7fbaeb33496cbc900f9eff65a66e, user_id=52f0490e551e41f281c9219a093a5464, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:31.945724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.296246 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1038/2086] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:31 2022] PUT /identity/v3/projects/5a1a7fbaeb33496cbc900f9eff65a66e/users/52f0490e551e41f281c9219a093a5464/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:32.297514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.308579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.320852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:32.321466 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1048/2086] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:31 2022] PUT /identity/v3/projects/f3ade3395dc94951a0071f8855712202/users/0fff56a5bab1465893a3fb73cb14b1db/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:32.322880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.324930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.412596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217f54-f4f8-4bdb-bc01-3c091b2cc7b0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.484668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5fc40-87b4-49b7-a873-983b987a6512 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.490203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9ddc3-29d0-40ad-9d18-a01adc6f32df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.490846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9ddc3-29d0-40ad-9d18-a01adc6f32df service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.491126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9ddc3-29d0-40ad-9d18-a01adc6f32df service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.491591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9ddc3-29d0-40ad-9d18-a01adc6f32df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.520968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.521628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.521960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.522238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] PATH_INFO: `/v3/projects/95c5ca8805924846b6cfddfb38797097` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.523777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c5ca8805924846b6cfddfb38797097)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.526134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.597601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9ddc3-29d0-40ad-9d18-a01adc6f32df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.599286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9ddc3-29d0-40ad-9d18-a01adc6f32df service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.613807 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1039/2087] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:32.616161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009ba5-d07e-48f0-9844-8c226616a847 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.616378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009ba5-d07e-48f0-9844-8c226616a847 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.616759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009ba5-d07e-48f0-9844-8c226616a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.655094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-14009ba5-d07e-48f0-9844-8c226616a847 None None] MFA Rules not processed for user `0fff56a5bab1465893a3fb73cb14b1db`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:32.656392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14009ba5-d07e-48f0-9844-8c226616a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.703022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c5ca8805924846b6cfddfb38797097', 'request_id': 'req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:32.710062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c5ca8805924846b6cfddfb38797097', 'request_id': 'req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:32.722360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c5ca8805924846b6cfddfb38797097', 'request_id': 'req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:32.743974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1040/2088] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:32.745328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.745619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.745924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.776489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] MFA Rules not processed for user `52f0490e551e41f281c9219a093a5464`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:32.777723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.828268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:32.850805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] The token cache is being invalidate because project 95c5ca8805924846b6cfddfb38797097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:32.851268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:32.852431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:32.854504 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1049/2089] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:32 2022] DELETE /identity/v3/projects/95c5ca8805924846b6cfddfb38797097 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:32.855524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.858544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.929364 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1041/2090] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:32.935222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.935222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.955161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c3e9-729f-4284-8f0b-bd3a7581bb89 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:33.003219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:33.003881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:33.004237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:33.005410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:33.008128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:33.013887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:33.158334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371a810-478a-4d30-b091-076c432b7c19 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:33.168117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:33.168977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:33.169801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:33.170294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] PATH_INFO: `/v3/users/4f97f37b4ebf440cb237272dfe5adde5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:33.171977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f97f37b4ebf440cb237272dfe5adde5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:33.175215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:33.211609 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1050/2091] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:32 2022] POST /identity/v3/projects => generated 389 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:33.212947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:33.217780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:33.319014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c58a8-4f05-4d84-b2fa-41584534d40b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:33.326712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:33.326712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:33.326712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:33.326712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:33.327048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:33.328564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:33.463223 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1051/2092] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:33 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:33.467765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:33.535011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f97f37b4ebf440cb237272dfe5adde5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:33.575089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f97f37b4ebf440cb237272dfe5adde5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:33.588820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f97f37b4ebf440cb237272dfe5adde5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:33.589888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f97f37b4ebf440cb237272dfe5adde5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:33.591790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f97f37b4ebf440cb237272dfe5adde5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:33.623621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd04b-aafc-4adf-934c-8bd34a75f6bc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:33.638500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:33.638500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:33.638500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:33.638500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:33.639099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:33.639099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:33.795225 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1042/2093] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:32 2022] DELETE /identity/v3/users/4f97f37b4ebf440cb237272dfe5adde5 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:33.804015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:33.804015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:33.902382 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1052/2094] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:33 2022] POST /identity/v3/users => generated 301 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:33.905355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:33.907645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:33.920127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badfd88-5d0f-4095-80de-4c82eba9ba05 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:33.926272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459630e6-2cea-41f1-98ab-2a6465a7b4b6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:33.929149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:33.931615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:33.932526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:33.933204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:33.934555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:33.938724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:33.938932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:33.940286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:33.940286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:33.940286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] PATH_INFO: `/v3/users/d3d9c3f50fbf42fb94714d3238b6886b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:33.943667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d9c3f50fbf42fb94714d3238b6886b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:33.945072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.092871 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1043/2095] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:33 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:34.095352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.102071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:34.133826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090ee9-4c49-48b0-b9ef-20f48fde0b7b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.151222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.152025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.152312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.152592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.153354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.155749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.191687 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1044/2096] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:34.193692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.219471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392e627-8ec3-42d5-b0f0-4a7920f2b606 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.229708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.230379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.230668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.230957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.232224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.234137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.249206 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1045/2097] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:34.250168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.264103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ed6e-dae5-473c-8183-387c79ae4ef7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.265263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d9c3f50fbf42fb94714d3238b6886b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.266181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d9c3f50fbf42fb94714d3238b6886b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.275241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.276072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.276359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.276635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] PATH_INFO: `/v3/projects/69c566294f7d45ffa6aeb748594292b4/users/cc712da3a7ba4b2c87622ab99f19c1e6/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.298461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c566294f7d45ffa6aeb748594292b4, user_id=cc712da3a7ba4b2c87622ab99f19c1e6, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.303018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.374313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d9c3f50fbf42fb94714d3238b6886b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.383345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d9c3f50fbf42fb94714d3238b6886b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.384850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d9c3f50fbf42fb94714d3238b6886b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.398962 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1046/2098] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:34 2022] PUT /identity/v3/projects/69c566294f7d45ffa6aeb748594292b4/users/cc712da3a7ba4b2c87622ab99f19c1e6/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:34.400074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.404450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:34.409279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1053/2099] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:33 2022] DELETE /identity/v3/users/d3d9c3f50fbf42fb94714d3238b6886b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:34.410638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.412207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:34.514268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449c23e-2ad6-4fd7-acc9-ca39e40e278b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.557306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe4aa-0449-4c26-8a25-2b494369b3e8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.566170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a499e-17fb-4db1-8041-55136935c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.568849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a499e-17fb-4db1-8041-55136935c114 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.569565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a499e-17fb-4db1-8041-55136935c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.570034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a499e-17fb-4db1-8041-55136935c114 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.570921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a499e-17fb-4db1-8041-55136935c114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.573816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a499e-17fb-4db1-8041-55136935c114 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.588242 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1054/2100] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:34.590200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.590494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.590772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.599606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.601672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.601672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.601672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] PATH_INFO: `/v3/projects/28d94f4cad194bb7917b91c56c7a26b3/users/9269ef03e1474e5dab99edc13f6c0435/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.624062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d94f4cad194bb7917b91c56c7a26b3, user_id=9269ef03e1474e5dab99edc13f6c0435, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.626721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.658646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:34.658646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:34.660825 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1055/2101] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:34.662695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.665553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:34.679487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29a211-7aeb-44a2-9b7a-c9f7cb218f5a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.685410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.686090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.686382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.686640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] PATH_INFO: `/v3/projects/14123064f74442d9904b910fadf04a25` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.687830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14123064f74442d9904b910fadf04a25)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.689745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:34.771493 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1047/2102] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:34 2022] PUT /identity/v3/projects/28d94f4cad194bb7917b91c56c7a26b3/users/9269ef03e1474e5dab99edc13f6c0435/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:34.772724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.842515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14123064f74442d9904b910fadf04a25', 'request_id': 'req-a26246e6-96bc-4c8e-b2bd-34701debe029'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.851358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14123064f74442d9904b910fadf04a25', 'request_id': 'req-a26246e6-96bc-4c8e-b2bd-34701debe029'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.862262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26025f6-71b9-43a6-b002-b051565dc9e0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:34.863095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14123064f74442d9904b910fadf04a25', 'request_id': 'req-a26246e6-96bc-4c8e-b2bd-34701debe029'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.940310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] The token cache is being invalidate because project 14123064f74442d9904b910fadf04a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:34.940766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.943168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:34.945690 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1056/2103] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:34 2022] DELETE /identity/v3/projects/14123064f74442d9904b910fadf04a25 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:34.948027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:34.952697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:34.969474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:34.978504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:34.978504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:34.978504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] PATH_INFO: `/v3/projects/69c566294f7d45ffa6aeb748594292b4/users/cc712da3a7ba4b2c87622ab99f19c1e6/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:34.978504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c566294f7d45ffa6aeb748594292b4, user_id=cc712da3a7ba4b2c87622ab99f19c1e6, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:34.986300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.019796 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1048/2104] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:34 2022] PUT /identity/v3/projects/69c566294f7d45ffa6aeb748594292b4/users/cc712da3a7ba4b2c87622ab99f19c1e6/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:35.020885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:35.027585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.035448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:35.090116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26246e6-96bc-4c8e-b2bd-34701debe029 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:35.146460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1e2a5-3916-4603-beb4-cb3470ba8a6f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:35.153039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ceb1-bb1b-42e6-b4b2-ff5079ee616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:35.154023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ceb1-bb1b-42e6-b4b2-ff5079ee616f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.154460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ceb1-bb1b-42e6-b4b2-ff5079ee616f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.155083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ceb1-bb1b-42e6-b4b2-ff5079ee616f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.155830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2ceb1-bb1b-42e6-b4b2-ff5079ee616f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:35.157652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2ceb1-bb1b-42e6-b4b2-ff5079ee616f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.164046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:35.165980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.166367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.166649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.168653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.171669 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1049/2105] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:35.173038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd0bd-c345-429f-ad94-e47585402c09 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.173330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd0bd-c345-429f-ad94-e47585402c09 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.173612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd0bd-c345-429f-ad94-e47585402c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.195653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:35.205988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ea4bd0bd-c345-429f-ad94-e47585402c09 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:35.205988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea4bd0bd-c345-429f-ad94-e47585402c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.225146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.244292 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1050/2106] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:35.245944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e100d5-c980-466b-97c8-70b17ecba317 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.246238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e100d5-c980-466b-97c8-70b17ecba317 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.246514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e100d5-c980-466b-97c8-70b17ecba317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.256054 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1057/2107] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:35.257696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:35.289381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016df72-ee7a-47d9-9fe2-cb5d3f2934be service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:35.306939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81806c6e-8746-4285-8a99-3d8c0a6139b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:35.308165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81806c6e-8746-4285-8a99-3d8c0a6139b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.308165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81806c6e-8746-4285-8a99-3d8c0a6139b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.308165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81806c6e-8746-4285-8a99-3d8c0a6139b4 admin admin] PATH_INFO: `/v3/projects/28d94f4cad194bb7917b91c56c7a26b3/users/9269ef03e1474e5dab99edc13f6c0435/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.310815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81806c6e-8746-4285-8a99-3d8c0a6139b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d94f4cad194bb7917b91c56c7a26b3, user_id=9269ef03e1474e5dab99edc13f6c0435, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:35.313714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81806c6e-8746-4285-8a99-3d8c0a6139b4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.344498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-73e100d5-c980-466b-97c8-70b17ecba317 None None] MFA Rules not processed for user `cc712da3a7ba4b2c87622ab99f19c1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:35.349586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73e100d5-c980-466b-97c8-70b17ecba317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.350121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1058/2108] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:35 2022] PUT /identity/v3/projects/28d94f4cad194bb7917b91c56c7a26b3/users/9269ef03e1474e5dab99edc13f6c0435/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:35.351671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.351997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.352354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.386074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:35.387330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.575762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1051/2109] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:35.575762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.575762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.588191 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1059/2110] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:35.589247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.593096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:35.596042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.664151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] MFA Rules not processed for user `9269ef03e1474e5dab99edc13f6c0435`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:35.666240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:35.773539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d97c-9966-4d20-b454-82ba2d7c2cf7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:35.789014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:35.789014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.789014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.789014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.800217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:35.800217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.802119 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1052/2111] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:35.803539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:35.813208 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1060/2112] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:35.822913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059ee27-ce0d-490c-bfee-7dcafcfbfb59 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:35.829628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:35.830482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.831173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.831531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.832930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:35.833555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:35.839148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.864050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1053/2113] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:35.868502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:35.892564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612f473-e339-4add-b679-2d2163e8dedd service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:35.905264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:35.906011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:35.906555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:35.906848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:35.907506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:35.909584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:35.970322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:35.990391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c74a6-f060-4fec-8dba-72c49ce832fa admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.011931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.012564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.013583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1061/2114] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:35 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:36.014219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.014521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.018025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:36.065707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.065707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:36.065707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:36.084295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1054/2115] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:53:36.190969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af913ad-37fb-46ab-be96-42accc8dc18b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.211905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.212807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.213147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.216579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.216579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.218953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:36.227753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:36.230411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:36.269160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb99f4-e501-431b-885a-4a89d279cbcb service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.280071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.280726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.281013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.281325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] PATH_INFO: `/v3/users/8622cc85c4aa4363ab15288b8e5e34a8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.282901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8622cc85c4aa4363ab15288b8e5e34a8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.286781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:36.364833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1062/2116] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:36 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:36.364833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:36.378239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7d1f-14a6-4383-984d-bdc0678d2dad admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.383876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.384746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.385118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.385576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] PATH_INFO: `/v3/users/52f0490e551e41f281c9219a093a5464` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.386841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f0490e551e41f281c9219a093a5464)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.394966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:36.512702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8622cc85c4aa4363ab15288b8e5e34a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.532443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8622cc85c4aa4363ab15288b8e5e34a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.552992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8622cc85c4aa4363ab15288b8e5e34a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.554268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8622cc85c4aa4363ab15288b8e5e34a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.554987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8622cc85c4aa4363ab15288b8e5e34a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.621456 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1055/2117] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:36 2022] DELETE /identity/v3/users/8622cc85c4aa4363ab15288b8e5e34a8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:36.622937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:36.624841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:36.639961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f0490e551e41f281c9219a093a5464'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.640962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f0490e551e41f281c9219a093a5464'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.723495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9cd2-ed74-472b-a02e-af85f6944678 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.732108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.733220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.733220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.733448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.734039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.736642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:36.749314 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1056/2118] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:36.750347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:36.752300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:36.767414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9680-6d73-4332-bccc-360134a1e869 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.775991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.775991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.775991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.775991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] PATH_INFO: `/v3/users/0fff56a5bab1465893a3fb73cb14b1db` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.777186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fff56a5bab1465893a3fb73cb14b1db)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.778757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f0490e551e41f281c9219a093a5464'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.780085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:36.789077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f0490e551e41f281c9219a093a5464'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.790266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f0490e551e41f281c9219a093a5464'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:36.832575 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1063/2119] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:36 2022] DELETE /identity/v3/users/52f0490e551e41f281c9219a093a5464 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:36.836082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:36.836082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:36.942232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b0ae9-0d41-4efe-9731-5ad1c7923a55 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:36.947747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:36.948567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:36.948861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:36.949143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] PATH_INFO: `/v3/projects/a15f24443fde4ce6b99f55dfae1dc5b9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:36.950927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15f24443fde4ce6b99f55dfae1dc5b9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:36.952975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.060546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fff56a5bab1465893a3fb73cb14b1db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.084515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fff56a5bab1465893a3fb73cb14b1db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.101915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fff56a5bab1465893a3fb73cb14b1db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.104019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fff56a5bab1465893a3fb73cb14b1db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.104855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7914dd7c-142e-4a3a-aae7-d379a5b6f1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fff56a5bab1465893a3fb73cb14b1db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.113081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15f24443fde4ce6b99f55dfae1dc5b9', 'request_id': 'req-9370a989-9ceb-4190-82d7-e20e9350b7aa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.123201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15f24443fde4ce6b99f55dfae1dc5b9', 'request_id': 'req-9370a989-9ceb-4190-82d7-e20e9350b7aa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.132270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15f24443fde4ce6b99f55dfae1dc5b9', 'request_id': 'req-9370a989-9ceb-4190-82d7-e20e9350b7aa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.236972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1057/2120] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:36 2022] DELETE /identity/v3/users/0fff56a5bab1465893a3fb73cb14b1db => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:37.236972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a842-5288-4674-a1bc-8700b2b34e8b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.236972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a842-5288-4674-a1bc-8700b2b34e8b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.236972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a842-5288-4674-a1bc-8700b2b34e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.280265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9fc5a842-5288-4674-a1bc-8700b2b34e8b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:37.282055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9fc5a842-5288-4674-a1bc-8700b2b34e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.344687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] The token cache is being invalidate because project a15f24443fde4ce6b99f55dfae1dc5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:37.345017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.349838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:37.350775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.357995 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1064/2121] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:36 2022] DELETE /identity/v3/projects/a15f24443fde4ce6b99f55dfae1dc5b9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:37.357995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.361236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.450670 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1058/2122] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:37.450670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca2cc-3563-48ab-b432-a882726bd126 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.450670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca2cc-3563-48ab-b432-a882726bd126 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.450670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca2cc-3563-48ab-b432-a882726bd126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.486991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-abeca2cc-3563-48ab-b432-a882726bd126 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:37.493002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-abeca2cc-3563-48ab-b432-a882726bd126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.512994 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1059/2123] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:37.515986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.516509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.516987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.542488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a989-9ceb-4190-82d7-e20e9350b7aa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:37.547695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:37.548186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:37.548344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.549797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.550010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.551976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.555492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:37.557957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.562493 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1060/2124] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:37.563641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.567923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.579156 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1065/2125] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:37.586291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e242c-be4d-4446-a28d-1768214dd883 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:37.587973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.593989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:37.594812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.594915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.595093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.595438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] PATH_INFO: `/v3/users/1e93cd3ff16349a990c231345c79b569` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.597315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e93cd3ff16349a990c231345c79b569)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:37.599673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.698523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c01a-09c1-4742-800d-51c850520447 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:37.709633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:37.710301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.710582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.710887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.726338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:37.735965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.743496 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1066/2126] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:37.744427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.755672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27a5a-3de8-48e2-860c-b38d8f98e0c6 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:37.760257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:37.764976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.764976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.764976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.781699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:37.796062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.817005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e93cd3ff16349a990c231345c79b569'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.824129 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1067/2127] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:37.830512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.849589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e93cd3ff16349a990c231345c79b569'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.853348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331bc0-5a5e-4646-b0db-d8e0584a59f5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:37.861149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e93cd3ff16349a990c231345c79b569'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.862971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e93cd3ff16349a990c231345c79b569'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.864418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-34569b18-7b67-4182-80bc-c46ecae68400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e93cd3ff16349a990c231345c79b569'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:37.864575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:37.865106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.865405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.865677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.871953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.908081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:37.912278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.940237 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1068/2128] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:37.941216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.947967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.960415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1061/2129] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:37 2022] DELETE /identity/v3/users/1e93cd3ff16349a990c231345c79b569 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:37.977135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99551-d571-4681-b9a6-0b673e85dc1d service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:38.080270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:38.081755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:38.081755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:38.081755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] PATH_INFO: `/v3/projects/774df3b6286848b885e4dcd2d3357d76/users/1b85dae0e90a48f9ab15dcad522ef2c3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:38.106216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=774df3b6286848b885e4dcd2d3357d76, user_id=1b85dae0e90a48f9ab15dcad522ef2c3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:38.111101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:38.149956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:38.219897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1069/2130] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:37 2022] PUT /identity/v3/projects/774df3b6286848b885e4dcd2d3357d76/users/1b85dae0e90a48f9ab15dcad522ef2c3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:38.241421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:38.241806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:38.242225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:38.288551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] MFA Rules not processed for user `1b85dae0e90a48f9ab15dcad522ef2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:38.289831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:38.476123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:38.478348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:38.491125 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1062/2131] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:38.494653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:38.615669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb38ab-03e1-4f6d-8096-5ff082341e1c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:38.621247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:38.621891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:38.622210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:38.622482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:38.623120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:38.625131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:38.701295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de7276-b1be-4410-bd93-92f8ecf3a33c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:38.716399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:38.719759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:38.722193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:38.722193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] PATH_INFO: `/v3/projects/9db888ae52464f218e8bbe0f70be57cd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:38.724884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db888ae52464f218e8bbe0f70be57cd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:38.726236 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1063/2132] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:38 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:38.730359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:38.730755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:38.888971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84afb-f66c-49a9-b181-106f56fd0749 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:38.896393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:38.896924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:38.897212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:38.897528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:38.898221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:38.902904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:38.967234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db888ae52464f218e8bbe0f70be57cd', 'request_id': 'req-0f27aed9-251f-4fc8-9a6a-0209653d2c07'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:38.974019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db888ae52464f218e8bbe0f70be57cd', 'request_id': 'req-0f27aed9-251f-4fc8-9a6a-0209653d2c07'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:38.989836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db888ae52464f218e8bbe0f70be57cd', 'request_id': 'req-0f27aed9-251f-4fc8-9a6a-0209653d2c07'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.009581 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1064/2133] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:38 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:39.010557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:39.013899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:39.097225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] The token cache is being invalidate because project 9db888ae52464f218e8bbe0f70be57cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:39.097719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.098661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.101535 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1070/2134] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:38 2022] DELETE /identity/v3/projects/9db888ae52464f218e8bbe0f70be57cd => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:39.102488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:39.106439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:39.186553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d12fcb-c8aa-4450-bf04-3ffe6f18a0fe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:39.238746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27aed9-251f-4fc8-9a6a-0209653d2c07 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:39.244107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:39.244756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:39.245050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:39.245315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] PATH_INFO: `/v3/projects/f3ade3395dc94951a0071f8855712202` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:39.246498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ade3395dc94951a0071f8855712202)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:39.252214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:39.310593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:39.311238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:39.311558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:39.311785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:39.313695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:39.383122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:39.409373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:39.409373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:39.424697 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1065/2135] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:39.426056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:39.426362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ade3395dc94951a0071f8855712202', 'request_id': 'req-70295d21-1b99-4f08-a1d4-00f16467f1f4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.428579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:39.453502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366666b6-5b3c-47e2-853f-523ae08f6c88 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:39.459841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ade3395dc94951a0071f8855712202', 'request_id': 'req-70295d21-1b99-4f08-a1d4-00f16467f1f4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.481563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ade3395dc94951a0071f8855712202', 'request_id': 'req-70295d21-1b99-4f08-a1d4-00f16467f1f4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.590591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] The token cache is being invalidate because project f3ade3395dc94951a0071f8855712202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:39.591355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.597351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:39.597351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1071/2136] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:39 2022] DELETE /identity/v3/projects/f3ade3395dc94951a0071f8855712202 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:39.598426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:39.600364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:39.618175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:39.618920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:39.619222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:39.619499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:39.620168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:39.622196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:39.646825 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1066/2137] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:39.652276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:39.655518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:39.707932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752b103-af8c-42ba-9edc-61b46b5d6a1c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:39.725718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:39.726481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:39.726766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:39.727047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] PATH_INFO: `/v3/users/a8321961e82a42c081f11dcfacd87ca2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:39.728504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8321961e82a42c081f11dcfacd87ca2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:39.730897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:39.778295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295d21-1b99-4f08-a1d4-00f16467f1f4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:39.790490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:39.791237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:39.791719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:39.792328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] PATH_INFO: `/v3/projects/7f4172f61bc143f7bb4b05c8175d21d4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:39.795134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4172f61bc143f7bb4b05c8175d21d4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:39.799460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:40.107077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4172f61bc143f7bb4b05c8175d21d4', 'request_id': 'req-d0325951-1221-4493-be45-b23f3228ad5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.116771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8321961e82a42c081f11dcfacd87ca2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.128314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4172f61bc143f7bb4b05c8175d21d4', 'request_id': 'req-d0325951-1221-4493-be45-b23f3228ad5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.139372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8321961e82a42c081f11dcfacd87ca2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.144483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4172f61bc143f7bb4b05c8175d21d4', 'request_id': 'req-d0325951-1221-4493-be45-b23f3228ad5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.151256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8321961e82a42c081f11dcfacd87ca2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.152032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8321961e82a42c081f11dcfacd87ca2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.152689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8321961e82a42c081f11dcfacd87ca2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.187153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:40.278429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] The token cache is being invalidate because project 7f4172f61bc143f7bb4b05c8175d21d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:40.278763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.279453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.282481 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1072/2138] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:39 2022] DELETE /identity/v3/projects/7f4172f61bc143f7bb4b05c8175d21d4 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:40.283446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:40.285287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:40.367882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0325951-1221-4493-be45-b23f3228ad5b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:40.373370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:40.374054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:40.374336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:40.374636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] PATH_INFO: `/v3/projects/5a1a7fbaeb33496cbc900f9eff65a66e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:40.375913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1a7fbaeb33496cbc900f9eff65a66e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:40.377940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:40.412840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1067/2139] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:39 2022] DELETE /identity/v3/users/a8321961e82a42c081f11dcfacd87ca2 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:40.413888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:40.422904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:40.505454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0858d-78da-42d9-a865-59c0a0d01d9f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:40.510781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:40.511439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:40.511725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:40.512280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] PATH_INFO: `/v3/users/cc712da3a7ba4b2c87622ab99f19c1e6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:40.513313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc712da3a7ba4b2c87622ab99f19c1e6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:40.515459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:40.555057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1a7fbaeb33496cbc900f9eff65a66e', 'request_id': 'req-b0eb6c37-e088-463d-bd4b-8eb6bace4333'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.567615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1a7fbaeb33496cbc900f9eff65a66e', 'request_id': 'req-b0eb6c37-e088-463d-bd4b-8eb6bace4333'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.573462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1a7fbaeb33496cbc900f9eff65a66e', 'request_id': 'req-b0eb6c37-e088-463d-bd4b-8eb6bace4333'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.651430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] The token cache is being invalidate because project 5a1a7fbaeb33496cbc900f9eff65a66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:40.651816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.652401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.654000 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1073/2140] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:40 2022] DELETE /identity/v3/projects/5a1a7fbaeb33496cbc900f9eff65a66e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:40.657269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:40.657269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:40.766269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb6c37-e088-463d-bd4b-8eb6bace4333 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:40.771957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc712da3a7ba4b2c87622ab99f19c1e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.772244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f94fb-eed0-449e-b220-17fd45db1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:40.773075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f94fb-eed0-449e-b220-17fd45db1b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:40.773499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f94fb-eed0-449e-b220-17fd45db1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:40.773984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f94fb-eed0-449e-b220-17fd45db1b40 admin admin] PATH_INFO: `/v3/projects/41618f00a04b4dd0879ed545e97af59a/users/8e80768b1247418e889d536b8bded153/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:40.806027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f94fb-eed0-449e-b220-17fd45db1b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41618f00a04b4dd0879ed545e97af59a, user_id=8e80768b1247418e889d536b8bded153, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:40.806027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f94fb-eed0-449e-b220-17fd45db1b40 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:40.812507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc712da3a7ba4b2c87622ab99f19c1e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.822230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc712da3a7ba4b2c87622ab99f19c1e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.823683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc712da3a7ba4b2c87622ab99f19c1e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.824558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-777070f5-96ef-4540-bf18-317e070dff8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc712da3a7ba4b2c87622ab99f19c1e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:40.933805 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1074/2141] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:40 2022] PUT /identity/v3/projects/41618f00a04b4dd0879ed545e97af59a/users/8e80768b1247418e889d536b8bded153/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:40.934236 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1068/2142] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:40 2022] DELETE /identity/v3/users/cc712da3a7ba4b2c87622ab99f19c1e6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:40.934383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e51d0-ca5d-4eb7-bff1-5139d7232c3b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:40.934383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e51d0-ca5d-4eb7-bff1-5139d7232c3b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:40.934383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e51d0-ca5d-4eb7-bff1-5139d7232c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:40.934880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:40.934880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:40.934880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:40.953684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:40.955029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:40.972293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-485e51d0-ca5d-4eb7-bff1-5139d7232c3b None None] MFA Rules not processed for user `1e9d23f811c74800ba53ae611844a8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:40.976644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-485e51d0-ca5d-4eb7-bff1-5139d7232c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.057653 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1069/2143] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:41.059083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:41.063194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.089191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b056-92d3-47b9-9c94-8fccad7b9d07 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:41.096735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:41.097395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.097705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.098037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] PATH_INFO: `/v3/users/9269ef03e1474e5dab99edc13f6c0435` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.099282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9269ef03e1474e5dab99edc13f6c0435)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:41.103666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:41.123999 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1075/2144] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:41.126067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f6b3-7cc8-46bc-8f09-b755e8dc8477 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.126800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f6b3-7cc8-46bc-8f09-b755e8dc8477 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.127316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f6b3-7cc8-46bc-8f09-b755e8dc8477 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.129820 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1076/2145] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:41.131080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f6b3-7cc8-46bc-8f09-b755e8dc8477 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:41.139949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c79f6b3-7cc8-46bc-8f09-b755e8dc8477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.171321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f6b3-7cc8-46bc-8f09-b755e8dc8477 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:41.176795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:41.177421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.177695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.178201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.178871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:41.180519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:41.191879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1077/2146] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:41.193001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:41.195883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.212407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf6915-3870-49b1-87dd-1d21756bf388 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:41.218617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:41.219507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.219839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.220253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] PATH_INFO: `/v3/projects/be31a6fe3fe54a17bd6cfef576360950` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.221470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be31a6fe3fe54a17bd6cfef576360950)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:41.223448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:41.444679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9269ef03e1474e5dab99edc13f6c0435'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.453489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be31a6fe3fe54a17bd6cfef576360950', 'request_id': 'req-9da2c1b2-e288-401c-b8a2-c2349a37efd8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.461408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be31a6fe3fe54a17bd6cfef576360950', 'request_id': 'req-9da2c1b2-e288-401c-b8a2-c2349a37efd8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.468727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9269ef03e1474e5dab99edc13f6c0435'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.473100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be31a6fe3fe54a17bd6cfef576360950', 'request_id': 'req-9da2c1b2-e288-401c-b8a2-c2349a37efd8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.477629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9269ef03e1474e5dab99edc13f6c0435'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.478694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9269ef03e1474e5dab99edc13f6c0435'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.479460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ede69335-f095-45fd-aa4d-38b094e6621b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9269ef03e1474e5dab99edc13f6c0435'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.571538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] The token cache is being invalidate because project be31a6fe3fe54a17bd6cfef576360950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:41.572901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.572901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9da2c1b2-e288-401c-b8a2-c2349a37efd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:41.576275 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1078/2147] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:41 2022] DELETE /identity/v3/projects/be31a6fe3fe54a17bd6cfef576360950 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:41.576363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3098-a0c7-4e79-9259-f097cad94219 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.576731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3098-a0c7-4e79-9259-f097cad94219 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.577088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3098-a0c7-4e79-9259-f097cad94219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.600330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1bea3098-a0c7-4e79-9259-f097cad94219 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:41.601578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1bea3098-a0c7-4e79-9259-f097cad94219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.672666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1079/2148] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:41.674253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.674705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.675118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.699578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:41.703233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:41.706288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.717119 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1070/2149] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:41 2022] DELETE /identity/v3/users/9269ef03e1474e5dab99edc13f6c0435 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:41.719156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5210-edce-46b8-a0fd-2cf3db1f7abe None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.719456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5210-edce-46b8-a0fd-2cf3db1f7abe None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.719737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5210-edce-46b8-a0fd-2cf3db1f7abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.743062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-032c5210-edce-46b8-a0fd-2cf3db1f7abe None None] MFA Rules not processed for user `122174705b7e43ac8f85a8b0160cd693`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:41.744536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-032c5210-edce-46b8-a0fd-2cf3db1f7abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.779316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1080/2150] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:53:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:41.780847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:41.797068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.818113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b3b3-5b12-4e25-a2d3-165b2d9f5210 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:41.889822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1071/2151] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:41.904626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.905836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.906153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.914417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:41.915204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:41.915551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:41.916853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] PATH_INFO: `/v3/projects/41618f00a04b4dd0879ed545e97af59a/users/8e80768b1247418e889d536b8bded153/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:41.918057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41618f00a04b4dd0879ed545e97af59a, user_id=8e80768b1247418e889d536b8bded153, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:41.921255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:41.928728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:41.930315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:41.942645 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1081/2152] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:41 2022] PUT /identity/v3/projects/41618f00a04b4dd0879ed545e97af59a/users/8e80768b1247418e889d536b8bded153/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:41.942645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.028176 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1072/2153] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:42.029310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.030953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.052532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbfbf1-2148-4d4d-a569-d8db454267a7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:42.062117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:42.063374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.064269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.064909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] PATH_INFO: `/v3/projects/69c566294f7d45ffa6aeb748594292b4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.066785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c566294f7d45ffa6aeb748594292b4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:42.070290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:42.122649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802e72-7c34-4ebc-8dfc-d44d8576988e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:42.126456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:42.127087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.127367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.127644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.128320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:42.128631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:42.130356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:42.150028 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1082/2154] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:42.150028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.150028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.233307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c566294f7d45ffa6aeb748594292b4', 'request_id': 'req-e90070ca-8854-466b-a525-cf5ce0815080'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.240700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c566294f7d45ffa6aeb748594292b4', 'request_id': 'req-e90070ca-8854-466b-a525-cf5ce0815080'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.244867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7901-d86b-40d6-8135-baf29aebbb26 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:42.248722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c566294f7d45ffa6aeb748594292b4', 'request_id': 'req-e90070ca-8854-466b-a525-cf5ce0815080'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.305733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:42.306448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.306729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.307007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.316112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:42.317662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:42.326479 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1083/2155] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:42.327333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.328781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.405979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] The token cache is being invalidate because project 69c566294f7d45ffa6aeb748594292b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:42.406455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.407397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e90070ca-8854-466b-a525-cf5ce0815080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.410150 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1073/2156] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:42 2022] DELETE /identity/v3/projects/69c566294f7d45ffa6aeb748594292b4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:42.412032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.412818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.413538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.450994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed018-bbd4-4f15-9bab-abe5ec75ba0c service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:42.459667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:42.460568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.462238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.462238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.462581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] MFA Rules not processed for user `8e80768b1247418e889d536b8bded153`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:42.463865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.464249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.540242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:42.552951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:42.554697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a684d4-d9a6-4380-b889-fcfa2854dd48 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:42.567586 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1084/2157] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:42 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:42.569104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.569449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.570073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.593098 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1074/2158] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:42.594701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:42.594827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.595932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.599130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.697547 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1085/2159] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:42.698615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.701609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.705277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca534-d9e1-40ac-ae9d-b18b9d41107f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:42.713162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc5535-da6d-4f18-ad99-d552dba4f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:42.714390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc5535-da6d-4f18-ad99-d552dba4f649 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.714831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc5535-da6d-4f18-ad99-d552dba4f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.715284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc5535-da6d-4f18-ad99-d552dba4f649 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.716662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc5535-da6d-4f18-ad99-d552dba4f649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:42.720643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe8a0a-0fa7-4eb5-ae6f-2dcc3ddc97cf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:42.723631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc5535-da6d-4f18-ad99-d552dba4f649 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:42.727560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:42.728275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.728613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.728929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] PATH_INFO: `/v3/projects/28d94f4cad194bb7917b91c56c7a26b3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.730456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d94f4cad194bb7917b91c56c7a26b3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:42.733008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:42.827386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1075/2160] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:42 2022] POST /identity/v3/projects => generated 403 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:42.829053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:42.829408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:42.829702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:42.859597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:42.861000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:42.880340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d94f4cad194bb7917b91c56c7a26b3', 'request_id': 'req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.889156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d94f4cad194bb7917b91c56c7a26b3', 'request_id': 'req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.899537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d94f4cad194bb7917b91c56c7a26b3', 'request_id': 'req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:42.957338 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1076/2161] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:42.958422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:42.959923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.030470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] The token cache is being invalidate because project 28d94f4cad194bb7917b91c56c7a26b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:43.030778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:43.031595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:43.035448 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1086/2162] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:42 2022] DELETE /identity/v3/projects/28d94f4cad194bb7917b91c56c7a26b3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:43.035623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.037086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.096673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4e907-1d79-4e63-a824-fe626dc50ef6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.104127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.104846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.105213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.105586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.108678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.129247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.131247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.144718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1077/2163] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:43.145342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.146808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.168061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cee7af-4e3e-45c3-8a68-7f6938efd1ba service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.174082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.174767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.175119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.175399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.176068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:43.176377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.178124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.187665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd9d1-42ef-4af2-a60b-f3dac3aa35d6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.194682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.195572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.196005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.196459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.198664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.203226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1078/2164] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:43.206442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.209481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.235706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b429a87-4a8d-4d9c-b41a-b56815cdf26f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.244876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.245703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.246034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.246320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.247486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.249167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.317213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.318906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b32ca-e185-49ea-ae91-16213d8f50c2 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.330600 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1087/2165] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:43.332086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50751a-8f99-422f-9140-0cbbbd9b93bb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.332379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50751a-8f99-422f-9140-0cbbbd9b93bb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.332728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50751a-8f99-422f-9140-0cbbbd9b93bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.355509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2d50751a-8f99-422f-9140-0cbbbd9b93bb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:43.357415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2d50751a-8f99-422f-9140-0cbbbd9b93bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.365673 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1088/2166] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:43.367011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79893ae-4fca-450d-acb5-f9f32de7f73a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.367331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79893ae-4fca-450d-acb5-f9f32de7f73a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.367566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79893ae-4fca-450d-acb5-f9f32de7f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.390862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b79893ae-4fca-450d-acb5-f9f32de7f73a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:43.391547 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1079/2167] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:43.392420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.395706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b79893ae-4fca-450d-acb5-f9f32de7f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.412472 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1089/2168] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:43.412472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.412472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.412472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.428201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a7cbf-984f-4803-9cc9-fc5bed50863d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.440136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:43.441681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.446254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:43.448869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.449657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.450525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.451337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.452167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.456240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.522371 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1090/2169] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:43.523472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.558684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78316e0b-1b31-4358-9846-a23cdad665af None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.567348 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1080/2170] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:43.568336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.570377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.571393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.571872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.572566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.576204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:43.576862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.579475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca64c-ead3-4e25-9a74-9df1cee8eb34 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.616000 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1091/2171] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:43.617491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.617805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.622881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.675198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:43.679561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.730284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9ece-8d67-47c5-a2b9-6e1bd07cbfc0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.738961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.739678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.740037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.740420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.741189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.743209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.755250 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1081/2172] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:43.759594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.761624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:43.783268 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1092/2173] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:43.787771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.800271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb49633-0418-489f-b9d3-411ee8fce808 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.807368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37cbd-2777-4f91-897a-ea29f99da35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.808004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37cbd-2777-4f91-897a-ea29f99da35c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.808396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37cbd-2777-4f91-897a-ea29f99da35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.809983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37cbd-2777-4f91-897a-ea29f99da35c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.810719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec37cbd-2777-4f91-897a-ea29f99da35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.812789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec37cbd-2777-4f91-897a-ea29f99da35c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.828262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:43.849837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f805-1888-4e7c-a3e7-0df71b04bc9b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.858714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0064277-1844-4cb6-aa04-0b6c024861a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.859251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0064277-1844-4cb6-aa04-0b6c024861a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.859564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0064277-1844-4cb6-aa04-0b6c024861a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.859938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0064277-1844-4cb6-aa04-0b6c024861a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.871441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0064277-1844-4cb6-aa04-0b6c024861a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.873589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0064277-1844-4cb6-aa04-0b6c024861a8 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.883331 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1082/2174] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:43.888425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0463c-ff60-49a0-b2ad-2b977a75c3a5 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.888990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0463c-ff60-49a0-b2ad-2b977a75c3a5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.889448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0463c-ff60-49a0-b2ad-2b977a75c3a5 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.896168 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1083/2175] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:53:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:43.898632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0463c-ff60-49a0-b2ad-2b977a75c3a5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.914412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0463c-ff60-49a0-b2ad-2b977a75c3a5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.922023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.923328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.923328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.924024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.924855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.927557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.940378 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1093/2176] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:43.940378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af55789-de59-40b6-be21-cf4d26877ee9 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.940378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af55789-de59-40b6-be21-cf4d26877ee9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.940378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af55789-de59-40b6-be21-cf4d26877ee9 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.941657 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1094/2177] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:43.942938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af55789-de59-40b6-be21-cf4d26877ee9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:43.963420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af55789-de59-40b6-be21-cf4d26877ee9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:43.970421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:43.970421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:43.970421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:43.970421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:43.971067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:43.972698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:43.984242 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1095/2178] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:43.984925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.008341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd556-d3b3-4196-bb96-8667a93495a5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.015066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.015771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.016055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.016381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.017054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:44.017359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.018994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75169b-428f-478c-99d7-bccbe1f3d245 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.042425 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1096/2179] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:44.042425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.042425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.042425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.049093 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1084/2180] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:43 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:44.050227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.091865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:44.093135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:44.167390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27839-6c60-4479-8961-a1a27e4f4173 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.173174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.173983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.174519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.174883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.175616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.177532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.190993 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1085/2181] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:44.191964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:44.192503 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1097/2182] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:44.194051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.214707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9eb57-dca8-412e-b5e2-c92abd4bff58 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.223860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.224670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.225247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.225764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] PATH_INFO: `/v3/projects/eb20a0da64fb4e60b540008653306bc8/users/8181cc5465544a0fba067403ace03d38/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.230813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.244952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb20a0da64fb4e60b540008653306bc8, user_id=8181cc5465544a0fba067403ace03d38, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.248097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.256595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:44.313262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5875cc-554d-452d-8de7-365937dc2dfe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.319045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e80768b1247418e889d536b8bded153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41618f00a04b4dd0879ed545e97af59a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.319745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.320031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.320453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] PATH_INFO: `/v3/projects/774df3b6286848b885e4dcd2d3357d76` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.321834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] RBAC: Authorizing `identity:get_project(project_id=774df3b6286848b885e4dcd2d3357d76)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.323978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.326387 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1086/2183] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:44 2022] GET /identity/v3/projects/774df3b6286848b885e4dcd2d3357d76 => generated 377 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:44.327080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.342121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fd171-ca1d-4dc6-aa71-1bb5b31cc4f3 tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.342972 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1098/2184] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:44 2022] PUT /identity/v3/projects/eb20a0da64fb4e60b540008653306bc8/users/8181cc5465544a0fba067403ace03d38/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:44.343790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.422208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.423138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.423537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.423927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.424685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.427039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.474053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdcd7-d3ab-46d8-897b-e836711c3c51 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.484962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.486543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.486864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.487436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.488423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.490606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.594667 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1087/2185] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:44 2022] POST /identity/v3/projects => generated 389 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:44.595705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.646185 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1099/2186] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:44 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:44.646185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.677168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1a246-b904-45a4-9dc9-9462a0f97fec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.682805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72671038-5b92-40ca-b859-b8af8ccaf09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.683783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72671038-5b92-40ca-b859-b8af8ccaf09f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.684265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72671038-5b92-40ca-b859-b8af8ccaf09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.685387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72671038-5b92-40ca-b859-b8af8ccaf09f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.691954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72671038-5b92-40ca-b859-b8af8ccaf09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.691954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72671038-5b92-40ca-b859-b8af8ccaf09f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.700941 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1088/2187] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:44.702800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.703172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.703450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.725425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:44.726677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:44.736638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396da1e-c956-45b7-a8af-b1e456efcc6a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.737791 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1089/2188] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:44.738679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.796702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.797272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.797553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.797833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.820791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6829c0-f277-4894-b6a4-f3ebac9fb47c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.828070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.828689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.828971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.829241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.831949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:44.914786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.916245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.930095 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1100/2189] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:44.931141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.943497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.944104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a36e71-464a-43bf-b014-90e0e5b10fdc service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.945207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.949663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.950342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.950620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.950896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.951550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.953526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:44.957943 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1090/2190] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:44.958759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:44.972099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77768f17-2db3-461b-a4ba-a10980b90708 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:44.990756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:44.991471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:44.991820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:44.992097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:44.992815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:44.994550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.006874 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1091/2191] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:45.007984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.024987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bd52-5f3f-4105-8e9e-6368a8375e13 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.032025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.034435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.035049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.036015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] PATH_INFO: `/v3/projects/5dff10f27a544333930eccd8121bd0ce/users/f6c54b20d1d64274ad3a32879f17181a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.055155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dff10f27a544333930eccd8121bd0ce, user_id=f6c54b20d1d64274ad3a32879f17181a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.058284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.080956 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1101/2192] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:44 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:45.082160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.094222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16da25-ba59-4742-9950-b01e6295406d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.098056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.098677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.098956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.099280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.110460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.111899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.122773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1102/2193] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:45.123469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.133691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283574a2-8f2c-4c6d-bf19-50c8eb77d0eb service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.141368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537689-7451-403d-95f4-5648111dc71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.142083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537689-7451-403d-95f4-5648111dc71f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.142309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537689-7451-403d-95f4-5648111dc71f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.142588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537689-7451-403d-95f4-5648111dc71f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.143246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c537689-7451-403d-95f4-5648111dc71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.144847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c537689-7451-403d-95f4-5648111dc71f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.155631 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1103/2194] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:45.156749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5409115-b757-4e8d-9fe6-5c4d0b6b57ab None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.157034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5409115-b757-4e8d-9fe6-5c4d0b6b57ab None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.157309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5409115-b757-4e8d-9fe6-5c4d0b6b57ab None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.158590 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1104/2195] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:45.159269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5409115-b757-4e8d-9fe6-5c4d0b6b57ab None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.173800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5409115-b757-4e8d-9fe6-5c4d0b6b57ab None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.185264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.186219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.186548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.186816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.196350 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1092/2196] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:45 2022] PUT /identity/v3/projects/5dff10f27a544333930eccd8121bd0ce/users/f6c54b20d1d64274ad3a32879f17181a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:45.196438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.196510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.196581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.213690 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1105/2197] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:45.215123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:45.217594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:45.222006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:45.238238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.322488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551886b-801c-428c-be93-8036be1b535d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.323552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7de8-fa28-4cff-9aae-c1ddd24672ee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.330284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.331426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.331834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.332283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] PATH_INFO: `/v3/projects/3b8697da825645e39af5b1222d8bdf0e/users/d07186ac54384c2a975c8b2420b853bf/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.367436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8697da825645e39af5b1222d8bdf0e, user_id=d07186ac54384c2a975c8b2420b853bf, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.371763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.430639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba6bc9-b59c-4697-9be6-ed2add6cd4bb tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e80768b1247418e889d536b8bded153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41618f00a04b4dd0879ed545e97af59a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.431275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6bc9-b59c-4697-9be6-ed2add6cd4bb tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.431552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6bc9-b59c-4697-9be6-ed2add6cd4bb tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.431824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6bc9-b59c-4697-9be6-ed2add6cd4bb tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] PATH_INFO: `/v3/projects/774df3b6286848b885e4dcd2d3357d76` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.432990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6bc9-b59c-4697-9be6-ed2add6cd4bb tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] RBAC: Authorizing `identity:get_project(project_id=774df3b6286848b885e4dcd2d3357d76)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.435193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6bc9-b59c-4697-9be6-ed2add6cd4bb tempest-FlavorsAccessTestJSON-1733864737 tempest-FlavorsAccessTestJSON-1733864737-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.436900 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1106/2198] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:45 2022] GET /identity/v3/projects/774df3b6286848b885e4dcd2d3357d76 => generated 377 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:45.438300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d59aef-4a6f-4d44-a0a7-c19d0a4d4ee2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.438661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d59aef-4a6f-4d44-a0a7-c19d0a4d4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.438932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d59aef-4a6f-4d44-a0a7-c19d0a4d4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.469618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-42d59aef-4a6f-4d44-a0a7-c19d0a4d4ee2 None None] MFA Rules not processed for user `f6c54b20d1d64274ad3a32879f17181a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:45.470990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42d59aef-4a6f-4d44-a0a7-c19d0a4d4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:45.485710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1093/2199] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:45 2022] PUT /identity/v3/projects/3b8697da825645e39af5b1222d8bdf0e/users/d07186ac54384c2a975c8b2420b853bf/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:45.486887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.600305 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1107/2200] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:45.609109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.609109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.609109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.635648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e39c8f-b041-465a-83de-a2de190eb612 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.702216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.703147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.703438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.703717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.705799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.708756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:45.723364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] MFA Rules not processed for user `d07186ac54384c2a975c8b2420b853bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:45.724792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:45.734989 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1094/2201] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:45.734989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.738564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:45.860908 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1108/2202] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:45.861987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:45.881683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529382e-31f6-430c-a468-e3ee391276d1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.888630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.889445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.889829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.890239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] PATH_INFO: `/v3/projects/5a1290b969a84eb897dd8ab368a89fa1/users/9dc9a684b2ce4262b578fe9364385bb9/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.891602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fab13-f51e-4890-8a69-143671579496 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:45.896583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9379b-beda-4691-baf6-6dcede0275d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:45.897224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9379b-beda-4691-baf6-6dcede0275d5 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:45.897595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9379b-beda-4691-baf6-6dcede0275d5 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:45.897937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9379b-beda-4691-baf6-6dcede0275d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:45.933060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1290b969a84eb897dd8ab368a89fa1, user_id=9dc9a684b2ce4262b578fe9364385bb9, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:45.935708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:46.050326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9379b-beda-4691-baf6-6dcede0275d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:46.052010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9379b-beda-4691-baf6-6dcede0275d5 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:46.090865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1109/2203] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:45 2022] PUT /identity/v3/projects/5a1290b969a84eb897dd8ab368a89fa1/users/9dc9a684b2ce4262b578fe9364385bb9/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:46.092260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:46.093648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1095/2204] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:46.102410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.102940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.103361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:46.168364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] MFA Rules not processed for user `9dc9a684b2ce4262b578fe9364385bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:46.173559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:46.239601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459abfc-bc64-41de-9f87-0130bd3bcb2e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:46.253616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:46.255316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.255798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.256320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:46.258405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:46.263844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:46.303781 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1096/2205] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:46.310993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:46.367318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a263a3-7311-478e-9e43-a31af91243c7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:46.374008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:46.374671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.374955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.375233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:46.375886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:46.377979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:46.501179 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1110/2206] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/projects => generated 381 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:46.501179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:46.501179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:46.554936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1097/2207] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:46.556181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:46.635637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadc14f-8e59-4fcc-af91-615d8f5c0ae7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:46.689154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d448a7c-76c9-4908-a245-d7b1180233af admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:46.696937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5dc24-770e-4a67-99f7-8fbb42c02b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:46.697726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5dc24-770e-4a67-99f7-8fbb42c02b6d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.698212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5dc24-770e-4a67-99f7-8fbb42c02b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.698488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5dc24-770e-4a67-99f7-8fbb42c02b6d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:46.699225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5dc24-770e-4a67-99f7-8fbb42c02b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:46.702053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5dc24-770e-4a67-99f7-8fbb42c02b6d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:46.722952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:46.723772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.724091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.724364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] PATH_INFO: `/v3/users/1b85dae0e90a48f9ab15dcad522ef2c3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:46.725602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b85dae0e90a48f9ab15dcad522ef2c3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:46.728010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:46.778507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:46.867259 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1098/2208] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/users => generated 297 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:46.868986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.869275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.870977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:46.896922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:46.898220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:46.973907 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1099/2209] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:46.978965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:46.998913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64af97-b950-4d9f-952e-7ee8ef93e0a7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.007615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.008434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.008964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.009713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.010936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.015424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.119033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b85dae0e90a48f9ab15dcad522ef2c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:47.120599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b85dae0e90a48f9ab15dcad522ef2c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:47.148380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1100/2210] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:47.148380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.157519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2ab98-505e-404d-8df6-6c9f492dd5fd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.162666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.163283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.164530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.164530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.164530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.166074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.177226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1101/2211] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:47.178136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.179884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.234902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b85dae0e90a48f9ab15dcad522ef2c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:47.245557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b85dae0e90a48f9ab15dcad522ef2c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:47.246506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b85dae0e90a48f9ab15dcad522ef2c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:47.273095 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1111/2212] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:46 2022] DELETE /identity/v3/users/1b85dae0e90a48f9ab15dcad522ef2c3 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:47.273095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.273095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.291950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1b16-7dc0-403a-af1a-fe7aabf2fd86 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.377029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317da13-6368-4147-ad20-ccb6fb8c7486 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.378858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.379591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.379975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.380349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.381103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.383135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.394621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1112/2213] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:47.395562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.401993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.413704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.417064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.417064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.417064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.421578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.421990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5adc6-adb6-40f6-955e-a2da4d883ff6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.427412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.428230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.428679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.429143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] PATH_INFO: `/v3/projects/430366c2891c4343b53968c17611d27a/users/651a48f224014da78e16b1979a59dd07/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.456578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430366c2891c4343b53968c17611d27a, user_id=651a48f224014da78e16b1979a59dd07, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.459496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.553502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.556104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347d08e-fc73-4133-b441-04bebba3b919 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.569251 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1102/2214] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:53:47.572239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.572239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.572239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.579274 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1113/2215] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:47 2022] PUT /identity/v3/projects/430366c2891c4343b53968c17611d27a/users/651a48f224014da78e16b1979a59dd07/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:47.580166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.635618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:47.637468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.652680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:47.711239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574a236-36a5-47f3-b4a3-3a8c5b1f5760 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.718860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.719600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.719883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.720197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] PATH_INFO: `/v3/projects/078a3e6ce033480ab2d1c9d2ed2f960d/users/2e794b6121aa4f32bf93609d3d098cd2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.742026 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1103/2216] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:47.743323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.750474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=078a3e6ce033480ab2d1c9d2ed2f960d, user_id=2e794b6121aa4f32bf93609d3d098cd2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.754739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.754933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f250cf2-6911-4fc5-945c-afb2df6441c3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.760897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.761652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.762052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.762331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.763024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.764648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.777925 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1104/2217] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:47.777925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.781309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.865057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96abe5-09b5-4ee1-89bf-8523ee2a170d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.876271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.877495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.879400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.880048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.954505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.957200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.964495 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1114/2218] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:47 2022] PUT /identity/v3/projects/078a3e6ce033480ab2d1c9d2ed2f960d/users/2e794b6121aa4f32bf93609d3d098cd2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:47.966327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.987701 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1105/2219] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:47.988768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:48.010622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0b0e-9d00-4321-85a0-78f6e1df0b8c service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:48.162854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7486a-6c01-4fd4-8beb-a38df60afe8f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:48.172951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:48.175625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.176524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.176920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.179967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:48.181923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:48.188779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb0d29-476a-4747-802e-92d774696fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:48.190944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb0d29-476a-4747-802e-92d774696fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.191673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb0d29-476a-4747-802e-92d774696fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.192736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb0d29-476a-4747-802e-92d774696fd2 admin admin] PATH_INFO: `/v3/projects/430366c2891c4343b53968c17611d27a/users/651a48f224014da78e16b1979a59dd07/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.196769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb0d29-476a-4747-802e-92d774696fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430366c2891c4343b53968c17611d27a, user_id=651a48f224014da78e16b1979a59dd07, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:48.201965 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1106/2220] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:48.202394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb0d29-476a-4747-802e-92d774696fd2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:48.207160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:48.247456 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1115/2221] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:47 2022] PUT /identity/v3/projects/430366c2891c4343b53968c17611d27a/users/651a48f224014da78e16b1979a59dd07/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:48.263838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22686fc7-2b6e-49b2-baaf-487c8594937e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:48.265539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.268024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.268308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.317810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:48.321293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] MFA Rules not processed for user `651a48f224014da78e16b1979a59dd07`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:48.322930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:48.405380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55420828-d59c-4088-9240-16da8e997e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:48.408624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420828-d59c-4088-9240-16da8e997e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.409273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420828-d59c-4088-9240-16da8e997e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.410632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420828-d59c-4088-9240-16da8e997e71 admin admin] PATH_INFO: `/v3/projects/078a3e6ce033480ab2d1c9d2ed2f960d/users/2e794b6121aa4f32bf93609d3d098cd2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.415298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55420828-d59c-4088-9240-16da8e997e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078a3e6ce033480ab2d1c9d2ed2f960d, user_id=2e794b6121aa4f32bf93609d3d098cd2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:48.433230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55420828-d59c-4088-9240-16da8e997e71 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:48.484257 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1107/2222] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:48 2022] PUT /identity/v3/projects/078a3e6ce033480ab2d1c9d2ed2f960d/users/2e794b6121aa4f32bf93609d3d098cd2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:48.493755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1116/2223] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:48.507419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217234-0ad4-4529-a2ac-9deecd1be396 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.507705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217234-0ad4-4529-a2ac-9deecd1be396 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.507979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217234-0ad4-4529-a2ac-9deecd1be396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.521693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:48.525524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:48.594663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-85217234-0ad4-4529-a2ac-9deecd1be396 None None] MFA Rules not processed for user `2e794b6121aa4f32bf93609d3d098cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:48.596165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-85217234-0ad4-4529-a2ac-9deecd1be396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:48.746010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c7430-9134-4e1b-920a-a5db306d87b4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:48.787234 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1108/2224] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:48.803618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.803930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.804245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.832838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] MFA Rules not processed for user `9dc9a684b2ce4262b578fe9364385bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:48.834110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:48.964745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:48.965624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:48.966137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:48.966559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:48.975802 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1109/2225] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:49.056437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:49.058614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:49.070277 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1117/2226] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:49.249523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:49.270629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ffe94-c3fb-4df9-8dd1-cecb286903b9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:49.277659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:49.279620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:49.279758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:49.280213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:49.282735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:49.296838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:49.298759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:49.310141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1110/2227] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:49.595183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:49.596836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:49.703350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:49.765824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808e14-ef1d-4086-9a5a-d66764a29d09 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:49.773108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:49.773937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:49.774191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:49.774616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] PATH_INFO: `/v3/projects/774df3b6286848b885e4dcd2d3357d76` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:49.777175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] RBAC: Authorizing `identity:delete_project(project_id=774df3b6286848b885e4dcd2d3357d76)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:49.782066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:50.003011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774df3b6286848b885e4dcd2d3357d76', 'request_id': 'req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.020003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:50.023501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774df3b6286848b885e4dcd2d3357d76', 'request_id': 'req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.038140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303f438-b82c-41d6-a2cc-a22d5283b271 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:50.040442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774df3b6286848b885e4dcd2d3357d76', 'request_id': 'req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.123071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] The token cache is being invalidate because project 774df3b6286848b885e4dcd2d3357d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:50.123750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.127130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.127130 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1118/2228] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:49 2022] DELETE /identity/v3/projects/774df3b6286848b885e4dcd2d3357d76 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:50.131044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:50.140800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:50.196320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:50.197189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:50.197621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:50.197925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] PATH_INFO: `/v3/users/d07186ac54384c2a975c8b2420b853bf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:50.200365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07186ac54384c2a975c8b2420b853bf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:50.223956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:50.228848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:50.316902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74e5a-a43a-4c5a-a3fc-545c3b8f779a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:50.331706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:50.332807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:50.333162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:50.333503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] PATH_INFO: `/v3/users/8e80768b1247418e889d536b8bded153` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:50.335129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e80768b1247418e889d536b8bded153)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:50.340124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:50.780052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07186ac54384c2a975c8b2420b853bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.793175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07186ac54384c2a975c8b2420b853bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.804082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07186ac54384c2a975c8b2420b853bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.805956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07186ac54384c2a975c8b2420b853bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.805956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9983823-c279-4082-a92c-256b963f8d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07186ac54384c2a975c8b2420b853bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.828601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e80768b1247418e889d536b8bded153'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.830559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e80768b1247418e889d536b8bded153'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:50.926508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1111/2229] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:50 2022] DELETE /identity/v3/users/d07186ac54384c2a975c8b2420b853bf => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:50.931227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:50.931596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:50.931838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:50.976287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:50.978775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:50.987912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e80768b1247418e889d536b8bded153'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:51.002910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e80768b1247418e889d536b8bded153'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:51.003826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e80768b1247418e889d536b8bded153'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:51.075779 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1119/2230] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:50 2022] DELETE /identity/v3/users/8e80768b1247418e889d536b8bded153 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:51.158748 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1112/2231] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:51.166728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:51.168637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:51.285394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f043c-84a7-4858-8229-21cb44bc2135 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:51.291490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:51.292259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:51.292641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:51.293186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:51.437938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:51.441464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:51.479099 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1120/2232] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:51.982458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:52.217827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:52.219933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:52.233684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206bfb6-ccd5-4a01-83bf-ccc6d6861b40 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:52.239474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:52.240378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:52.240836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:52.241334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] PATH_INFO: `/v3/projects/3b8697da825645e39af5b1222d8bdf0e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:52.242787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8697da825645e39af5b1222d8bdf0e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:52.244975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:52.445248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8697da825645e39af5b1222d8bdf0e', 'request_id': 'req-81c01a38-1bd7-4ade-9391-f6b359626cfc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:52.451830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8697da825645e39af5b1222d8bdf0e', 'request_id': 'req-81c01a38-1bd7-4ade-9391-f6b359626cfc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:52.465080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8697da825645e39af5b1222d8bdf0e', 'request_id': 'req-81c01a38-1bd7-4ade-9391-f6b359626cfc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:52.556547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:52.558979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:52.573534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15838bf8-a520-4c25-836c-448aaadd65f0 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:52.582692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] The token cache is being invalidate because project 3b8697da825645e39af5b1222d8bdf0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:52.585558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:52.585558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:52.587567 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1113/2233] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:52 2022] DELETE /identity/v3/projects/3b8697da825645e39af5b1222d8bdf0e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:52.593646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:52.595526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:52.750524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:52.751470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:52.751967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:52.752423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] PATH_INFO: `/v3/projects/41618f00a04b4dd0879ed545e97af59a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:52.757478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41618f00a04b4dd0879ed545e97af59a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:52.764547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:52.781710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:52.788321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01a38-1bd7-4ade-9391-f6b359626cfc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:52.797666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:52.798883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:52.799320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:52.799895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] PATH_INFO: `/v3/users/651a48f224014da78e16b1979a59dd07` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:52.802834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651a48f224014da78e16b1979a59dd07)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:52.807541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:52.995649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41618f00a04b4dd0879ed545e97af59a', 'request_id': 'req-8cf773d9-e0c2-432b-8e40-2dc018f640c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.004598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41618f00a04b4dd0879ed545e97af59a', 'request_id': 'req-8cf773d9-e0c2-432b-8e40-2dc018f640c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.014847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41618f00a04b4dd0879ed545e97af59a', 'request_id': 'req-8cf773d9-e0c2-432b-8e40-2dc018f640c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.102854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] The token cache is being invalidate because project 41618f00a04b4dd0879ed545e97af59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:53.103701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.104898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cf773d9-e0c2-432b-8e40-2dc018f640c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.110591 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1121/2234] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:52 2022] DELETE /identity/v3/projects/41618f00a04b4dd0879ed545e97af59a => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:53.110721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651a48f224014da78e16b1979a59dd07'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.122480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:53.122837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:53.123157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:53.125728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651a48f224014da78e16b1979a59dd07'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.139670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651a48f224014da78e16b1979a59dd07'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.140944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651a48f224014da78e16b1979a59dd07'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.142277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5a72601c-7cd5-440b-bba3-e652284b8895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651a48f224014da78e16b1979a59dd07'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:53.194014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:53.195318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:53.247710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1114/2235] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:52 2022] DELETE /identity/v3/users/651a48f224014da78e16b1979a59dd07 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:53.347121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1122/2236] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:53.357094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:53.357462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:53.358039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:53.405285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:53.408202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:53.541534 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1115/2237] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:53.548782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:53.575445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c4f2-2f67-4a88-85b5-161c80f02067 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:53.584489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:53.585472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:53.585984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:53.586475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:53.587637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:53.588154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:53.590127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:53.623885 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1123/2238] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:53.628730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:53.642807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7b92-8f7e-4a64-a940-df16b06dd385 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:53.648458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:53.652039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:53.652039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:53.652039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:53.652039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:53.653800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:53.782728 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1116/2239] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:53 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:53.784384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:53.805169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c70ec-8800-49db-9f89-195856d5f0d0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:53.936293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:53.937035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:53.937446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:53.937823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:53.938638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:53.941704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:53.976567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:53.978645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:54.000993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc1329-011a-499e-b4c8-51c07513f248 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.007905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.010181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.010640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.010975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] PATH_INFO: `/v3/projects/430366c2891c4343b53968c17611d27a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.012942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430366c2891c4343b53968c17611d27a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.015308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.035494 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1124/2240] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:53 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:54.039409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:54.064726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a566-617f-48dc-ba2e-29278532f8c9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.073022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.073655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.073958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.074288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.075744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.079895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.098717 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1125/2241] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:54.102859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:54.120323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1cf71-2638-44d0-a04a-dc83c1dcc6d5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.127168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.127693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.128099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.128522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.129317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.132083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.148091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1126/2242] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:54.156817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:54.184031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00361-20d5-42e2-9495-e844e486bb84 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.225217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430366c2891c4343b53968c17611d27a', 'request_id': 'req-797b36b6-cd36-4a6b-b676-c99f809b85f7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:54.242992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430366c2891c4343b53968c17611d27a', 'request_id': 'req-797b36b6-cd36-4a6b-b676-c99f809b85f7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:54.253540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430366c2891c4343b53968c17611d27a', 'request_id': 'req-797b36b6-cd36-4a6b-b676-c99f809b85f7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:54.316863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956615aa-6470-4e9c-9ea1-7aa6520793ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.318104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956615aa-6470-4e9c-9ea1-7aa6520793ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.318589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956615aa-6470-4e9c-9ea1-7aa6520793ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.319275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956615aa-6470-4e9c-9ea1-7aa6520793ea admin admin] PATH_INFO: `/v3/projects/f91c7fa8a6284040ac7d2d5cb4205f38/users/e8ae4c5d9df14e89ac4f48df71217024/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.340804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956615aa-6470-4e9c-9ea1-7aa6520793ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91c7fa8a6284040ac7d2d5cb4205f38, user_id=e8ae4c5d9df14e89ac4f48df71217024, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.345262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956615aa-6470-4e9c-9ea1-7aa6520793ea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.426657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] The token cache is being invalidate because project 430366c2891c4343b53968c17611d27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:54.428859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:54.430555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-797b36b6-cd36-4a6b-b676-c99f809b85f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:54.435059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1117/2243] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:53 2022] DELETE /identity/v3/projects/430366c2891c4343b53968c17611d27a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:54.444407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aaa9a-9111-492a-a0ea-2b839a7c5c61 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.444985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aaa9a-9111-492a-a0ea-2b839a7c5c61 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.445468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aaa9a-9111-492a-a0ea-2b839a7c5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.474137 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1127/2244] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:54 2022] PUT /identity/v3/projects/f91c7fa8a6284040ac7d2d5cb4205f38/users/e8ae4c5d9df14e89ac4f48df71217024/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:54.487450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.487751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.488061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.495360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1e4aaa9a-9111-492a-a0ea-2b839a7c5c61 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:54.498333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1e4aaa9a-9111-492a-a0ea-2b839a7c5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:54.571719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] MFA Rules not processed for user `e8ae4c5d9df14e89ac4f48df71217024`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:54.573157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:54.654521 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1118/2245] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:54.662688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:54.664612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.664948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.665227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.718250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:54.719524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:54.737112 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1128/2246] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:54.737670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:54.741100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:54.751448 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1119/2247] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:54.757181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:54.762814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c182a-0069-44cb-a1eb-b846e93c839a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.771689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.771917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.774220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.778366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.778366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.778588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828db77-136b-4dc8-ab1b-a3ac91fd69ef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.782164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.787575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.788696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.789182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.789659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.790575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:54.791993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.794893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.811894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1120/2248] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:54.817053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:54.829727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840186-a7bb-4617-ace0-9368537d4285 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:54.838919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:54.840127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:54.840688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:54.841185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:54.842246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:54.844924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:54.888900 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1129/2249] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:54 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:54.890317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.006559 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1121/2250] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:54 2022] POST /identity/v3/projects => generated 407 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:55.011790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.052564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c506-97ef-4b71-bd80-06d8e35b8376 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.195911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d0df8-f8fd-4533-85e7-1a21407227ae admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.216154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.218202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.219487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.219963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.220445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.222361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.222668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.222963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.223246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.223899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.226701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.232934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.359826 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1130/2251] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:54 2022] POST /identity/v3/users => generated 293 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:55.364601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.382224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e49cce-0ab1-4897-bcd9-5519af219ec9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.382871 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1122/2252] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:55 2022] POST /identity/v3/users => generated 304 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:55.387961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.391318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.392465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.393884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.394431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.396148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.398473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.411874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb69bc-4d74-4030-b52b-9be225868753 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.420549 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1131/2253] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:55.424443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.430174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.430857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.431136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.431436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.432121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.434020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.439084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639198-f4c6-4681-ac28-67879ef229d1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.448843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.451375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.451549 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1123/2254] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:55.451657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.451936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] PATH_INFO: `/v3/projects/108d111c25204d27b3e0d170514405cc/users/4439eb14a5f349cc9e99650de95900b9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.470583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.481361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108d111c25204d27b3e0d170514405cc, user_id=4439eb14a5f349cc9e99650de95900b9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.484312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.490446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73599e6d-f924-466d-b759-912b2e0947f8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.507671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.507671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.507671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.507671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.508247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.508247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.522363 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1124/2255] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:55.531250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.544685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea92db-0091-43cc-8ee4-2d5fe3147651 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.552433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca60a-4814-4a77-843e-180f8a47c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.553696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca60a-4814-4a77-843e-180f8a47c6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.554504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca60a-4814-4a77-843e-180f8a47c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.554821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca60a-4814-4a77-843e-180f8a47c6c4 admin admin] PATH_INFO: `/v3/projects/76a85e85f4934b7fa66f27087466b236/users/50ecfa2bd46347349dcf982e92c84095/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.599695 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1132/2256] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:55 2022] PUT /identity/v3/projects/108d111c25204d27b3e0d170514405cc/users/4439eb14a5f349cc9e99650de95900b9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:55.600146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca60a-4814-4a77-843e-180f8a47c6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a85e85f4934b7fa66f27087466b236, user_id=50ecfa2bd46347349dcf982e92c84095, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.600146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca60a-4814-4a77-843e-180f8a47c6c4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.602473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.753383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc078-a469-45ca-989d-8d63c132c644 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.810013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:55.810013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.810013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.810013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.810634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:55.810634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:55.819507 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1125/2257] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:55 2022] PUT /identity/v3/projects/76a85e85f4934b7fa66f27087466b236/users/50ecfa2bd46347349dcf982e92c84095/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:55.831234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171b75c-b653-4d89-8f75-b8a79a415073 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:55.831529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171b75c-b653-4d89-8f75-b8a79a415073 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:55.831845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171b75c-b653-4d89-8f75-b8a79a415073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:55.836053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1133/2258] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:55.837778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:55.866869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ce25-2c1f-45f2-8958-496ebd6933a7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:55.926568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7171b75c-b653-4d89-8f75-b8a79a415073 None None] MFA Rules not processed for user `50ecfa2bd46347349dcf982e92c84095`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:55.927888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7171b75c-b653-4d89-8f75-b8a79a415073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:56.006249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b83b6e-a99e-4ef3-a675-d2d6b283751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.006704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b83b6e-a99e-4ef3-a675-d2d6b283751c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.006966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b83b6e-a99e-4ef3-a675-d2d6b283751c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.007244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b83b6e-a99e-4ef3-a675-d2d6b283751c admin admin] PATH_INFO: `/v3/projects/108d111c25204d27b3e0d170514405cc/users/4439eb14a5f349cc9e99650de95900b9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.011232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b83b6e-a99e-4ef3-a675-d2d6b283751c admin admin] RBAC: Authorizing `identity:create_grant(project_id=108d111c25204d27b3e0d170514405cc, user_id=4439eb14a5f349cc9e99650de95900b9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.021460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b83b6e-a99e-4ef3-a675-d2d6b283751c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.059823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1134/2259] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:55 2022] PUT /identity/v3/projects/108d111c25204d27b3e0d170514405cc/users/4439eb14a5f349cc9e99650de95900b9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:56.065775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.066066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.068192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.082363 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1126/2260] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:56.085975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.086243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.086532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.119581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:56.122137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:56.139284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] MFA Rules not processed for user `4439eb14a5f349cc9e99650de95900b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:56.140539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:56.220633 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1135/2261] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:56.221710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.285581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:56.335845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1127/2262] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:56.337445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.342702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:56.380752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509c63-8f84-4d83-b115-aa28e9b279ad None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.390785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.391435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.394283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.394283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.394283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.394665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.498063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175a921-594e-4115-a0f5-1bb9ead3c8ff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.507169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.508013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.508301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.508576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.520160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.533374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.548509 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1136/2263] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:56 2022] POST /identity/v3/projects => generated 407 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:56.549096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.560888 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1128/2264] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:53:56.561594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.595149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413248-f360-4db9-b783-c43b8ea0d7b8 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.706234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.706967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.707312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.707656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.708416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.710741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.721302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea8068-4445-4e1e-a612-41e84f928879 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.727029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.728268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.728654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.729047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.730013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:56.730437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.734062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.749360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1137/2265] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:56.753719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.769463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e0651-6744-4a35-951b-0a4b0ff8e6de tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.781373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.781373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.781373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.782215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.782215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.783886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.811243 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1129/2266] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:56 2022] POST /identity/v3/users => generated 310 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:56.823300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.841117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d107-8f4e-4ad2-8231-aaea7035dd10 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.847678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.848691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.849048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.849394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.851263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.853747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:56.871914 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1130/2267] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:56.874907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.896594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416419-229a-4ef9-bd29-a6b2dd516089 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:56.919021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1138/2268] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:56 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:56.921076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:56.925000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:56.925316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:56.926128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:56.926706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] PATH_INFO: `/v3/projects/2904ceaa2413409db891c86b743b9025/users/6d70ea5eff534c2a991a5434d31cbeca/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:56.960491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2904ceaa2413409db891c86b743b9025, user_id=6d70ea5eff534c2a991a5434d31cbeca, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:56.964429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.044274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bb749-3b0b-41d6-b3a0-2597128cbf1e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:57.051683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:57.051683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.051994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.062339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.063090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:57.063436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:57.071328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.089580 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1131/2269] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:56 2022] PUT /identity/v3/projects/2904ceaa2413409db891c86b743b9025/users/6d70ea5eff534c2a991a5434d31cbeca/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:57.110208 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1139/2270] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:57.110443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:57.149097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:57.151384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:57.252503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67e4b-7ef1-4e3f-b75b-1f74ac8e14c0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:57.271563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:57.271563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.271733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.271889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.273670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:57.279902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.303647 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1132/2271] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:57.304943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:57.317458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b032-7659-4cb0-8010-346396e162b7 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:57.327220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccfff1-e05d-4d82-9862-c821652dcc03 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:57.333397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfc53b-6d5a-45ef-ae28-c34e1e4a4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:57.334476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfc53b-6d5a-45ef-ae28-c34e1e4a4ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.334970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfc53b-6d5a-45ef-ae28-c34e1e4a4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.335654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfc53b-6d5a-45ef-ae28-c34e1e4a4ae3 admin admin] PATH_INFO: `/v3/projects/2904ceaa2413409db891c86b743b9025/users/6d70ea5eff534c2a991a5434d31cbeca/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.338487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfc53b-6d5a-45ef-ae28-c34e1e4a4ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2904ceaa2413409db891c86b743b9025, user_id=6d70ea5eff534c2a991a5434d31cbeca, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:57.342948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfc53b-6d5a-45ef-ae28-c34e1e4a4ae3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.374517 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1133/2272] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:57 2022] PUT /identity/v3/projects/2904ceaa2413409db891c86b743b9025/users/6d70ea5eff534c2a991a5434d31cbeca/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:57.386103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.391500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.391500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.454724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] MFA Rules not processed for user `6d70ea5eff534c2a991a5434d31cbeca`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:57.456097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:57.487615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:57.487615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.487615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.487615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.610495 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1134/2273] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:57.611507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:57.622185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:57.682382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:57.685166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.701796 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1140/2274] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:53:57.701796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:57.702720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:57.725322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15337508-e2ed-4ccb-8e24-a5331dde9d8a service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:57.743445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48bb4d-efa9-4157-b497-0eb984bb9bf4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:57.749412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:57.750413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.750799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.751173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] PATH_INFO: `/v3/users/f6c54b20d1d64274ad3a32879f17181a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.753527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c54b20d1d64274ad3a32879f17181a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:57.755479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.839224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9a06-d99c-4323-8f9f-3cc2dff69d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:57.839924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9a06-d99c-4323-8f9f-3cc2dff69d07 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.840406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9a06-d99c-4323-8f9f-3cc2dff69d07 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.840586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9a06-d99c-4323-8f9f-3cc2dff69d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.853619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd9a06-d99c-4323-8f9f-3cc2dff69d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:57.856888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd9a06-d99c-4323-8f9f-3cc2dff69d07 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:57.871210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1141/2275] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:57 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:57.873368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924f51a-8e88-4749-9198-b224e09ac642 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:57.873731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924f51a-8e88-4749-9198-b224e09ac642 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:57.874077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924f51a-8e88-4749-9198-b224e09ac642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:57.912830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c924f51a-8e88-4749-9198-b224e09ac642 None None] MFA Rules not processed for user `8181cc5465544a0fba067403ace03d38`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:57.914348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c924f51a-8e88-4749-9198-b224e09ac642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:57.919930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:58.039055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c54b20d1d64274ad3a32879f17181a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:58.049528 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1142/2276] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:58.051599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad3a8-def4-426f-bad5-f943291abdb8 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.052072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad3a8-def4-426f-bad5-f943291abdb8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.052513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad3a8-def4-426f-bad5-f943291abdb8 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.057013 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1143/2277] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:58.058854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ad3a8-def4-426f-bad5-f943291abdb8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.063987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-464ad3a8-def4-426f-bad5-f943291abdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.068077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c54b20d1d64274ad3a32879f17181a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:58.083182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c54b20d1d64274ad3a32879f17181a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:58.084249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c54b20d1d64274ad3a32879f17181a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:58.087715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c54b20d1d64274ad3a32879f17181a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:58.096995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ad3a8-def4-426f-bad5-f943291abdb8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.103965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52909b47-502a-4f01-b058-dfe6900612e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.104756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52909b47-502a-4f01-b058-dfe6900612e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.105143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52909b47-502a-4f01-b058-dfe6900612e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.105522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52909b47-502a-4f01-b058-dfe6900612e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.107239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52909b47-502a-4f01-b058-dfe6900612e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.112029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52909b47-502a-4f01-b058-dfe6900612e5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.200681 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1135/2278] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:57 2022] DELETE /identity/v3/users/f6c54b20d1d64274ad3a32879f17181a => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:58.201718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:58.203271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.254657 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1144/2279] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:58 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:58.254657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.254657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.254657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.284006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:58.286973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.340119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.342626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.404877 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1145/2280] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:58.406031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.408131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.425885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cbbe8-bd3e-4f02-a673-520a495ea2c5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.431695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.432422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.432778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.433124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.434087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.436286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.439650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae462-fca6-4756-897d-7069e4a72474 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.508136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.508787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.509152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.509459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.510819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e5a2cb06e4645d6adf5e395f1483c85)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.513672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.515416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1136/2281] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:58 2022] GET /identity/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85 => generated 371 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:58.517110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.518872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.554424 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1146/2282] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:58 2022] POST /identity/v3/users => generated 309 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:58.555601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.556937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.624202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151e7ff-8d2b-4d4c-a1b5-8a645aa4951c tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.630267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.630885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.631160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.631524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.634092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:58.635472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d017c39-68df-4936-884c-2d031bdcd6e0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.640923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.641654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.642011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.642286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.655017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.656801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.667666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1147/2283] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:58.668498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.684206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c0e0-e9d4-4a06-82f3-3805ce6efa88 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.698832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.701530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.701880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.702160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.702863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.707000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.722074 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1148/2284] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:58.726197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.737501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.739463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.742680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98c376-d1b1-4fc9-8627-444b1507552c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:58.750558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130e818-1d61-4e37-bd5b-264de875f819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:58.752327 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1137/2285] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:58 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:58.752463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130e818-1d61-4e37-bd5b-264de875f819 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:58.752791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130e818-1d61-4e37-bd5b-264de875f819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:58.753212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130e818-1d61-4e37-bd5b-264de875f819 admin admin] PATH_INFO: `/v3/projects/ddf5539d7c3c42ac9aee51b5731d5f03/users/4b3c25a68fad4670ba65ce93dd19f9be/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:58.786678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130e818-1d61-4e37-bd5b-264de875f819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf5539d7c3c42ac9aee51b5731d5f03, user_id=4b3c25a68fad4670ba65ce93dd19f9be, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:58.795958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130e818-1d61-4e37-bd5b-264de875f819 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:58.944040 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1149/2286] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:58 2022] PUT /identity/v3/projects/ddf5539d7c3c42ac9aee51b5731d5f03/users/4b3c25a68fad4670ba65ce93dd19f9be/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:58.952138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:58.970859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923db6-9876-4e27-849b-ffd2bbc1a202 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.019620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6f365-3b56-4fcd-ae8e-ec64b5cccbf1 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.019860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6f365-3b56-4fcd-ae8e-ec64b5cccbf1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.020375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6f365-3b56-4fcd-ae8e-ec64b5cccbf1 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.021325 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1150/2287] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:59.031217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6f365-3b56-4fcd-ae8e-ec64b5cccbf1 None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:59.094504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.095263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.095677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.096030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.097003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.098867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.113393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1138/2288] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:59.118850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:59.141271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977e5f-2051-40ae-a1ec-d1db93655ae6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.147697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.148621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.149034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.149415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] PATH_INFO: `/v3/projects/ddf5539d7c3c42ac9aee51b5731d5f03/users/4b3c25a68fad4670ba65ce93dd19f9be/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.152275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf5539d7c3c42ac9aee51b5731d5f03, user_id=4b3c25a68fad4670ba65ce93dd19f9be, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.156013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.172290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1139/2289] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:59 2022] PUT /identity/v3/projects/ddf5539d7c3c42ac9aee51b5731d5f03/users/4b3c25a68fad4670ba65ce93dd19f9be/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:59.204890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6f365-3b56-4fcd-ae8e-ec64b5cccbf1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:59.283475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6f365-3b56-4fcd-ae8e-ec64b5cccbf1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.351473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.352227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.352590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.352941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.354284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e5a2cb06e4645d6adf5e395f1483c85)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.357017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.359444 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1151/2290] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:59 2022] GET /identity/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85 => generated 371 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:59.409575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:59.429024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221492d-be26-4be7-87ee-3f3bea2dd61c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.438992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.439763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.440447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.440974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.441804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:59.442363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.444814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.480036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:59.483291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:59.493264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1140/2291] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:59.495029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:59.520902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7c2ee-4245-4f3b-a880-1a259ba3e6ce tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.548059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.548684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.548965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.549242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.550070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.551912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.625303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51198e-cee1-4494-acd1-7265004904d5 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.632695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.634082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.634712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.635287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] PATH_INFO: `/v3/projects/5dff10f27a544333930eccd8121bd0ce` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.637408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dff10f27a544333930eccd8121bd0ce)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.639718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.662987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1141/2292] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:59 2022] POST /identity/v3/users => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:59.667970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:59.692918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407526e-57dc-46d1-aa30-4ed31800ba0e tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:59.698801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:59.699957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.699957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.700153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.701351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:59.701732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:59.703622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce88fa1-d958-4858-bea5-90c72d17fa05 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:59.722858 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1142/2293] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:59.729934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:59.806711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.806996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.807268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.825444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dff10f27a544333930eccd8121bd0ce', 'request_id': 'req-14408a11-ea8c-4e81-9c5f-74ababbeb362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:59.832892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] MFA Rules not processed for user `548435e7f5d7476ea9cf0a226e5cc652`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:59.834304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:59.841132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dff10f27a544333930eccd8121bd0ce', 'request_id': 'req-14408a11-ea8c-4e81-9c5f-74ababbeb362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:59.858908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dff10f27a544333930eccd8121bd0ce', 'request_id': 'req-14408a11-ea8c-4e81-9c5f-74ababbeb362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:59.959331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] The token cache is being invalidate because project 5dff10f27a544333930eccd8121bd0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:59.959943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:59.961051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14408a11-ea8c-4e81-9c5f-74ababbeb362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:59.964100 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1152/2294] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:59 2022] DELETE /identity/v3/projects/5dff10f27a544333930eccd8121bd0ce => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:59.966372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0b75-81ea-4248-b0ff-8ef63ad4ea3d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.966728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0b75-81ea-4248-b0ff-8ef63ad4ea3d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.967116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0b75-81ea-4248-b0ff-8ef63ad4ea3d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.968955 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1153/2295] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:53:59.970150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:59.970523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:59.971259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:59.991647 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1143/2296] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:59.991647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:53:59.994662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:00.033939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:00.035556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:00.125826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:00.158817 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1154/2297] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:00.159787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:00.160525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:00.161665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:00.162276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:00.187815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1599c08-9061-4d8b-9e3a-b89f19058264 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:00.200343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:00.203312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.207434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.207434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] PATH_INFO: `/v3/users/50ecfa2bd46347349dcf982e92c84095` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.207434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ecfa2bd46347349dcf982e92c84095)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:00.213246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:00.257956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98367e73-5eb7-49d3-be79-7fb4319f5277 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:00.264075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bc60b-502c-4f1f-9ea7-b7dd04a52f11 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:00.264725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc60b-502c-4f1f-9ea7-b7dd04a52f11 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.265006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc60b-502c-4f1f-9ea7-b7dd04a52f11 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.279455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc60b-502c-4f1f-9ea7-b7dd04a52f11 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.279455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bc60b-502c-4f1f-9ea7-b7dd04a52f11 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e5a2cb06e4645d6adf5e395f1483c85)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:00.279455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bc60b-502c-4f1f-9ea7-b7dd04a52f11 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:00.279455 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1144/2298] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:53:59 2022] GET /identity/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85 => generated 371 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:00.279455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.279979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.279979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.302618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:00.304791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:00.316455 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1145/2299] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:00.321202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:00.334655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6c28-d9da-437c-b22e-43cbb1f25c63 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:00.342411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:00.342573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.342799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.343090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.344386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:00.344707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:00.346570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:00.375735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1146/2300] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:00.376879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:00.388206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10454f88-0079-44fe-94b9-6afdb2d943aa admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:00.396529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:00.398477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.398792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.399097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.399764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:00.401810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:00.559291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ecfa2bd46347349dcf982e92c84095'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:00.560370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ecfa2bd46347349dcf982e92c84095'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:00.573890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1147/2301] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:00 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:00.578242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:00.712565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ecfa2bd46347349dcf982e92c84095'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:00.739647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ecfa2bd46347349dcf982e92c84095'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:00.740325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cbe10-debd-46ba-ae11-a355ce181bfe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:00.746075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ccee77b1-756f-4f3d-b82c-4d3f387eb2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ecfa2bd46347349dcf982e92c84095'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:00.774755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:00.775617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.776095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.776577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.783660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:00.808117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:00.848930 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1155/2302] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:00 2022] DELETE /identity/v3/users/50ecfa2bd46347349dcf982e92c84095 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:00.857424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:00.857809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:00.858200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:00.943856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:00.954131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:01.018342 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1148/2303] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:00 2022] POST /identity/v3/users => generated 287 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:01.020218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:01.040233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:01.089773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba52e61-788a-43c0-b06d-4814b32e0c2b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:01.244303 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1156/2304] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:01.277410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:01.279615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:01.281795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:01.284217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:01.285547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:01.286079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:01.287101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:01.288980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:01.319108 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1149/2305] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:01.325202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:01.344970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c04aba-aac5-49b0-b3cd-f8cc0e905479 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:01.366749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:01.367462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:01.368332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:01.368929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:01.369298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:01.374247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:01.408419 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1150/2306] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:01.410707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:01.451166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f09818-7653-4cdf-8c0f-5a635a7523a2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:01.486502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2f06-bfc1-4567-9bfd-746512d1e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:01.487994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2f06-bfc1-4567-9bfd-746512d1e405 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:01.488475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2f06-bfc1-4567-9bfd-746512d1e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:01.488905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2f06-bfc1-4567-9bfd-746512d1e405 admin admin] PATH_INFO: `/v3/projects/e21fd585b76e48c8bdbf075a22a59bd8/users/7a0c37253c01462da4554fdde8840777/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:01.494443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd778-2574-4639-a82c-0bb21163ad6d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:01.516186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf2f06-bfc1-4567-9bfd-746512d1e405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21fd585b76e48c8bdbf075a22a59bd8, user_id=7a0c37253c01462da4554fdde8840777, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:01.516408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126303d-367d-41f2-ac8b-043491a46d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:01.516961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126303d-367d-41f2-ac8b-043491a46d54 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:01.517245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126303d-367d-41f2-ac8b-043491a46d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:01.517518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126303d-367d-41f2-ac8b-043491a46d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:01.521023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf2f06-bfc1-4567-9bfd-746512d1e405 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:01.538846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126303d-367d-41f2-ac8b-043491a46d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:01.540384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126303d-367d-41f2-ac8b-043491a46d54 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:01.562256 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1157/2307] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:01.563741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:01.566830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:01.567328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:01.574203 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1158/2308] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:01.579971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:01.582056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:01.627721 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1151/2309] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:01 2022] PUT /identity/v3/projects/e21fd585b76e48c8bdbf075a22a59bd8/users/7a0c37253c01462da4554fdde8840777/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:01.640526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:01.644419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:01.644419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:01.686726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:01.745770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] MFA Rules not processed for user `7a0c37253c01462da4554fdde8840777`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:01.752810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:01.794899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:01.822566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:01.824440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:01.883676 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1152/2310] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:02.030427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4589f46-5378-494a-93b1-5c5828630a5d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:02.044563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:02.045239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:02.045522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:02.045792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:02.047437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e5a2cb06e4645d6adf5e395f1483c85)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:02.049549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:02.051441 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1159/2311] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:01 2022] GET /identity/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85 => generated 371 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:54:02.108725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:02.149015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1a9f1-dd36-4afc-b076-a495b971d433 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:02.173011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:02.173770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:02.174163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:02.174527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/users/9da0d72230b14352a7a01794582a9774` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:02.238006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9da0d72230b14352a7a01794582a9774)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:02.240338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:02.342250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:02.352574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:02.401176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e210-899b-4100-8794-376ff9cad004 tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:02.421183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:02.428323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:02.428323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:02.428323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:02.450337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:02.456482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:02.480184 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1160/2312] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:54:02.508228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da0d72230b14352a7a01794582a9774'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:02.546046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da0d72230b14352a7a01794582a9774'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:02.561677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da0d72230b14352a7a01794582a9774'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:02.564452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da0d72230b14352a7a01794582a9774'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:02.565444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da0d72230b14352a7a01794582a9774'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:02.601230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:02.603234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:02.660646 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1153/2313] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:02 2022] DELETE /identity/v3/users/9da0d72230b14352a7a01794582a9774 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:02.662455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:02.673383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:02.805289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe0e4-02ef-439a-96c5-d6b173f786c0 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:02.832503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606effe4-dd45-48ef-af52-1f9af0e336dc tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:02.903076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4439eb14a5f349cc9e99650de95900b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '108d111c25204d27b3e0d170514405cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:02.903076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:02.903076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:02.904853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] PATH_INFO: `/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:02.904853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e5a2cb06e4645d6adf5e395f1483c85)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:02.904853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:02.938769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:02.953558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:02.955261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:02.956108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] PATH_INFO: `/v3/projects/76a85e85f4934b7fa66f27087466b236` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:02.958055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a85e85f4934b7fa66f27087466b236)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:02.960404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:03.392813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5a2cb06e4645d6adf5e395f1483c85', 'request_id': 'req-515f7ffa-a980-4d41-b4ea-91692b348a0f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.393684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a85e85f4934b7fa66f27087466b236', 'request_id': 'req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.426138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a85e85f4934b7fa66f27087466b236', 'request_id': 'req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.426335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5a2cb06e4645d6adf5e395f1483c85', 'request_id': 'req-515f7ffa-a980-4d41-b4ea-91692b348a0f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.445952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a85e85f4934b7fa66f27087466b236', 'request_id': 'req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.448031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5a2cb06e4645d6adf5e395f1483c85', 'request_id': 'req-515f7ffa-a980-4d41-b4ea-91692b348a0f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.550159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] The token cache is being invalidate because project 4e5a2cb06e4645d6adf5e395f1483c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:03.551517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.553951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.559910 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1154/2314] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:02 2022] DELETE /identity/v3/projects/4e5a2cb06e4645d6adf5e395f1483c85 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:03.565444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:03.579878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:03.698198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7ffa-a980-4d41-b4ea-91692b348a0f tempest-QuotasAdminTestV257-609978744 tempest-QuotasAdminTestV257-609978744-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:03.702226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] The token cache is being invalidate because project 76a85e85f4934b7fa66f27087466b236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:03.702537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.705424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:03.711128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1161/2315] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:02 2022] DELETE /identity/v3/projects/76a85e85f4934b7fa66f27087466b236 => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:03.717478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:03.724129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:03.880319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:03.881141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:03.881566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:03.882028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] PATH_INFO: `/v3/users/e8ae4c5d9df14e89ac4f48df71217024` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:03.883397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ae4c5d9df14e89ac4f48df71217024)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:03.886378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:04.022409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c7ba5-5c40-45c7-9af6-11a06b0d9d89 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:04.041388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:04.049298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:04.051582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:04.052372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] PATH_INFO: `/v3/users/6d70ea5eff534c2a991a5434d31cbeca` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:04.063388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d70ea5eff534c2a991a5434d31cbeca)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:04.068527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:04.160922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ae4c5d9df14e89ac4f48df71217024'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.194532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:04.217824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ae4c5d9df14e89ac4f48df71217024'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.247297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ae4c5d9df14e89ac4f48df71217024'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.248725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ae4c5d9df14e89ac4f48df71217024'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.249587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-591ee23e-314f-4a78-8025-92bc134e66ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ae4c5d9df14e89ac4f48df71217024'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.423752 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1155/2316] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:03 2022] DELETE /identity/v3/users/e8ae4c5d9df14e89ac4f48df71217024 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:04.436986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:04.439309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:04.439706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:04.511464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:04.513048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:04.650566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d70ea5eff534c2a991a5434d31cbeca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.652555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d70ea5eff534c2a991a5434d31cbeca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.787566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d70ea5eff534c2a991a5434d31cbeca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.808477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d70ea5eff534c2a991a5434d31cbeca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.811878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d70ea5eff534c2a991a5434d31cbeca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:04.826724 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1156/2317] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:04.849809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:04.856832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:04.883875 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1162/2318] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:03 2022] DELETE /identity/v3/users/6d70ea5eff534c2a991a5434d31cbeca => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:05.021156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:05.105666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d11ff-3546-4e9b-8a5f-e947a3edc137 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:05.249112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:05.257587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:05.257587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:05.257587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:05.257587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:05.476811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:05.478479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:05.503182 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1157/2319] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:07.045598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:07.049925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:07.080430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:07.085562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:07.090540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293da51e-79cf-4f64-9848-0f7fd467d0f0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:07.108717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:07.109391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:07.109676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:07.109991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] PATH_INFO: `/v3/users/7a0c37253c01462da4554fdde8840777` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:07.116811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0c37253c01462da4554fdde8840777)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:07.125050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:07.194112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:07.264514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281fadd-9193-40aa-a563-8a655f980338 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:07.280294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52017880-6845-4162-8c50-22d57748e203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:07.280294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52017880-6845-4162-8c50-22d57748e203 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:07.280294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52017880-6845-4162-8c50-22d57748e203 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:07.280294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52017880-6845-4162-8c50-22d57748e203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:07.282829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-52017880-6845-4162-8c50-22d57748e203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:07.458442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52017880-6845-4162-8c50-22d57748e203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:07.462102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52017880-6845-4162-8c50-22d57748e203 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:07.482785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0c37253c01462da4554fdde8840777'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.494098 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1158/2320] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:07 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:54:07.494745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0c37253c01462da4554fdde8840777'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.496566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52017880-6845-4162-8c50-22d57748e203 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:07.500450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-52017880-6845-4162-8c50-22d57748e203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:07.541282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52017880-6845-4162-8c50-22d57748e203 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:07.557572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:07.559315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:07.559834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:07.560680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] PATH_INFO: `/v3/projects/2904ceaa2413409db891c86b743b9025` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:07.572779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2904ceaa2413409db891c86b743b9025)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:07.575965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0c37253c01462da4554fdde8840777'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.581004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:07.589119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0c37253c01462da4554fdde8840777'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.598431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-52248c4e-6a0c-4dbf-a6a9-df0f45311988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0c37253c01462da4554fdde8840777'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.644816 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1163/2321] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:07 2022] DELETE /identity/v3/users/7a0c37253c01462da4554fdde8840777 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:07.651542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:07.656964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:07.657306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:07.657633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:07.714135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:07.716070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:07.848593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2904ceaa2413409db891c86b743b9025', 'request_id': 'req-a33e62a3-ba6a-4147-95d1-69028c31c3f1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.868477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2904ceaa2413409db891c86b743b9025', 'request_id': 'req-a33e62a3-ba6a-4147-95d1-69028c31c3f1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.882159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2904ceaa2413409db891c86b743b9025', 'request_id': 'req-a33e62a3-ba6a-4147-95d1-69028c31c3f1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.904798 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1164/2322] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:07.948881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:07.950919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:07.993457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] The token cache is being invalidate because project 2904ceaa2413409db891c86b743b9025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:07.993730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.995679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a33e62a3-ba6a-4147-95d1-69028c31c3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:07.998915 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1159/2323] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:07 2022] DELETE /identity/v3/projects/2904ceaa2413409db891c86b743b9025 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:08.004095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.004381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.004658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.051875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:08.053195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:08.061282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c528b-643e-4c8b-8f3e-85b60faeeb36 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:08.149334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:08.151428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.151991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.152535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.154998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:08.197226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1160/2324] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:08.199493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:08.200806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:08.214793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc4d37-d663-4bd4-be0d-d0b5ef191513 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:08.221959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:08.222618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.223180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.223180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] PATH_INFO: `/v3/projects/f91c7fa8a6284040ac7d2d5cb4205f38` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.262186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:08.265907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff597ee-1b4a-405d-87bb-ad18782947d5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:08.267196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91c7fa8a6284040ac7d2d5cb4205f38)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:08.271913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:08.285234 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1165/2325] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:08.286991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.287351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.287688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.328147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:08.332654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:08.357363 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1166/2326] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:08.361420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:08.381702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a24d0a-da89-4cb3-85d5-3c076a509918 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:08.388406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:08.389175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.389664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.390010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.390967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:08.391084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:08.392713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:08.415175 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1167/2327] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:08.430427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:08.462058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d44e7-a08e-438f-907b-c3b231474ebd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:08.476353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91c7fa8a6284040ac7d2d5cb4205f38', 'request_id': 'req-7947d18f-fa87-4415-896b-36e4edf9bf29'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.492885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91c7fa8a6284040ac7d2d5cb4205f38', 'request_id': 'req-7947d18f-fa87-4415-896b-36e4edf9bf29'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.503855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91c7fa8a6284040ac7d2d5cb4205f38', 'request_id': 'req-7947d18f-fa87-4415-896b-36e4edf9bf29'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.578635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] The token cache is being invalidate because project f91c7fa8a6284040ac7d2d5cb4205f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:08.579033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.580024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.581146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:08.582273 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1161/2328] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:08 2022] DELETE /identity/v3/projects/f91c7fa8a6284040ac7d2d5cb4205f38 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:08.585013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.585365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.585661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.586672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:08.587088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:08.588693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:08.588922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:08.606317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947d18f-fa87-4415-896b-36e4edf9bf29 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:08.611965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:08.613361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.614005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.614495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] PATH_INFO: `/v3/users/4439eb14a5f349cc9e99650de95900b9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.616113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4439eb14a5f349cc9e99650de95900b9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:08.623815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:08.758344 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1168/2329] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:08 2022] POST /identity/v3/projects => generated 411 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:08.762675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:08.768840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:08.881588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4439eb14a5f349cc9e99650de95900b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.911184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772f1b6-dc13-4363-ba1e-fb4a86bfff9a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:08.925975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4439eb14a5f349cc9e99650de95900b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.928421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:08.929111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:08.929389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:08.929661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:08.930361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:08.932941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:08.960122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4439eb14a5f349cc9e99650de95900b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.961649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4439eb14a5f349cc9e99650de95900b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:08.962784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4439eb14a5f349cc9e99650de95900b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:09.082777 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1162/2330] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:08 2022] DELETE /identity/v3/users/4439eb14a5f349cc9e99650de95900b9 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:09.090360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1169/2331] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:08 2022] POST /identity/v3/users => generated 306 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:09.092557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:09.099721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:09.127837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:09.244195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e0fe6-776a-432d-abd7-8ef298c0a17b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:09.254199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:09.255026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:09.255305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:09.255578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:09.256238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:09.258406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:09.284974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1163/2332] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:09.286343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:09.298280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e0cd9-31e9-456d-89cb-19c72fbbc695 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:09.304831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629cc01-f335-4ab8-99b8-92f7ad0736d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:09.308437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629cc01-f335-4ab8-99b8-92f7ad0736d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:09.308437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629cc01-f335-4ab8-99b8-92f7ad0736d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:09.308437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629cc01-f335-4ab8-99b8-92f7ad0736d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:09.308437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629cc01-f335-4ab8-99b8-92f7ad0736d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:09.310959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629cc01-f335-4ab8-99b8-92f7ad0736d7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:09.333776 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1170/2333] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:09.338997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:09.370269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f2bca-cf05-4b0f-a484-f57a67f8f446 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:09.382896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:09.384566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:09.384953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:09.385626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] PATH_INFO: `/v3/projects/f85e318103684eda871538b0cdcffca7/users/d27b5e8a66004718aff2474ffcf4a502/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:09.410262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85e318103684eda871538b0cdcffca7, user_id=d27b5e8a66004718aff2474ffcf4a502, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:09.413912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:09.514995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1164/2334] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:09 2022] PUT /identity/v3/projects/f85e318103684eda871538b0cdcffca7/users/d27b5e8a66004718aff2474ffcf4a502/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:09.516643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:09.516850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:09.517121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:09.584248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] MFA Rules not processed for user `d27b5e8a66004718aff2474ffcf4a502`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:09.586626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:09.615883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:09.709671 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1171/2335] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:09 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:09.714996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:09.886140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:09.888221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:09.902672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2dc3-aa51-443e-98b7-36030890fb00 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:09.913637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:09.914440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:09.914798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:09.914984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:09.919677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:09.925797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:09.932688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56795a2-0933-46fb-a7d2-09803b8d23a6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:09.963384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:09.967243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:09.968633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:09.971288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] PATH_INFO: `/v3/projects/e21fd585b76e48c8bdbf075a22a59bd8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:09.975509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21fd585b76e48c8bdbf075a22a59bd8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:09.979428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:10.083816 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1165/2336] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:09 2022] POST /identity/v3/projects => generated 409 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:10.091469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.131673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21fd585b76e48c8bdbf075a22a59bd8', 'request_id': 'req-13778719-0203-491a-b8f9-042e25b0d6c1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.144631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21fd585b76e48c8bdbf075a22a59bd8', 'request_id': 'req-13778719-0203-491a-b8f9-042e25b0d6c1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.163367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21fd585b76e48c8bdbf075a22a59bd8', 'request_id': 'req-13778719-0203-491a-b8f9-042e25b0d6c1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.258981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02514-f7dc-462c-a0df-e309be0d88e4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:10.297611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] The token cache is being invalidate because project e21fd585b76e48c8bdbf075a22a59bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:10.300025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.300445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13778719-0203-491a-b8f9-042e25b0d6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.302722 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1172/2337] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:09 2022] DELETE /identity/v3/projects/e21fd585b76e48c8bdbf075a22a59bd8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:10.307504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7d3b-2065-41d8-915e-abc9b9502aad None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.308087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7d3b-2065-41d8-915e-abc9b9502aad None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.308642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7d3b-2065-41d8-915e-abc9b9502aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.337026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-06ab7d3b-2065-41d8-915e-abc9b9502aad None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:10.338556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-06ab7d3b-2065-41d8-915e-abc9b9502aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:10.420599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:10.420599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.426732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.426732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.426732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:10.427683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:10.518032 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1173/2338] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:10.527890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91451956-c161-497b-9663-67653f82ba91 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.528788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91451956-c161-497b-9663-67653f82ba91 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.529401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91451956-c161-497b-9663-67653f82ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.553364 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1166/2339] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:10 2022] POST /identity/v3/users => generated 311 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:10.557842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.561000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:10.573358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-91451956-c161-497b-9663-67653f82ba91 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:10.575454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-91451956-c161-497b-9663-67653f82ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:10.587794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c4f37-a35e-4781-a470-d85dbb630795 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:10.595701 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1174/2340] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:10.600364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91451956-c161-497b-9663-67653f82ba91 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.603307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-91451956-c161-497b-9663-67653f82ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:10.606735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:10.608295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.608295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.608295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.609512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:10.646973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:10.673537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91451956-c161-497b-9663-67653f82ba91 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:10.681348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:10.682089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.682369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.682700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] PATH_INFO: `/v3/projects/108d111c25204d27b3e0d170514405cc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.684187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=108d111c25204d27b3e0d170514405cc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:10.686118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:10.695535 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1167/2341] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:10.701716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.732637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9a87-4b93-4d33-85de-7fb75b0d80d7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:10.744774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:10.747505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.748393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.748677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.749462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:10.749701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:10.755316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:10.780454 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1168/2342] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:10.781482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.793676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f15a1-3941-45f0-a4bc-aefeca0b4ff2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:10.799351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:10.800018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:10.804745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:10.804745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] PATH_INFO: `/v3/projects/b07d48e648744765922ac490740502c5/users/48316f9379dd43a884f9c594a9dc070b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:10.822682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07d48e648744765922ac490740502c5, user_id=48316f9379dd43a884f9c594a9dc070b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:10.827017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:10.829979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108d111c25204d27b3e0d170514405cc', 'request_id': 'req-8dddafec-0c21-49ff-b9ca-a45849b0ce56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.840283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108d111c25204d27b3e0d170514405cc', 'request_id': 'req-8dddafec-0c21-49ff-b9ca-a45849b0ce56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.849606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108d111c25204d27b3e0d170514405cc', 'request_id': 'req-8dddafec-0c21-49ff-b9ca-a45849b0ce56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.947703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] The token cache is being invalidate because project 108d111c25204d27b3e0d170514405cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:10.952337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.955042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:10.955228 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1169/2343] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:10 2022] PUT /identity/v3/projects/b07d48e648744765922ac490740502c5/users/48316f9379dd43a884f9c594a9dc070b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:10.956871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.959888 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1175/2344] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:10 2022] DELETE /identity/v3/projects/108d111c25204d27b3e0d170514405cc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:10.964643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:10.967897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:10.972400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:11.056175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a4296-d18c-4bf3-b5b5-ba2d2b418f8b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.064221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.065030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.065394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.065744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.066512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.070002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.160575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddafec-0c21-49ff-b9ca-a45849b0ce56 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.171458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ae43-8184-4a7a-a5fa-364544d38088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.172882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ae43-8184-4a7a-a5fa-364544d38088 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.173524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ae43-8184-4a7a-a5fa-364544d38088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.174352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ae43-8184-4a7a-a5fa-364544d38088 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.175772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ae43-8184-4a7a-a5fa-364544d38088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.179243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ae43-8184-4a7a-a5fa-364544d38088 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.204030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1176/2345] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:11.206776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.207854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.208409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.211510 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1170/2346] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:10 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:11.212481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:11.219233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:11.257580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:11.260815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:11.494067 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1177/2347] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:11.495640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:11.497552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4baae9-d823-4f57-b890-4694a74d3726 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.510116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801aa3-a2c5-4bf9-8731-7df2d23a8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.511426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801aa3-a2c5-4bf9-8731-7df2d23a8a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.512475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801aa3-a2c5-4bf9-8731-7df2d23a8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.513684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801aa3-a2c5-4bf9-8731-7df2d23a8a95 admin admin] PATH_INFO: `/v3/projects/b07d48e648744765922ac490740502c5/users/48316f9379dd43a884f9c594a9dc070b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.514154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d1a8-bd67-48a3-84e2-753320589151 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.516792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20801aa3-a2c5-4bf9-8731-7df2d23a8a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07d48e648744765922ac490740502c5, user_id=48316f9379dd43a884f9c594a9dc070b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.522866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20801aa3-a2c5-4bf9-8731-7df2d23a8a95 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.523240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.524480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.524937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.526001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.526853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.552107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.560055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1171/2348] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:11 2022] PUT /identity/v3/projects/b07d48e648744765922ac490740502c5/users/48316f9379dd43a884f9c594a9dc070b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:11.562186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48521fc-2ce9-42f5-913a-d6311d58d228 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.562702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48521fc-2ce9-42f5-913a-d6311d58d228 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.563215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48521fc-2ce9-42f5-913a-d6311d58d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.591295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f48521fc-2ce9-42f5-913a-d6311d58d228 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:11.593310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f48521fc-2ce9-42f5-913a-d6311d58d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:11.688682 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1172/2349] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:11.690545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6d20-5c45-4085-b0ec-afce5910afa9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.691046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6d20-5c45-4085-b0ec-afce5910afa9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.691554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6d20-5c45-4085-b0ec-afce5910afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.734646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1178/2350] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:11 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:11.735202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:11.743393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-54eb6d20-5c45-4085-b0ec-afce5910afa9 None None] MFA Rules not processed for user `48316f9379dd43a884f9c594a9dc070b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:11.745148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54eb6d20-5c45-4085-b0ec-afce5910afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:11.749112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3099fc-5b40-48b5-8b3c-d9710218817a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.758742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.759659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.760052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.760446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.761438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:11.761585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.763963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.805722 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1179/2351] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:11.807482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:11.855422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688e483-2d8b-4934-ab61-4061b5542542 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.874304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.882042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.882665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.883050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.884316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.889770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.908777 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1180/2352] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:11.909519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:11.923131 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1173/2353] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:11.926073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.926837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.927908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.932025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1429a-182b-4a08-b018-b3e84299561c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:11.941299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:11.942414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:11.942925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:11.943657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:11.944459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:11.949872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:11.968090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:11.970377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.063587 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1174/2354] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:12.066556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.094273 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1181/2355] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:11 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:12.096461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8e4f-4db9-464f-89b7-b04b3d5fe2cd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.101930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.109813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.160652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:12.185712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.190290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.190290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.190290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.190290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.190290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.203283 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1175/2356] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:12.205431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.222158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2c96e-259e-4e3f-9aca-3c8f6fdee208 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.228132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.228798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.229079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.229508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.230923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.233714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.234259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971f74c-ee51-4302-9740-dc4072f026f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.239105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.239996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.240428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.266224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.329471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.330972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.344632 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1182/2357] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:12.345506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.357811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0444f-b942-42d8-84f7-4b38045c1bf4 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.365163 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1176/2358] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:12 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:12.368614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.369617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.370437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.370794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.371240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] PATH_INFO: `/v3/projects/66b6b50b43864bc8aba09932cb8a4589/users/8a5918f7fd3d48b8b0be9ee6715e53d0/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.389599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245dfb-7b9f-445b-8606-d972e1fac683 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.390259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b6b50b43864bc8aba09932cb8a4589, user_id=8a5918f7fd3d48b8b0be9ee6715e53d0, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.393497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.395697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.396945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.397931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.398776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.399493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.401272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.416159 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1177/2359] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:12.420347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.433170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eb1f7-c269-474d-ace3-cb4548904a8b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.439255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0921c-88f9-45a6-8cc9-3c7106fe653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.439990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0921c-88f9-45a6-8cc9-3c7106fe653d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.440339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0921c-88f9-45a6-8cc9-3c7106fe653d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.441214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0921c-88f9-45a6-8cc9-3c7106fe653d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.442029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0921c-88f9-45a6-8cc9-3c7106fe653d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.444525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0921c-88f9-45a6-8cc9-3c7106fe653d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.451408 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1183/2360] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:12 2022] PUT /identity/v3/projects/66b6b50b43864bc8aba09932cb8a4589/users/8a5918f7fd3d48b8b0be9ee6715e53d0/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:12.457913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1178/2361] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:12.460882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.466675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bd52e-a957-4ba6-aca0-b8390f7bccbc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.467172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bd52e-a957-4ba6-aca0-b8390f7bccbc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.467595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bd52e-a957-4ba6-aca0-b8390f7bccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.595520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e22bd52e-a957-4ba6-aca0-b8390f7bccbc None None] MFA Rules not processed for user `8a5918f7fd3d48b8b0be9ee6715e53d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:12.595520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e22bd52e-a957-4ba6-aca0-b8390f7bccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.596904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a863-cfc5-43e8-8f0d-1ed176259d8c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.596904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.596904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.596904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.597239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d/users/6be4c811a7b844ccaec3ce70ca03584c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.597239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b642faa8bc55428a9fbf3674c786de5d, user_id=6be4c811a7b844ccaec3ce70ca03584c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.597239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:12.612043 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1179/2362] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:12.682495 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1184/2363] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:12 2022] PUT /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d/users/6be4c811a7b844ccaec3ce70ca03584c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:12.694379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.694871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.695185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.740615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] MFA Rules not processed for user `6be4c811a7b844ccaec3ce70ca03584c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:12.742377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.811020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.814225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.873438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1180/2364] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:12.878840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:12.906720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:12.937626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905791d1-169c-4e3c-b149-a7391e14fac5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.944154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.947322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.947322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.947322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.948070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.975790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e403-2862-477c-9177-12616e25ae5c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:12.981647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:12.982319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.982600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.982871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.983513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:12.985625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:13.036255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:13.038044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:13.055177 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1185/2365] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:54:13.084397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1181/2366] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:12 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:13.094957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:13.112105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c415ce-654e-4868-95ae-e409015cacda service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:13.178990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:13.179641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:13.179641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:13.180098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:13.180855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:13.182957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:13.320985 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1186/2367] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:13 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:13.325730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:13.341453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b442857-fd5c-49f6-8d7a-1f37b400bbcb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:13.350128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:13.351102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:13.351562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:13.352037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:13.353502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:13.358732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:13.375961 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1182/2368] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:13.379730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:13.395402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f94b8-61ad-4537-a629-2b89fe6e9351 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:13.401506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:13.404546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:13.405219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:13.406319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] PATH_INFO: `/v3/projects/fd00d2e28e94468d981f534711b8009a/users/2072f485ae164798aeb2bd88ccb94353/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:13.455922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd00d2e28e94468d981f534711b8009a, user_id=2072f485ae164798aeb2bd88ccb94353, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:13.461149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:13.470818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:13.479658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:13.548790 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1187/2369] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:13 2022] PUT /identity/v3/projects/fd00d2e28e94468d981f534711b8009a/users/2072f485ae164798aeb2bd88ccb94353/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:13.550457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:13.634463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a863c9-a233-4223-a1f8-325d6d77b908 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:13.689516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:13.774602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a16f-3c4e-4463-bce9-63c3e6067ea1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:13.797376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:13.800814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:13.802517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:13.804505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:13.848764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:13.848764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:13.848764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:13.848764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:13.915296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:13.916936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:13.934177 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1188/2370] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:13.935865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:14.043092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:14.044773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:14.056102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1183/2371] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:13 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:14.069698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a1ad-3659-46da-b5bc-3a148eed68cc service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:14.077773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4615de-e30c-4e36-9ffc-6bf8c5487b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:14.077773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4615de-e30c-4e36-9ffc-6bf8c5487b9e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.077773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4615de-e30c-4e36-9ffc-6bf8c5487b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.080793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4615de-e30c-4e36-9ffc-6bf8c5487b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.080793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4615de-e30c-4e36-9ffc-6bf8c5487b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:14.080793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4615de-e30c-4e36-9ffc-6bf8c5487b9e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:14.092503 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1189/2372] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:14.098324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:14.113473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8237d-bdef-481f-95fa-fa5c199339a4 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:14.119552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:14.120459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.124429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.124429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] PATH_INFO: `/v3/projects/fd00d2e28e94468d981f534711b8009a/users/2072f485ae164798aeb2bd88ccb94353/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.124429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd00d2e28e94468d981f534711b8009a, user_id=2072f485ae164798aeb2bd88ccb94353, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:14.125817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:14.138170 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1184/2373] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:14 2022] PUT /identity/v3/projects/fd00d2e28e94468d981f534711b8009a/users/2072f485ae164798aeb2bd88ccb94353/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:14.158919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.159399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.160197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.209488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] MFA Rules not processed for user `2072f485ae164798aeb2bd88ccb94353`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:14.210867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:14.311082 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1190/2374] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:14.502473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:14.550162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:14.641636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7979e5f-f7ef-43f9-9e86-4587c608df3d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:14.647532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:14.648330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.648587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.649009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.650946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:14.721266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:14.722959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b229803-fe1a-44f6-b621-5eb7add0fd30 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:14.742557 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1185/2375] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:14 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:14.766690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:14.780697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a57-4be4-46b9-a6d0-e8cbba3df4ec None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:14.786648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:14.787258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.787400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.787677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.798900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:14.801157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:14.828740 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1191/2376] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:14.836994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d466402-c4ee-4dbf-8124-8c4324c1bc4b None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.837635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d466402-c4ee-4dbf-8124-8c4324c1bc4b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.838089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d466402-c4ee-4dbf-8124-8c4324c1bc4b None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.839715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1186/2377] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:14.845308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:14.857084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:14.869960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8baf-23d5-4007-8252-244db7bbc591 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:14.878883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d988b6-8164-4d5d-b19a-caf2a8cc6246 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:14.879958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d988b6-8164-4d5d-b19a-caf2a8cc6246 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:14.880433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d988b6-8164-4d5d-b19a-caf2a8cc6246 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:14.880890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d988b6-8164-4d5d-b19a-caf2a8cc6246 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:14.883107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d988b6-8164-4d5d-b19a-caf2a8cc6246 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:14.887826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d988b6-8164-4d5d-b19a-caf2a8cc6246 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:14.892350 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1192/2378] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:14 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:14.931269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d466402-c4ee-4dbf-8124-8c4324c1bc4b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:15.038414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e0b1-9d20-4d36-8de7-dd62222d2943 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.039018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e0b1-9d20-4d36-8de7-dd62222d2943 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.039611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e0b1-9d20-4d36-8de7-dd62222d2943 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:15.041819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1193/2379] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:15.049727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e0b1-9d20-4d36-8de7-dd62222d2943 None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:15.087559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e0b1-9d20-4d36-8de7-dd62222d2943 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:15.088259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d466402-c4ee-4dbf-8124-8c4324c1bc4b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:15.108021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:15.110594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.112250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.112581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] PATH_INFO: `/v3/users/d27b5e8a66004718aff2474ffcf4a502` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:15.116165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e0b1-9d20-4d36-8de7-dd62222d2943 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:15.127294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27b5e8a66004718aff2474ffcf4a502)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:15.131742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0e1e5-97dd-47e7-a1be-807803c95846 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:15.132576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0e1e5-97dd-47e7-a1be-807803c95846 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.132932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0e1e5-97dd-47e7-a1be-807803c95846 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.133279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0e1e5-97dd-47e7-a1be-807803c95846 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:15.133454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:15.134872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0e1e5-97dd-47e7-a1be-807803c95846 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:15.137165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0e1e5-97dd-47e7-a1be-807803c95846 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:15.152575 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1194/2380] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:15 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:15.155492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b5b8-a455-4c25-9565-6cbedd150647 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.156981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b5b8-a455-4c25-9565-6cbedd150647 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.158186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b5b8-a455-4c25-9565-6cbedd150647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:15.229079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-15e1b5b8-a455-4c25-9565-6cbedd150647 None None] MFA Rules not processed for user `4b3c25a68fad4670ba65ce93dd19f9be`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:15.232432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-15e1b5b8-a455-4c25-9565-6cbedd150647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:15.347429 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1195/2381] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:15.415182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41e58-3c45-4c2a-ae61-804a43b3916d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.416664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41e58-3c45-4c2a-ae61-804a43b3916d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.417164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41e58-3c45-4c2a-ae61-804a43b3916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:15.461030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a1c41e58-3c45-4c2a-ae61-804a43b3916d None None] MFA Rules not processed for user `6be4c811a7b844ccaec3ce70ca03584c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:15.463886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1c41e58-3c45-4c2a-ae61-804a43b3916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:15.471410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27b5e8a66004718aff2474ffcf4a502'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:15.505739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27b5e8a66004718aff2474ffcf4a502'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:15.536261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27b5e8a66004718aff2474ffcf4a502'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:15.538285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27b5e8a66004718aff2474ffcf4a502'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:15.538446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27b5e8a66004718aff2474ffcf4a502'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:15.558901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:15.633622 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1196/2382] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:15.648229 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1187/2383] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:14 2022] DELETE /identity/v3/users/d27b5e8a66004718aff2474ffcf4a502 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:15.663527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.663813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.664307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:15.702414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:15.703676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:15.838420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1197/2384] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:15.864503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:15.866242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:15.979678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840fee2-2429-444a-b40d-7e42eb32fc51 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:15.988912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:15.990594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:15.990594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:15.990851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:16.006147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:16.008201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:16.053362 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1188/2385] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:16.138313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:16.145761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:16.164249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:16.281978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9112-c32c-4e93-a7eb-66b39845dbbe None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:16.293228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:16.294061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:16.294389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:16.294711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:16.297177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:16.416085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:16.418295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7fc8e-6d30-4162-8c78-88e36cbc70ad service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:16.436483 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1198/2386] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:16.764408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:17.145338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:17.547505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:17.913768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:17.916245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:17.958244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242b07-f4fc-45f0-b657-97030ff9d9d6 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:17.967884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:17.970550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:17.970550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:17.970550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] PATH_INFO: `/v3/projects/f85e318103684eda871538b0cdcffca7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:17.972076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85e318103684eda871538b0cdcffca7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:17.974910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:18.017813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:18.019467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:18.019759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:18.020042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:18.022149 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1199/2387] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:18.041742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:18.046597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:18.096273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:18.098729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:18.185904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85e318103684eda871538b0cdcffca7', 'request_id': 'req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.187767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:18.199909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85e318103684eda871538b0cdcffca7', 'request_id': 'req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.219004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85e318103684eda871538b0cdcffca7', 'request_id': 'req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.312991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] The token cache is being invalidate because project f85e318103684eda871538b0cdcffca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:18.312991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.312991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.313628 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1189/2388] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:17 2022] DELETE /identity/v3/projects/f85e318103684eda871538b0cdcffca7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:18.316681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:18.321241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:18.333331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf7851-3931-4682-9a24-0f4b1e876157 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:18.505178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ade2c-4a17-4b60-af9d-d8b124b744c1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:18.505178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ade2c-4a17-4b60-af9d-d8b124b744c1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:18.505178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ade2c-4a17-4b60-af9d-d8b124b744c1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:18.505551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ade2c-4a17-4b60-af9d-d8b124b744c1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:18.508131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ade2c-4a17-4b60-af9d-d8b124b744c1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:18.513773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ade2c-4a17-4b60-af9d-d8b124b744c1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:18.518506 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1200/2389] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:18 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:54:18.538281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb0bc-5701-4cd4-b3e0-09b1c6c2c29a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:18.544875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:18.545657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:18.546187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:18.547347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] PATH_INFO: `/v3/users/48316f9379dd43a884f9c594a9dc070b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:18.548639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48316f9379dd43a884f9c594a9dc070b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:18.551211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:18.826013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48316f9379dd43a884f9c594a9dc070b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.912636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48316f9379dd43a884f9c594a9dc070b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.922813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48316f9379dd43a884f9c594a9dc070b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.923835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48316f9379dd43a884f9c594a9dc070b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.925567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48316f9379dd43a884f9c594a9dc070b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:18.974908 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1190/2390] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:18 2022] DELETE /identity/v3/users/48316f9379dd43a884f9c594a9dc070b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:19.164313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:19.170117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f6577-6d92-4ab2-94a7-6e331c0b7238 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:19.170648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f6577-6d92-4ab2-94a7-6e331c0b7238 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:19.170648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f6577-6d92-4ab2-94a7-6e331c0b7238 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:19.172559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1201/2391] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:19.180982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:19.182718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:19.353813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:19.359369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:19.498217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78023a-2fdc-4fc4-8578-e153b04ab856 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:19.505049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:19.505740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:19.506013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:19.506384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:19.507484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:19.509884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:19.511660 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1191/2392] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:19 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:19.986822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a738228-09d1-4a2e-b7fe-746e6d505615 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:19.987108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a738228-09d1-4a2e-b7fe-746e6d505615 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:19.987414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a738228-09d1-4a2e-b7fe-746e6d505615 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:19.989190 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1202/2393] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:19.997674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:20.028271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:20.051638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406fcff-ac98-4b93-ae2b-5fcd70871e47 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:20.055489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:20.085375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370181-1361-49ea-aff1-c85a976a5ee1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:20.086573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370181-1361-49ea-aff1-c85a976a5ee1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:20.087085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370181-1361-49ea-aff1-c85a976a5ee1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:20.087562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370181-1361-49ea-aff1-c85a976a5ee1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:20.090750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae370181-1361-49ea-aff1-c85a976a5ee1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:20.095195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae370181-1361-49ea-aff1-c85a976a5ee1 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:20.112325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1192/2394] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:19 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:20.284685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a738228-09d1-4a2e-b7fe-746e6d505615 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:20.287090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3a738228-09d1-4a2e-b7fe-746e6d505615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:20.363489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894f8b-9f92-49ef-8b33-d5a18c0b3a34 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:20.363489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894f8b-9f92-49ef-8b33-d5a18c0b3a34 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:20.363489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894f8b-9f92-49ef-8b33-d5a18c0b3a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:20.403859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-65894f8b-9f92-49ef-8b33-d5a18c0b3a34 None None] MFA Rules not processed for user `6be4c811a7b844ccaec3ce70ca03584c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:20.407259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-65894f8b-9f92-49ef-8b33-d5a18c0b3a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:20.490331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a738228-09d1-4a2e-b7fe-746e6d505615 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:20.503800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:20.505153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:20.505674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:20.509444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] PATH_INFO: `/v3/projects/b07d48e648744765922ac490740502c5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:20.513728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07d48e648744765922ac490740502c5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:20.516344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:20.573324 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1193/2395] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:20.576462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3ec81-294a-424b-83ac-3c750cdc2a2f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:20.579580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3ec81-294a-424b-83ac-3c750cdc2a2f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:20.581545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3ec81-294a-424b-83ac-3c750cdc2a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:20.642723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e4c3ec81-294a-424b-83ac-3c750cdc2a2f None None] MFA Rules not processed for user `9dc9a684b2ce4262b578fe9364385bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:20.644584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e4c3ec81-294a-424b-83ac-3c750cdc2a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:20.811857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07d48e648744765922ac490740502c5', 'request_id': 'req-564f89b1-0a51-48a4-badc-5d6e72b6b115'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:20.830414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07d48e648744765922ac490740502c5', 'request_id': 'req-564f89b1-0a51-48a4-badc-5d6e72b6b115'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:20.851425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07d48e648744765922ac490740502c5', 'request_id': 'req-564f89b1-0a51-48a4-badc-5d6e72b6b115'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:20.862353 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1194/2396] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:20.958842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] The token cache is being invalidate because project b07d48e648744765922ac490740502c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:20.961466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:20.962074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-564f89b1-0a51-48a4-badc-5d6e72b6b115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:20.965654 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1203/2397] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:20 2022] DELETE /identity/v3/projects/b07d48e648744765922ac490740502c5 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:20.970631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:20.971178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:20.971636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:20.995413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:20.997013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:21.009405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:21.097374 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1195/2398] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:21.105348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.105885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.106290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.130929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:21.132577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:21.149762 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1204/2399] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:21.156568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:21.165459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2cdb8-e83f-4425-827b-535d72af35ff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:21.170864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:21.171564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.171564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.171564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.171564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:21.171564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:21.171564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b54bd-ec54-4ad1-88bf-99bc1e3fe30f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:21.187929 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1196/2400] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:21.205283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:21.215577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f88072-052a-4d9d-9528-d1d90c544f2b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:21.220395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:21.221007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.221274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.221542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.222209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:21.224101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:21.287660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.288057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.288557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.325339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] MFA Rules not processed for user `d0becfb3ce834310802d5a152e7de5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:21.327732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:21.381050 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1205/2401] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:21 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:21.385593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:21.409222 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1197/2402] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:21.476185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5988cd-0d98-4383-b260-d46595771a5c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:21.485688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:21.486530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.486813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.487094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.488481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:21.502104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:21.607723 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1206/2403] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:21 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:21.611916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:21.640953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79aad8-0164-478d-ac6a-9fc34c8153bb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:21.675651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:21.676643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.677074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.678794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.679706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:21.681653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:21.702954 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1198/2404] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:21.705777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:21.720344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa08a5-798b-47e7-a837-30897f88226b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:21.727952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01802-aa65-45ce-9946-3a2b74dd55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:21.728635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01802-aa65-45ce-9946-3a2b74dd55f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.729134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01802-aa65-45ce-9946-3a2b74dd55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.730718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01802-aa65-45ce-9946-3a2b74dd55f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.731574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01802-aa65-45ce-9946-3a2b74dd55f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:21.733388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01802-aa65-45ce-9946-3a2b74dd55f4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:21.764768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:21.775272 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1207/2405] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:21.782208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c972d-d7cc-4850-b4fd-0ce369296f29 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:21.794821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2663c-b2e1-4a90-bdb3-0265e6a465d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:21.795726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2663c-b2e1-4a90-bdb3-0265e6a465d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.796053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2663c-b2e1-4a90-bdb3-0265e6a465d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.796512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2663c-b2e1-4a90-bdb3-0265e6a465d6 admin admin] PATH_INFO: `/v3/projects/d2f2cf16e3964ce2b5b0491468a3b159/users/214b5ab49764481c98a048528f3d2f9b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.846568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2663c-b2e1-4a90-bdb3-0265e6a465d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f2cf16e3964ce2b5b0491468a3b159, user_id=214b5ab49764481c98a048528f3d2f9b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:21.854171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2663c-b2e1-4a90-bdb3-0265e6a465d6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:21.859632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:21.860879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:21.861460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:21.863319 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1208/2406] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:54:21.876048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:21.878261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:22.004103 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1199/2407] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:21 2022] PUT /identity/v3/projects/d2f2cf16e3964ce2b5b0491468a3b159/users/214b5ab49764481c98a048528f3d2f9b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:22.006771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:22.007399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:22.007672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:22.027649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:22.028311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:22.042491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:22.044924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:22.122780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:22.155705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836d3f0-5193-49af-b0da-d6a08e6da8f0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:22.158437 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1200/2408] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:22.176035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:22.194246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:22.324430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7674-59f7-47ac-83de-e0fa5c54a867 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:22.325368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7674-59f7-47ac-83de-e0fa5c54a867 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:22.325796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7674-59f7-47ac-83de-e0fa5c54a867 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:22.326255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7674-59f7-47ac-83de-e0fa5c54a867 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:22.329062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7674-59f7-47ac-83de-e0fa5c54a867 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:22.330879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d93bb-4607-4237-aadc-6a7b9e24a9c6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:22.346617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7674-59f7-47ac-83de-e0fa5c54a867 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:22.348669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:22.349321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:22.349603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:22.349916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:22.361279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1209/2409] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:21 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:22.388239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:22.392484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:22.439174 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1201/2410] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:54:22.581303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:23.266703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557dd3d-0479-4211-a05b-c10fa822243d None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:23.267792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557dd3d-0479-4211-a05b-c10fa822243d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:23.268440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557dd3d-0479-4211-a05b-c10fa822243d None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:23.270352 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1210/2411] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:23.286340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:23.447885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:23.466764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d814dc-ecc0-4f20-bf44-bf8a58a597ec service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:23.474189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:23.475068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:23.476913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:23.477564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:23.479463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:23.486172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:23.490280 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1202/2412] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:23 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:23.570540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:23.622491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bdf35-70da-4a11-8cbe-4306fafc9a39 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:23.623103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bdf35-70da-4a11-8cbe-4306fafc9a39 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:23.623610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bdf35-70da-4a11-8cbe-4306fafc9a39 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:23.628360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1211/2413] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:23.630748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:23.632937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:23.657439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:23.670713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46b3fe-597a-46fd-aa28-c8d7be0f5ed5 tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:23.677219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daa1e1-5da5-49ab-84d7-ac1148684f7e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:23.677911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daa1e1-5da5-49ab-84d7-ac1148684f7e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:23.678205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daa1e1-5da5-49ab-84d7-ac1148684f7e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:23.678483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daa1e1-5da5-49ab-84d7-ac1148684f7e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:23.680224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daa1e1-5da5-49ab-84d7-ac1148684f7e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:23.684694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daa1e1-5da5-49ab-84d7-ac1148684f7e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:23.691774 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1203/2414] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:23 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:23.900642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ee1cb-ce1b-4c3a-b518-86231a386f3a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:23.901533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ee1cb-ce1b-4c3a-b518-86231a386f3a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:23.901817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ee1cb-ce1b-4c3a-b518-86231a386f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:23.941264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d52ee1cb-ce1b-4c3a-b518-86231a386f3a None None] MFA Rules not processed for user `6be4c811a7b844ccaec3ce70ca03584c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:23.942598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d52ee1cb-ce1b-4c3a-b518-86231a386f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:24.022015 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1212/2415] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:24.154435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:24.628994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efefd51-c728-45a4-bfbd-38b6aad6a320 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:24.630333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efefd51-c728-45a4-bfbd-38b6aad6a320 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:24.630720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efefd51-c728-45a4-bfbd-38b6aad6a320 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:24.632596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1204/2416] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:24.663383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d6f4-201b-4dbe-9486-7cf7c3ab83ff None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:24.665450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d6f4-201b-4dbe-9486-7cf7c3ab83ff None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:24.665989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d6f4-201b-4dbe-9486-7cf7c3ab83ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:24.727974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1656d6f4-201b-4dbe-9486-7cf7c3ab83ff None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:24.730146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1656d6f4-201b-4dbe-9486-7cf7c3ab83ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:24.886835 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1213/2417] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:54:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:24.918935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efefd51-c728-45a4-bfbd-38b6aad6a320 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:24.921595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2efefd51-c728-45a4-bfbd-38b6aad6a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:24.946341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efefd51-c728-45a4-bfbd-38b6aad6a320 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:24.953322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:24.954311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:24.954931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:24.955392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:24.973028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:24.975972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:24.990354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1205/2418] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:25.124542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:25.656006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:25.732485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1a64-d80e-40c7-bbb2-3321baad36b4 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:25.733812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1a64-d80e-40c7-bbb2-3321baad36b4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:25.741590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1a64-d80e-40c7-bbb2-3321baad36b4 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:25.741590 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1214/2419] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:54:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:54:25.743631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:54:25.767824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:25.811388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4405c-59b3-40ea-b3d2-525cb23a7001 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:25.838107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2072f485ae164798aeb2bd88ccb94353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd00d2e28e94468d981f534711b8009a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:25.838810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:25.839086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:25.840102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:25.843190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorizing `identity:get_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:25.845712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:25.850859 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1206/2420] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:54:25 2022] GET /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 383 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:26.253158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1a64-d80e-40c7-bbb2-3321baad36b4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:26.254409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-136d1a64-d80e-40c7-bbb2-3321baad36b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:26.295524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1a64-d80e-40c7-bbb2-3321baad36b4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:26.318378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:26.319948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:26.331841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:26.332754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:26.333344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:26.333830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] PATH_INFO: `/v3/users/8a5918f7fd3d48b8b0be9ee6715e53d0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:26.338719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5918f7fd3d48b8b0be9ee6715e53d0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:26.343697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426a4e1-b808-49f2-a14e-861b9f96a69e tempest-QuotasAdminNegativeTest-1581135621 tempest-QuotasAdminNegativeTest-1581135621-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:26.343921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:26.352696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:26.374713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:26.375264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:26.376161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] PATH_INFO: `/v3/users/6be4c811a7b844ccaec3ce70ca03584c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:26.380651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be4c811a7b844ccaec3ce70ca03584c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:26.385568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:26.628993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5918f7fd3d48b8b0be9ee6715e53d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.632798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5918f7fd3d48b8b0be9ee6715e53d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.660278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be4c811a7b844ccaec3ce70ca03584c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.682241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be4c811a7b844ccaec3ce70ca03584c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.691314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be4c811a7b844ccaec3ce70ca03584c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.692393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be4c811a7b844ccaec3ce70ca03584c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.693292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-940f452b-8338-49f7-a78a-12144d722cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be4c811a7b844ccaec3ce70ca03584c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.751949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5918f7fd3d48b8b0be9ee6715e53d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.760513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5918f7fd3d48b8b0be9ee6715e53d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.763995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dc341a54-de2d-4e00-8180-1600aa23119e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5918f7fd3d48b8b0be9ee6715e53d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:26.789285 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1215/2421] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:26 2022] DELETE /identity/v3/users/8a5918f7fd3d48b8b0be9ee6715e53d0 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:26.825214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:26.825506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:26.827041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:26.878746 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1207/2422] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:26 2022] DELETE /identity/v3/users/6be4c811a7b844ccaec3ce70ca03584c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:26.881230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:26.881926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:26.882371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:26.912981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:26.914742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:26.969670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:26.970985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:27.026127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1216/2423] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:27.078043 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1208/2424] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:27.102449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:27.112472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:27.114455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:27.129681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:27.131627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:27.208343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a9399-df63-4b84-aef8-8168d739763d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:27.212503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:27.213259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:27.213538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:27.213805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:27.227062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:27.228531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:27.232915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecbc9d-b874-467f-a0ad-0765b2c4ad7e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:27.242438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9821b7-11a3-4a0d-a6c8-db5bf5b8b187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:27.243583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9821b7-11a3-4a0d-a6c8-db5bf5b8b187 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:27.243583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9821b7-11a3-4a0d-a6c8-db5bf5b8b187 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:27.250484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9821b7-11a3-4a0d-a6c8-db5bf5b8b187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:27.251594 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1217/2425] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:27.257726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9821b7-11a3-4a0d-a6c8-db5bf5b8b187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:27.259924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9821b7-11a3-4a0d-a6c8-db5bf5b8b187 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:27.274230 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1209/2426] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:54:27.519731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:28.773258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:28.783524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:28.807291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63fc92-0854-4b4d-9c93-afd866d0a899 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:28.819399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:28.820590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:28.821507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:28.823748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] PATH_INFO: `/v3/projects/66b6b50b43864bc8aba09932cb8a4589` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:28.825373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b6b50b43864bc8aba09932cb8a4589)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:28.831699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:29.009463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b6b50b43864bc8aba09932cb8a4589', 'request_id': 'req-4449d072-55a1-4537-a05c-21139115d5b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.020076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b6b50b43864bc8aba09932cb8a4589', 'request_id': 'req-4449d072-55a1-4537-a05c-21139115d5b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.032339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b6b50b43864bc8aba09932cb8a4589', 'request_id': 'req-4449d072-55a1-4537-a05c-21139115d5b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.150503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:29.157067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] The token cache is being invalidate because project 66b6b50b43864bc8aba09932cb8a4589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:29.157290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.158445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4449d072-55a1-4537-a05c-21139115d5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.164708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1218/2427] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:28 2022] DELETE /identity/v3/projects/66b6b50b43864bc8aba09932cb8a4589 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:29.166724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:29.167290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:29.167859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:29.202718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:29.204263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:29.296880 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1210/2428] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:29.299381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:29.300599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:29.301433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:29.308712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:29.341438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:29.342910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:29.353983 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1219/2429] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:29.359726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:29.371362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c485b9a-f119-4536-965a-ea8d998301e5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:29.381402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:29.382372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:29.382761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:29.386532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:29.386532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:29.386532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:29.387027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:29.403568 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1211/2430] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:29.412768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:29.429207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b9e7-8409-44bd-9744-91290decd154 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:29.462730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:29.480432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:29.483579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:29.489839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:29.489839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:29.498464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:29.554881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:29.556453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:29.570387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055d1a-57fc-4af8-87f6-3ba701a12142 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:29.577251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:29.577982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:29.578612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:29.578612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] PATH_INFO: `/v3/projects/b642faa8bc55428a9fbf3674c786de5d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:29.580035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b642faa8bc55428a9fbf3674c786de5d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:29.583472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:29.641587 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1220/2431] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:29 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:29.647985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:29.763370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a0e1-726e-45b2-87e9-1ee20d1edd22 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:29.772810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:29.773876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:29.775085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:29.775565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:29.776681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:29.779889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:29.795209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b642faa8bc55428a9fbf3674c786de5d', 'request_id': 'req-d86639fe-dfb9-4903-9392-3196587fe47e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.808398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b642faa8bc55428a9fbf3674c786de5d', 'request_id': 'req-d86639fe-dfb9-4903-9392-3196587fe47e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.822212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b642faa8bc55428a9fbf3674c786de5d', 'request_id': 'req-d86639fe-dfb9-4903-9392-3196587fe47e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.931258 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1221/2432] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:29 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:29.935742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:29.939613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] The token cache is being invalidate because project b642faa8bc55428a9fbf3674c786de5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:29.939917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.940645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:29.942765 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1212/2433] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:29 2022] DELETE /identity/v3/projects/b642faa8bc55428a9fbf3674c786de5d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:29.946991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:29.949314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:29.952719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b8b14-6934-4f08-984a-e433dd178a17 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:30.077639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86639fe-dfb9-4903-9392-3196587fe47e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:30.080391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:30.080589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:30.080832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:30.081705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:30.082385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:30.085282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:30.093625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:30.099801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:30.099801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:30.099801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] PATH_INFO: `/v3/users/2072f485ae164798aeb2bd88ccb94353` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:30.099801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2072f485ae164798aeb2bd88ccb94353)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:30.100173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:30.111772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1222/2434] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:30.113455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:30.122906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:30.150703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e173-82d4-4b9f-9a99-4836e804338e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:30.158522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:30.159152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:30.160911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:30.160911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:30.160911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:30.162039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:30.178466 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1223/2435] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:30.180436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:30.192271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f1ad7-f55b-4a63-9847-d9e9e5cbe56c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:30.201636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb521f8-df74-4163-9096-e035f22cad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:30.203658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb521f8-df74-4163-9096-e035f22cad5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:30.204247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb521f8-df74-4163-9096-e035f22cad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:30.204920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb521f8-df74-4163-9096-e035f22cad5e admin admin] PATH_INFO: `/v3/projects/588cc0e260004612aa4b05afe7a88ccc/users/1f6910ac1bd743a0b1791d8f92f5a427/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:30.237829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb521f8-df74-4163-9096-e035f22cad5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=588cc0e260004612aa4b05afe7a88ccc, user_id=1f6910ac1bd743a0b1791d8f92f5a427, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:30.242458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb521f8-df74-4163-9096-e035f22cad5e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:30.282033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:30.380754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2072f485ae164798aeb2bd88ccb94353'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:30.416643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2072f485ae164798aeb2bd88ccb94353'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:30.435323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2072f485ae164798aeb2bd88ccb94353'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:30.437146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2072f485ae164798aeb2bd88ccb94353'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:30.438251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2072f485ae164798aeb2bd88ccb94353'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:30.469340 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1224/2436] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:30 2022] PUT /identity/v3/projects/588cc0e260004612aa4b05afe7a88ccc/users/1f6910ac1bd743a0b1791d8f92f5a427/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:30.489306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:30.489713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:30.490111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:30.551821 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1213/2437] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:29 2022] DELETE /identity/v3/users/2072f485ae164798aeb2bd88ccb94353 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:30.578931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:30.615914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] MFA Rules not processed for user `1f6910ac1bd743a0b1791d8f92f5a427`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:30.626808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:30.760345 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1225/2438] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:30.856396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:30.906712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:30.908832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:31.006303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb07bf-b988-47a8-942a-921a8ee32f44 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:31.024700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:31.025412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:31.025690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:31.026237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:31.039363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:31.041173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:31.053706 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1214/2439] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:31.148579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:31.151200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:31.250880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d287-fa4b-45b7-b580-262f283e0fac None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:31.257398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:31.258565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:31.258800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:31.259091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] PATH_INFO: `/v3/users/1f6910ac1bd743a0b1791d8f92f5a427` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:31.260484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6910ac1bd743a0b1791d8f92f5a427)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:31.263903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:31.626164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6910ac1bd743a0b1791d8f92f5a427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:31.627548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6910ac1bd743a0b1791d8f92f5a427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:31.648297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:31.649704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:31.690870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9108-3ed6-439a-9331-f42488f45eb0 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:31.710409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:31.711668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:31.715265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:31.715627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] PATH_INFO: `/v3/projects/fd00d2e28e94468d981f534711b8009a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:31.720013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd00d2e28e94468d981f534711b8009a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:31.722112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:31.729203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6910ac1bd743a0b1791d8f92f5a427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:31.743560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6910ac1bd743a0b1791d8f92f5a427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:31.743560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ae8085f7-de1f-4575-9448-5b014211cb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6910ac1bd743a0b1791d8f92f5a427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:31.805868 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1226/2440] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:31 2022] DELETE /identity/v3/users/1f6910ac1bd743a0b1791d8f92f5a427 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:31.813926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b582a-82fd-4fd6-8a0b-351f910ba41d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:31.814450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b582a-82fd-4fd6-8a0b-351f910ba41d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:31.816222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b582a-82fd-4fd6-8a0b-351f910ba41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:31.914892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5d4b582a-82fd-4fd6-8a0b-351f910ba41d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:31.937263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d4b582a-82fd-4fd6-8a0b-351f910ba41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:31.973988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd00d2e28e94468d981f534711b8009a', 'request_id': 'req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:31.996248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd00d2e28e94468d981f534711b8009a', 'request_id': 'req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:32.010622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd00d2e28e94468d981f534711b8009a', 'request_id': 'req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:32.158110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] The token cache is being invalidate because project fd00d2e28e94468d981f534711b8009a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:32.158448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:32.167119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d865eb6f-c33f-4cbd-9dd2-3cfce1032d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:32.167119 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1215/2441] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:31 2022] DELETE /identity/v3/projects/fd00d2e28e94468d981f534711b8009a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:32.171874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:32.174296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:32.174607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:32.195835 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1227/2442] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:32.238983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:32.240249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:32.258162 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1216/2443] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:32.266535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:32.267128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:32.267595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:32.300995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:32.302608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:32.323298 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1228/2444] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:32.327911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:32.350388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403382c-a6bd-40d7-828f-7e1386c896de None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:32.363910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:32.380059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:32.380775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:32.381146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:32.381426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:32.382147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:32.382455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:32.384467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:32.427267 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1217/2445] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:32.435242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:32.453936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aabf07-f559-46d2-bf58-f16b42128f28 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:32.476644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:32.477275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:32.477552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:32.477821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:32.480200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:32.486410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:32.570134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:32.638241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:32.647835 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1229/2446] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:32 2022] POST /identity/v3/projects => generated 405 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:32.656583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d7d6-91e3-493d-a9ba-89fe90617cf2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:32.864744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:32.865392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:32.865676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:32.865982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:32.866816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:32.871763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:32.978970 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1218/2447] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:32 2022] POST /identity/v3/users => generated 303 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:32.981119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:33.001678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a47b0-e4ed-429d-b98b-0dad744aec54 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:33.018795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:33.019581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.020174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.020701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.022040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:33.030537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:33.066570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1230/2448] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:33.070466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:33.092943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddbe9-a9bf-48d9-9a6d-385e0c00d8a9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:33.106751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:33.108644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:33.110190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:33.110816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.111097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.111368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.112039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:33.114214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:33.145411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1219/2449] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:33.149749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:33.170893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da9936-aa9f-41a1-81cb-6e24a83a10ff admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:33.190369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c91360-829f-4d04-ac0a-1c99e86ba509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:33.191076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91360-829f-4d04-ac0a-1c99e86ba509 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.191538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91360-829f-4d04-ac0a-1c99e86ba509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.191813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91360-829f-4d04-ac0a-1c99e86ba509 admin admin] PATH_INFO: `/v3/projects/2a8fa8d2c95d4852b7f5c22a3879b2d2/users/6044f040839f4bc3b5f232275fc68759/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.226782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c91360-829f-4d04-ac0a-1c99e86ba509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8fa8d2c95d4852b7f5c22a3879b2d2, user_id=6044f040839f4bc3b5f232275fc68759, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:33.235949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c91360-829f-4d04-ac0a-1c99e86ba509 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:33.300014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523b0f9-c99c-4686-94d6-7892d7933652 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:33.317348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:33.318310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.318807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.321784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.332636 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1220/2450] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:33 2022] PUT /identity/v3/projects/2a8fa8d2c95d4852b7f5c22a3879b2d2/users/6044f040839f4bc3b5f232275fc68759/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:33.343642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a36b-060e-4239-8083-15a4f30ee98e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.344037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a36b-060e-4239-8083-15a4f30ee98e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.344416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a36b-060e-4239-8083-15a4f30ee98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.353714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:33.355290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:33.380240 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1231/2451] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:33.442587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-53d4a36b-060e-4239-8083-15a4f30ee98e None None] MFA Rules not processed for user `6044f040839f4bc3b5f232275fc68759`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:33.444059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-53d4a36b-060e-4239-8083-15a4f30ee98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:33.553425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:33.600997 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1221/2452] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:33.605127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:33.619811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4df5d9-719a-4489-8c71-db660249424e service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:33.727037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.727595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:33.728046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.728402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:33.739501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.739662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:33.739662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:33.739662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:33.739662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:33.753427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] MFA Rules not processed for user `122174705b7e43ac8f85a8b0160cd693`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:33.755155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:33.840029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1232/2453] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:33 2022] POST /identity/v3/projects => generated 409 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:33.843795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:33.982953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b23c1-472a-439b-b4e7-7698b537d7ba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:33.992095 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1222/2454] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:33.995857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:33.996680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.003400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.003697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.004396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:34.014961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:34.127370 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1233/2455] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:33 2022] POST /identity/v3/users => generated 311 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:34.131053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:34.156115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889b387-b047-4c01-b3ad-acb3953cc30b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:34.165327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:34.166109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.166396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.166670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.167531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:34.169228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:34.186674 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1223/2456] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:34.192048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:34.204142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:34.208937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfcddf-22d1-49d9-b1d2-18aa86b08d0e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:34.222493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dc306-3213-48e2-ad79-96f34d2e245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:34.223483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc306-3213-48e2-ad79-96f34d2e245d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.223969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc306-3213-48e2-ad79-96f34d2e245d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.224447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc306-3213-48e2-ad79-96f34d2e245d admin admin] PATH_INFO: `/v3/projects/0af78d1505fd4168bda03cca2cec3154/users/5b00981c43294b3cb66bdb315ae955cf/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.260525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dc306-3213-48e2-ad79-96f34d2e245d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af78d1505fd4168bda03cca2cec3154, user_id=5b00981c43294b3cb66bdb315ae955cf, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:34.265705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dc306-3213-48e2-ad79-96f34d2e245d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:34.353367 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1234/2457] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:34 2022] PUT /identity/v3/projects/0af78d1505fd4168bda03cca2cec3154/users/5b00981c43294b3cb66bdb315ae955cf/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:34.355069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:34.375243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6379c-35f5-4bad-a51e-849a3718d203 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:34.400338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.400338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.400338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.463021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:34.521572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] MFA Rules not processed for user `214b5ab49764481c98a048528f3d2f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:34.521572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:34.584248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:34.913390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.913390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.913390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.913390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:34.913390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:34.913390 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1224/2458] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:34.915039 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1235/2459] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:34.916160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:34.918218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:34.918736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:34.929510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb06eb-4c9a-486d-b37d-35a408059117 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:34.942400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85ac2e-e768-41a6-b9d3-d5452b9900b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:34.942400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ac2e-e768-41a6-b9d3-d5452b9900b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.942400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ac2e-e768-41a6-b9d3-d5452b9900b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.942400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ac2e-e768-41a6-b9d3-d5452b9900b1 admin admin] PATH_INFO: `/v3/projects/0af78d1505fd4168bda03cca2cec3154/users/5b00981c43294b3cb66bdb315ae955cf/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.942719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64471787-d872-4f13-aca9-9aaf4ec0a369 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:34.946787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85ac2e-e768-41a6-b9d3-d5452b9900b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af78d1505fd4168bda03cca2cec3154, user_id=5b00981c43294b3cb66bdb315ae955cf, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:34.953961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85ac2e-e768-41a6-b9d3-d5452b9900b1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:34.958933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:34.959600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:34.959942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:34.960303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:34.961273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:34.963866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:34.993477 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1236/2460] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:34 2022] PUT /identity/v3/projects/0af78d1505fd4168bda03cca2cec3154/users/5b00981c43294b3cb66bdb315ae955cf/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:34.996662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:35.001560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:35.062621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:35.062621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] MFA Rules not processed for user `5b00981c43294b3cb66bdb315ae955cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:35.062621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:35.290359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1237/2461] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:35.291709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:35.304680 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1225/2462] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:34 2022] POST /identity/v3/projects => generated 371 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:35.309545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:35.439126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a569-6f2e-491e-b90a-6dd332a174d4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:35.529963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f677fb6-cc54-4e78-8b1f-51d10b834620 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:35.559576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:35.560523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:35.560970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:35.561389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:35.562270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:35.576603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:35.665469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:35.666258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:35.666585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:35.667783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] PATH_INFO: `/v3/users/6044f040839f4bc3b5f232275fc68759` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:35.669318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6044f040839f4bc3b5f232275fc68759)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:35.674698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:35.703508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1226/2463] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:35 2022] POST /identity/v3/users => generated 292 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:35.711510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:35.726454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b9bd-5c75-4f59-b09f-05790645ea93 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:35.739150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:35.740085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:35.740475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:35.740688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:35.741360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:35.743218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:35.758014 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1227/2464] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:35.763038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:35.778611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d68169-a590-4b34-bdc1-193a1a66259f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:35.784464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:35.785126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:35.785419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:35.785688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] PATH_INFO: `/v3/projects/a8c97f23d4ce41cc8388998c408c366f/users/92fc473ae07540adbc11f9e31e663b55/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:35.818815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c97f23d4ce41cc8388998c408c366f, user_id=92fc473ae07540adbc11f9e31e663b55, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:35.823221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:35.883114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6044f040839f4bc3b5f232275fc68759'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:35.884027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6044f040839f4bc3b5f232275fc68759'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:35.941722 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1228/2465] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:35 2022] PUT /identity/v3/projects/a8c97f23d4ce41cc8388998c408c366f/users/92fc473ae07540adbc11f9e31e663b55/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:35.946178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:35.961546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6044f040839f4bc3b5f232275fc68759'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.004294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6044f040839f4bc3b5f232275fc68759'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.007717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6044f040839f4bc3b5f232275fc68759'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.051467 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1238/2466] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:35 2022] DELETE /identity/v3/users/6044f040839f4bc3b5f232275fc68759 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:36.055294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:36.056968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:36.149809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dafd30-5e86-471b-8786-61792da3af92 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:36.254636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17034c2-0768-482a-af5b-31107d8f7b6d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:36.261954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:36.264103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.264103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.264103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] PATH_INFO: `/v3/projects/588cc0e260004612aa4b05afe7a88ccc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.272573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588cc0e260004612aa4b05afe7a88ccc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:36.275522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:36.383975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b28184-b1a5-47bc-a8a6-ef81b89044b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:36.384898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b28184-b1a5-47bc-a8a6-ef81b89044b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.385481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b28184-b1a5-47bc-a8a6-ef81b89044b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.386015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b28184-b1a5-47bc-a8a6-ef81b89044b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.388222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:36.388725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b28184-b1a5-47bc-a8a6-ef81b89044b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:36.392370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b28184-b1a5-47bc-a8a6-ef81b89044b9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:36.423044 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1229/2467] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:36.426375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.430169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.430169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.483482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:36.484938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588cc0e260004612aa4b05afe7a88ccc', 'request_id': 'req-77e57b25-c563-44a1-a42f-fbdc24ed93f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.489535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:36.507555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588cc0e260004612aa4b05afe7a88ccc', 'request_id': 'req-77e57b25-c563-44a1-a42f-fbdc24ed93f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.528606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588cc0e260004612aa4b05afe7a88ccc', 'request_id': 'req-77e57b25-c563-44a1-a42f-fbdc24ed93f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.656604 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1230/2468] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:36.657833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:36.665034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:36.672241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] The token cache is being invalidate because project 588cc0e260004612aa4b05afe7a88ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:36.672751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.676125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e57b25-c563-44a1-a42f-fbdc24ed93f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:36.684585 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1239/2469] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:36 2022] DELETE /identity/v3/projects/588cc0e260004612aa4b05afe7a88ccc => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:36.689604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.690237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.690697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.718868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43defc-cc20-4f1b-9193-9a1deed85fe9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:36.732625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9e546-ea96-4de7-9f1e-51a0e96e7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:36.733387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9e546-ea96-4de7-9f1e-51a0e96e7aad admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.733824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9e546-ea96-4de7-9f1e-51a0e96e7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.734216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9e546-ea96-4de7-9f1e-51a0e96e7aad admin admin] PATH_INFO: `/v3/projects/a8c97f23d4ce41cc8388998c408c366f/users/92fc473ae07540adbc11f9e31e663b55/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.738403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9e546-ea96-4de7-9f1e-51a0e96e7aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c97f23d4ce41cc8388998c408c366f, user_id=92fc473ae07540adbc11f9e31e663b55, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:36.741160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:36.743198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:36.746769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9e546-ea96-4de7-9f1e-51a0e96e7aad admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:36.763887 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1240/2470] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:36.772689 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1231/2471] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:36 2022] PUT /identity/v3/projects/a8c97f23d4ce41cc8388998c408c366f/users/92fc473ae07540adbc11f9e31e663b55/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:36.774200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.774495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.774776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.774945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:36.778288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:36.824115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:36.825451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:36.874237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cf529-e737-4fe6-8e11-c0f250ae1b1b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:36.964040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:36.966255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:36.966984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:36.967960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:36.971624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:37.036351 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1232/2472] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:37.043543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:37.055687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73efb9-f97e-463a-9dfe-78ea2dbc5545 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:37.062257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:37.062892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.063174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.063450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.064281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:37.064629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.066643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.082923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1233/2473] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:54:37.091933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:37.114862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b059a-94a5-48c2-8541-2cdebc7dd937 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:37.121737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:37.122939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.123153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.124212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.125041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.127620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.133020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.134619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.146314 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1241/2474] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:37.170164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:37.249419 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1234/2475] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:37 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:37.253566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:37.266038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fae74-caae-41b0-bb0e-bf2ff757d11b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:37.409412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:37.412913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.413794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.414322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.426408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.429084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.566022 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1242/2476] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:37 2022] POST /identity/v3/users => generated 303 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:37.566837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:37.587857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3abfb-b7ed-451a-872a-9fdf31908dc7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:37.595908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:37.596829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.597198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.597666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.598646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.601493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.626794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1235/2477] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:37.627138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:37.674470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f407d0-b227-4a9a-ad2f-8097671632af admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:37.681548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f508a-e47a-4c71-ae7c-553923e5c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:37.682201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f508a-e47a-4c71-ae7c-553923e5c0fe admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.682693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f508a-e47a-4c71-ae7c-553923e5c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.683278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f508a-e47a-4c71-ae7c-553923e5c0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.684158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f508a-e47a-4c71-ae7c-553923e5c0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.686413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f508a-e47a-4c71-ae7c-553923e5c0fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.707983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:37.720273 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1243/2478] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:37.724070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3239f-c158-4961-bd7d-72c729ba49f3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:37.730078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:37.730976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.732225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.732225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] PATH_INFO: `/v3/projects/0be42bedb4074f93abad4f02e6c010bc/users/0a17e2636e7d4d72840dd07825c47aca/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.758439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be42bedb4074f93abad4f02e6c010bc, user_id=0a17e2636e7d4d72840dd07825c47aca, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:37.762267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:37.861440 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1236/2479] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:37 2022] PUT /identity/v3/projects/0be42bedb4074f93abad4f02e6c010bc/users/0a17e2636e7d4d72840dd07825c47aca/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:37.867335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:37.867872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:37.868319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:37.897948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:37.899487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:37.985565 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1244/2480] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:37.997866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:38.000115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:38.094894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765618d-2a9f-4b01-9f3a-de02ddc3b5c5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:38.111101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:38.111101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:38.111101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:38.111101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:38.111719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:38.112791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:38.124583 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1237/2481] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:38.185493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:38.187073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:38.222336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bae16-4030-4676-8e47-987d0ca6872b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:38.231409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:38.232449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:38.232947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:38.233412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] PATH_INFO: `/v3/projects/2a8fa8d2c95d4852b7f5c22a3879b2d2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:38.236779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8fa8d2c95d4852b7f5c22a3879b2d2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:38.238998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:38.307438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:38.423173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8fa8d2c95d4852b7f5c22a3879b2d2', 'request_id': 'req-251341c3-99a7-4f4b-a89a-58a283de97d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:38.431050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8fa8d2c95d4852b7f5c22a3879b2d2', 'request_id': 'req-251341c3-99a7-4f4b-a89a-58a283de97d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:38.451305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8fa8d2c95d4852b7f5c22a3879b2d2', 'request_id': 'req-251341c3-99a7-4f4b-a89a-58a283de97d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:38.554673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] The token cache is being invalidate because project 2a8fa8d2c95d4852b7f5c22a3879b2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:38.555071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:38.557192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:38.560292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1245/2482] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:38 2022] DELETE /identity/v3/projects/2a8fa8d2c95d4852b7f5c22a3879b2d2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:38.563767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:38.582279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34911-543d-442a-909f-df895d08c8b1 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:38.717624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:38.766661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:38.766661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:38.774091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:38.774590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] PATH_INFO: `/v3/users/5b00981c43294b3cb66bdb315ae955cf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:38.776084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b00981c43294b3cb66bdb315ae955cf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:38.779264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:39.047186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:39.089805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b00981c43294b3cb66bdb315ae955cf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:39.110098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b00981c43294b3cb66bdb315ae955cf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:39.124523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b00981c43294b3cb66bdb315ae955cf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:39.126547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b00981c43294b3cb66bdb315ae955cf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:39.127855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffc7a86c-09ab-4399-b8a1-bc6fdf1b53da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b00981c43294b3cb66bdb315ae955cf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:39.222203 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1238/2483] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:38 2022] DELETE /identity/v3/users/5b00981c43294b3cb66bdb315ae955cf => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:40.024394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:40.285920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:40.288235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:40.307150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251341c3-99a7-4f4b-a89a-58a283de97d7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:40.466157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:40.472255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:40.473220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:40.473713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:40.476198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] PATH_INFO: `/v3/projects/0af78d1505fd4168bda03cca2cec3154` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:40.477355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af78d1505fd4168bda03cca2cec3154)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:40.483156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:40.700037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af78d1505fd4168bda03cca2cec3154', 'request_id': 'req-0ea5d306-a20d-41ee-b827-8a4167480427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:40.716125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af78d1505fd4168bda03cca2cec3154', 'request_id': 'req-0ea5d306-a20d-41ee-b827-8a4167480427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:40.735770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af78d1505fd4168bda03cca2cec3154', 'request_id': 'req-0ea5d306-a20d-41ee-b827-8a4167480427'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:40.827560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] The token cache is being invalidate because project 0af78d1505fd4168bda03cca2cec3154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:40.827960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:40.831980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ea5d306-a20d-41ee-b827-8a4167480427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:40.834916 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1246/2484] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:40 2022] DELETE /identity/v3/projects/0af78d1505fd4168bda03cca2cec3154 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:40.843253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:40.843827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:40.844258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:40.884166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:40.892063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:41.088507 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1239/2485] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:41.102020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.102586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.103136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.139063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:41.140535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:41.162043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.180874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1247/2486] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:41.190683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674d0ad-2db9-4b79-941a-c89dd4e47adf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.207892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.210403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.211424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.212984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.214259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:41.214848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.218351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.257993 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1240/2487] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:41.263072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.277789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512f5c-d025-46b2-a633-bf5df12075fb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.299077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.299720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.300006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.300307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.306462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.310874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.359631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.363472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:41.410681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a20d6-42e8-4bdd-abb8-85add24e4518 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.430056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.431005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.431787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.432570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] PATH_INFO: `/v3/users/8181cc5465544a0fba067403ace03d38` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.435196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8181cc5465544a0fba067403ace03d38)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.436391 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1248/2488] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:41 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:41.437592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.440728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.489666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:41.641950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417953c-b48b-403a-92b8-115d81ab3693 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.659491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.662807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.662807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.662807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.662807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.668133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.689383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:41.792667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8181cc5465544a0fba067403ace03d38'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:41.831581 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1249/2489] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:41 2022] POST /identity/v3/users => generated 297 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:41.832750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.840995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8181cc5465544a0fba067403ace03d38'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:41.846497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06ca5-334c-4745-a782-92bd87e919dd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.852217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.852967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.853101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.853375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.857910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.857910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.868085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8181cc5465544a0fba067403ace03d38'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:41.869963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8181cc5465544a0fba067403ace03d38'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:41.871822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-509ff4e5-d90a-4922-8fcb-80cf4912af45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8181cc5465544a0fba067403ace03d38'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:41.872912 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1250/2490] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:41.876836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.878934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:41.898013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd2df-8fce-43d0-9acb-191c604311cb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.904112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.905101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.905595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.906155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.907462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.910454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.937613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1251/2491] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:41.945050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.963751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de150790-8460-4e4f-8459-5013118fd63f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.975565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.976697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.977135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.977567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] PATH_INFO: `/v3/projects/99d7e142612a407e82beaf28a4defb73/users/035ab796190f47bf83f0bb58daf66f21/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.990623 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1241/2492] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:41 2022] DELETE /identity/v3/users/8181cc5465544a0fba067403ace03d38 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:42.022654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d7e142612a407e82beaf28a4defb73, user_id=035ab796190f47bf83f0bb58daf66f21, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:42.028071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:42.139328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1252/2493] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:41 2022] PUT /identity/v3/projects/99d7e142612a407e82beaf28a4defb73/users/035ab796190f47bf83f0bb58daf66f21/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:42.142445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:42.142973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:42.143457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:42.233723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] MFA Rules not processed for user `035ab796190f47bf83f0bb58daf66f21`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:42.236361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:42.390130 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1242/2494] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:42.391822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:42.541627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7be25-3bd0-41b6-bd97-91000a12215a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:42.555576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:42.557046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:42.557340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:42.558185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:42.558849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:42.561028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:42.617149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:42.683786 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1253/2495] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:42 2022] POST /identity/v3/projects => generated 393 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:42.687985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:42.711540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28070-7989-4b51-b9a2-8bb33eeecb07 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:42.817132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:42.817888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:42.818272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:42.818619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:42.819526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:42.821596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:42.918102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1243/2496] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:42 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:42.926268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:42.986917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab8e9-03b8-4dae-a2c0-0c3ee40b349e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:42.998844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:43.001635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.002192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.002638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.003763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:43.006905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:43.043596 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1254/2497] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:43.048427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:43.084007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a553fc-c21d-46ae-bcee-7b4976871925 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:43.097113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:43.097917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.098219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.098493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] PATH_INFO: `/v3/projects/8816433ce4764909a9f0cf35dcf22f81/users/b00096bc62b94d75a5b3aa7dd742bc11/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.121062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8816433ce4764909a9f0cf35dcf22f81, user_id=b00096bc62b94d75a5b3aa7dd742bc11, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:43.123917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:43.169638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:43.181211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:43.185521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:43.220203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccbab3-49ab-446c-8aec-694db9a35b25 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:43.254362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:43.254362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.254362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.254362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] PATH_INFO: `/v3/projects/eb20a0da64fb4e60b540008653306bc8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.255026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb20a0da64fb4e60b540008653306bc8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:43.255026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:43.320921 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1244/2498] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:43 2022] PUT /identity/v3/projects/8816433ce4764909a9f0cf35dcf22f81/users/b00096bc62b94d75a5b3aa7dd742bc11/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:43.325289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:43.465064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb20a0da64fb4e60b540008653306bc8', 'request_id': 'req-343004c2-7928-4d8f-a2b8-8d940b9dba86'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:43.480398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb20a0da64fb4e60b540008653306bc8', 'request_id': 'req-343004c2-7928-4d8f-a2b8-8d940b9dba86'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:43.485121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ea64d-b8b2-4e1f-8d11-bf56a82ff442 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:43.496832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb20a0da64fb4e60b540008653306bc8', 'request_id': 'req-343004c2-7928-4d8f-a2b8-8d940b9dba86'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:43.498769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:43.603772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:43.604963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.606401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.606744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.607438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:43.615696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:43.633797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] The token cache is being invalidate because project eb20a0da64fb4e60b540008653306bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:43.634252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:43.639220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:43.640520 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1255/2499] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:43 2022] DELETE /identity/v3/projects/eb20a0da64fb4e60b540008653306bc8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:43.646253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:43.648621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:43.663458 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1245/2500] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:43.668731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:43.673489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:43.688046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343004c2-7928-4d8f-a2b8-8d940b9dba86 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:43.699984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b0d82-5ad7-4592-acb2-635c3028bec6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:43.706653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:43.707295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735a3e5-bc03-467f-a49d-2f946d13ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:43.707451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.707800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.708822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a3e5-bc03-467f-a49d-2f946d13ff66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.709287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a3e5-bc03-467f-a49d-2f946d13ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.710290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a3e5-bc03-467f-a49d-2f946d13ff66 admin admin] PATH_INFO: `/v3/projects/8816433ce4764909a9f0cf35dcf22f81/users/b00096bc62b94d75a5b3aa7dd742bc11/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.711937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] PATH_INFO: `/v3/users/4b3c25a68fad4670ba65ce93dd19f9be` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.713461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735a3e5-bc03-467f-a49d-2f946d13ff66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8816433ce4764909a9f0cf35dcf22f81, user_id=b00096bc62b94d75a5b3aa7dd742bc11, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:43.714604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3c25a68fad4670ba65ce93dd19f9be)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:43.716999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:43.718671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735a3e5-bc03-467f-a49d-2f946d13ff66 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:43.741548 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1246/2501] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:43 2022] PUT /identity/v3/projects/8816433ce4764909a9f0cf35dcf22f81/users/b00096bc62b94d75a5b3aa7dd742bc11/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:43.767878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58d19-c4c4-4ef6-90a4-d55baa54a089 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:43.768150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58d19-c4c4-4ef6-90a4-d55baa54a089 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:43.768529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58d19-c4c4-4ef6-90a4-d55baa54a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:43.830790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48d58d19-c4c4-4ef6-90a4-d55baa54a089 None None] MFA Rules not processed for user `b00096bc62b94d75a5b3aa7dd742bc11`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:43.830790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48d58d19-c4c4-4ef6-90a4-d55baa54a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:44.090613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3c25a68fad4670ba65ce93dd19f9be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:44.092971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3c25a68fad4670ba65ce93dd19f9be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:44.101023 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1247/2502] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:44.114554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:44.114554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:44.114554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:44.181626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] MFA Rules not processed for user `035ab796190f47bf83f0bb58daf66f21`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:44.197892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:44.199047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3c25a68fad4670ba65ce93dd19f9be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:44.214984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3c25a68fad4670ba65ce93dd19f9be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:44.216158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3c25a68fad4670ba65ce93dd19f9be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:44.276070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1256/2503] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:43 2022] DELETE /identity/v3/users/4b3c25a68fad4670ba65ce93dd19f9be => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:44.383901 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1248/2504] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:44.384080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:44.384080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:44.559272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b960-a8ab-489e-b57d-46cc84b198d5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:44.579575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:44.583123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:44.583911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:44.584500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:44.599122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:44.610792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:44.707316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:44.708530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:44.743986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:44.747905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b46559-3ccc-4803-a4f8-40ae2de8f47a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:44.767009 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1257/2505] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:54:44.852786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367296c-1392-4e9e-9abe-1bf0b705246c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:44.986776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:45.008605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:45.009584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:45.010157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:45.011439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] PATH_INFO: `/v3/projects/ddf5539d7c3c42ac9aee51b5731d5f03` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:45.013785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf5539d7c3c42ac9aee51b5731d5f03)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:45.015672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:45.025895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:45.167793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf5539d7c3c42ac9aee51b5731d5f03', 'request_id': 'req-90b2783e-7879-4178-9889-64ef14c761aa'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:45.176596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf5539d7c3c42ac9aee51b5731d5f03', 'request_id': 'req-90b2783e-7879-4178-9889-64ef14c761aa'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:45.185697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf5539d7c3c42ac9aee51b5731d5f03', 'request_id': 'req-90b2783e-7879-4178-9889-64ef14c761aa'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:45.297332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] The token cache is being invalidate because project ddf5539d7c3c42ac9aee51b5731d5f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:45.297689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:45.300076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-90b2783e-7879-4178-9889-64ef14c761aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:45.302475 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1249/2506] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:44 2022] DELETE /identity/v3/projects/ddf5539d7c3c42ac9aee51b5731d5f03 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:45.308884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:45.309342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:45.309652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:45.366801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:45.368530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:45.512349 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1258/2507] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:45.533051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:45.533051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:45.533340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:45.577572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:45.585117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:45.609963 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1250/2508] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:45.614993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:45.638792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b66d-2b7b-436c-addd-89232ab2ca8b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:45.645214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:45.646625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:45.646919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:45.647742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:45.649166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:45.649490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:45.652192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:45.677280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:45.684720 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1259/2509] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:45.692054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134efe6f-477d-44ed-9fdc-d49ac8f11bfc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:45.708713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:45.708713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:45.708713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:45.709229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:45.713358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:45.721876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:45.850589 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1251/2510] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:45 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:45.854910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:45.882057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1395f2a-2e14-481f-ace7-3f552be035db admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:46.108361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:46.109304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:46.111002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:46.111520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:46.116034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:46.123896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:46.240970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:46.254089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:46.262716 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1260/2511] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:45 2022] POST /identity/v3/users => generated 281 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:46.276481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6d0a-a73e-4091-b0e0-ec2536afd3e9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:46.283064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:46.283851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:46.284280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:46.284655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:46.285620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:46.287266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:46.304381 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1252/2512] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:46.309156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:46.340647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b69b1-005e-4160-b762-653c2b7253ab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:46.352219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:46.364679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa381-94e4-4062-982f-c409202bedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:46.365325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa381-94e4-4062-982f-c409202bedb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:46.365607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa381-94e4-4062-982f-c409202bedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:46.365902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa381-94e4-4062-982f-c409202bedb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:46.366582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafa381-94e4-4062-982f-c409202bedb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:46.374755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafa381-94e4-4062-982f-c409202bedb5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:46.408751 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1261/2513] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:46.408950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:46.425035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88759c21-b4ff-4f12-ace6-1ab02a9e4b37 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:46.443411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:46.444100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:46.444382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:46.444658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] PATH_INFO: `/v3/projects/3e40e5b116734810a8fdb1717a76b8d8/users/cae8929880974034aa25997ec7bca08d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:46.473341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e40e5b116734810a8fdb1717a76b8d8, user_id=cae8929880974034aa25997ec7bca08d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:46.478388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:46.559581 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1253/2514] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:46 2022] PUT /identity/v3/projects/3e40e5b116734810a8fdb1717a76b8d8/users/cae8929880974034aa25997ec7bca08d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:46.570985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:46.571674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:46.572310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:46.637638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] MFA Rules not processed for user `cae8929880974034aa25997ec7bca08d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:46.639892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:46.811191 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1262/2515] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:46.815748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:47.065802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a084-2e8c-48d7-9931-fb0b51f58b55 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:47.075155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:47.075871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:47.076280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:47.076651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:47.077597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:47.080955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:47.091281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:47.225976 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1254/2516] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:46 2022] POST /identity/v3/projects => generated 359 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:47.231647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:47.253750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2881-d565-422d-93b4-242cb3429375 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:47.393031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:47.397031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:47.397031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:47.398119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:47.400895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:47.403968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:47.553028 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1263/2517] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:47 2022] POST /identity/v3/users => generated 286 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:47.555928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:47.580483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f872e91-27ac-4bf3-b362-05488efaa05a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:47.580483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:47.580483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:47.580483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:47.580921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:47.581207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:47.582957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:47.611768 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1255/2518] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:47.611976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:47.614923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:47.629300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c9e9-9c95-4c2f-b864-5c2519fce2ce admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:47.635263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:47.636290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:47.636818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:47.637254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] PATH_INFO: `/v3/projects/a9bc567f827147b7b0cfd8146cafa9fd/users/c0580f8aed4943bf83d4661a8e4620b2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:47.690909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bc567f827147b7b0cfd8146cafa9fd, user_id=c0580f8aed4943bf83d4661a8e4620b2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:47.697911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:47.830268 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1264/2519] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:47 2022] PUT /identity/v3/projects/a9bc567f827147b7b0cfd8146cafa9fd/users/c0580f8aed4943bf83d4661a8e4620b2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:47.831874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:47.847252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb7ef-9e1e-48db-83c1-29d44ad6d247 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:47.980365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec525f9-c943-4a64-84e6-d8c3bde2eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:47.981062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec525f9-c943-4a64-84e6-d8c3bde2eada admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:47.981340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec525f9-c943-4a64-84e6-d8c3bde2eada admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:47.981610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec525f9-c943-4a64-84e6-d8c3bde2eada admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:47.983522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec525f9-c943-4a64-84e6-d8c3bde2eada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:47.985643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec525f9-c943-4a64-84e6-d8c3bde2eada admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:47.998739 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1256/2520] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:48.003803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:48.016799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc39f-ab01-4a7d-af41-1077124ad578 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:48.027426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:48.028325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:48.028609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:48.028886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] PATH_INFO: `/v3/projects/a9bc567f827147b7b0cfd8146cafa9fd/users/c0580f8aed4943bf83d4661a8e4620b2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:48.031361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bc567f827147b7b0cfd8146cafa9fd, user_id=c0580f8aed4943bf83d4661a8e4620b2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:48.034370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:48.077978 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1265/2521] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:48 2022] PUT /identity/v3/projects/a9bc567f827147b7b0cfd8146cafa9fd/users/c0580f8aed4943bf83d4661a8e4620b2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:48.100094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:48.100406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:48.100681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:48.146420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] MFA Rules not processed for user `c0580f8aed4943bf83d4661a8e4620b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:48.148681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:48.257214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1257/2522] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:48.273272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:48.282799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:48.423138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19bc7-ac8b-4d6e-8f1f-b53e93a8d269 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:48.436486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d915e8-1936-4e80-a3ff-c7d03bd9a610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:48.438362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d915e8-1936-4e80-a3ff-c7d03bd9a610 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:48.438362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d915e8-1936-4e80-a3ff-c7d03bd9a610 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:48.438362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d915e8-1936-4e80-a3ff-c7d03bd9a610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:48.449164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d915e8-1936-4e80-a3ff-c7d03bd9a610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:48.451891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d915e8-1936-4e80-a3ff-c7d03bd9a610 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:48.465059 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1266/2523] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:49.329176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:49.740644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:49.815645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:49.836804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3bbc-5d1c-4368-8b29-72cb4f6ad97b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:49.851302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:49.853176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:49.853176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:49.853176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] PATH_INFO: `/v3/users/cae8929880974034aa25997ec7bca08d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:49.855478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae8929880974034aa25997ec7bca08d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:49.868545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:50.127351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae8929880974034aa25997ec7bca08d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:50.179181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae8929880974034aa25997ec7bca08d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:50.194352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae8929880974034aa25997ec7bca08d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:50.195601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae8929880974034aa25997ec7bca08d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:50.196595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae8929880974034aa25997ec7bca08d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:50.323365 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1258/2524] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:49 2022] DELETE /identity/v3/users/cae8929880974034aa25997ec7bca08d => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:50.328069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2cac-041d-40a1-b2be-97dcbc964e19 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:50.329702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2cac-041d-40a1-b2be-97dcbc964e19 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:50.330332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2cac-041d-40a1-b2be-97dcbc964e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:50.365795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8efe2cac-041d-40a1-b2be-97dcbc964e19 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:50.369043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8efe2cac-041d-40a1-b2be-97dcbc964e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:50.498409 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1267/2525] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:50.558362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:50.560011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:50.714203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e33a54-7b93-4c98-a718-befbeb439442 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:50.724400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4d49a-8be3-4583-8ef8-744b79674bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:50.725359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4d49a-8be3-4583-8ef8-744b79674bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:50.726960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4d49a-8be3-4583-8ef8-744b79674bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:50.727422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4d49a-8be3-4583-8ef8-744b79674bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:50.771817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4d49a-8be3-4583-8ef8-744b79674bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:50.781287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4d49a-8be3-4583-8ef8-744b79674bb3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:50.804491 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1259/2526] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:51.437800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:51.856597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c82534-3946-4551-a214-456536471db9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:51.857610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c82534-3946-4551-a214-456536471db9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:51.858373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c82534-3946-4551-a214-456536471db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:51.934887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:51.946972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-88c82534-3946-4551-a214-456536471db9 None None] MFA Rules not processed for user `92fc473ae07540adbc11f9e31e663b55`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:51.946972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-88c82534-3946-4551-a214-456536471db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:52.108920 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1268/2527] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:52.111292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:52.111812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:52.113250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:52.136786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] MFA Rules not processed for user `214b5ab49764481c98a048528f3d2f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:52.138498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:52.261450 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1260/2528] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:52.700977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:52.912435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c82534-3946-4551-a214-456536471db9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:52.913955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-88c82534-3946-4551-a214-456536471db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:52.931782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c82534-3946-4551-a214-456536471db9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:52.940733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:52.941779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:52.942303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:52.942769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] PATH_INFO: `/v3/projects/3e40e5b116734810a8fdb1717a76b8d8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:52.944875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e40e5b116734810a8fdb1717a76b8d8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:52.947237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:52.982834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:52.984954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:53.018324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:53.141627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e40e5b116734810a8fdb1717a76b8d8', 'request_id': 'req-c533b72a-c886-418d-abc4-07422e28ac30'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.161605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e40e5b116734810a8fdb1717a76b8d8', 'request_id': 'req-c533b72a-c886-418d-abc4-07422e28ac30'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.181941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e40e5b116734810a8fdb1717a76b8d8', 'request_id': 'req-c533b72a-c886-418d-abc4-07422e28ac30'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.202430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbba9ed-0297-4f6a-9a41-7143708b89af None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:53.305749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] The token cache is being invalidate because project 3e40e5b116734810a8fdb1717a76b8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:53.306180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.307049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.313251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1269/2529] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:52 2022] DELETE /identity/v3/projects/3e40e5b116734810a8fdb1717a76b8d8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:53.314494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:53.319947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:53.349038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:53.350625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:53.350625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:53.350625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:53.359001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:53.512627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b72a-c886-418d-abc4-07422e28ac30 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:53.533110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:53.533308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:53.533552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:53.533774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] PATH_INFO: `/v3/users/c0580f8aed4943bf83d4661a8e4620b2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:53.538467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:53.539539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0580f8aed4943bf83d4661a8e4620b2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:53.542647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff671faa-4c42-474c-8c91-1963431cbaa3 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:53.546666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:53.568282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1261/2530] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:53.853511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0580f8aed4943bf83d4661a8e4620b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.854333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0580f8aed4943bf83d4661a8e4620b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:53.860401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:53.991680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0580f8aed4943bf83d4661a8e4620b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:54.012516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0580f8aed4943bf83d4661a8e4620b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:54.016811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00a2370e-e51b-4935-bf3d-e80b7c3ac5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0580f8aed4943bf83d4661a8e4620b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:54.047880 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1270/2531] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:54:53 2022] DELETE /identity/v3/users/c0580f8aed4943bf83d4661a8e4620b2 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:54.364991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:54.378443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575c8b-c040-4c8c-8a3f-615bd6df15ec None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:54.379591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575c8b-c040-4c8c-8a3f-615bd6df15ec None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:54.380067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575c8b-c040-4c8c-8a3f-615bd6df15ec None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:54.382264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1262/2532] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:54:54.391076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:54.391404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:54.391679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:54.430100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:54.431820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:54.612436 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1271/2533] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:54:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:54:54.656125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575c8b-c040-4c8c-8a3f-615bd6df15ec None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:54.660338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16575c8b-c040-4c8c-8a3f-615bd6df15ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:54.694380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575c8b-c040-4c8c-8a3f-615bd6df15ec None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:54.700125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fdfc9-1dba-4b31-8204-878c3cf26a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:54.701050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fdfc9-1dba-4b31-8204-878c3cf26a95 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:54.701660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fdfc9-1dba-4b31-8204-878c3cf26a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:54.702189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fdfc9-1dba-4b31-8204-878c3cf26a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:54.782744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fdfc9-1dba-4b31-8204-878c3cf26a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:54.787578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fdfc9-1dba-4b31-8204-878c3cf26a95 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:54.807486 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1263/2534] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:55.057877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:55.655892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:55.931723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:55.933964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:56.080452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:56.089513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68797f-d439-4bda-8ae9-a52a37ed0d9a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:56.106832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:56.107909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:56.108441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:56.109192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] PATH_INFO: `/v3/projects/a9bc567f827147b7b0cfd8146cafa9fd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:56.111042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bc567f827147b7b0cfd8146cafa9fd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:56.113490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:56.311774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bc567f827147b7b0cfd8146cafa9fd', 'request_id': 'req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:56.378754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bc567f827147b7b0cfd8146cafa9fd', 'request_id': 'req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:56.457322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bc567f827147b7b0cfd8146cafa9fd', 'request_id': 'req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:56.598986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] The token cache is being invalidate because project a9bc567f827147b7b0cfd8146cafa9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:54:56.600055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:56.603488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b69ee4c-57a1-4671-9383-fa7ab9eee4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:54:56.627915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1272/2535] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:54:55 2022] DELETE /identity/v3/projects/a9bc567f827147b7b0cfd8146cafa9fd => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:56.631040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:56.631569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:56.632975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:56.693148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:56.700682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:56.703028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:57.020424 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1264/2536] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:57.025695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:57.026457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:57.026635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:57.173418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:57.183512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:57.247727 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1273/2537] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:57.252539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:57.267556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60301b5-aeb0-4dd6-8a51-29c97ad1a92f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:57.296553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:57.297631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:57.298116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:57.298796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:57.299762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:54:57.300255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:57.302213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:57.346760 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1265/2538] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:54:57.362480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:57.377051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16696670-6445-4e49-ac99-be039c6a1f9d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:57.390552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b479-72b3-4a93-a16b-c2fd7af6ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:57.391712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b479-72b3-4a93-a16b-c2fd7af6ecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:57.392246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b479-72b3-4a93-a16b-c2fd7af6ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:57.392749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b479-72b3-4a93-a16b-c2fd7af6ecb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:57.398153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9b479-72b3-4a93-a16b-c2fd7af6ecb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:57.406579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9b479-72b3-4a93-a16b-c2fd7af6ecb0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:57.538085 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1274/2539] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:57 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:57.544202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:57.562745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b48d-c0e3-4f4e-9360-2de32471a234 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:57.755373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:57.758780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:57.759960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:57.761119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:57.762628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:57.765626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:57.783615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:57.783909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:57.784519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:57.851547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] MFA Rules not processed for user `0a17e2636e7d4d72840dd07825c47aca`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:57.852980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:57.965888 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1266/2540] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:57 2022] POST /identity/v3/users => generated 291 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:57.976846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:57.997769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:58.011689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f043-c43b-4707-bb04-3699828dbd7f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:58.027582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:58.028621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:58.030395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:58.031025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:58.032097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:58.034053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:58.050416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1267/2541] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:58.056730 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1275/2542] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:58.061956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:58.084648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:58.087686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:58.111459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a316e-be39-4b1a-9dd8-9a637be431c1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:58.123877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:58.125058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:58.125873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:58.127338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:58.128930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:58.135677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:58.199709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1268/2543] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:58.205115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:58.231185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30673-a7a9-499b-9881-e9fa6036c481 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:58.248679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:58.249536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:58.250478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:58.250868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] PATH_INFO: `/v3/projects/da4386b854ed4a3a845d3837ec8df45f/users/3b49067c8bf84e588a4cbbd506e104c5/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:58.296236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4386b854ed4a3a845d3837ec8df45f, user_id=3b49067c8bf84e588a4cbbd506e104c5, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:58.303829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:58.378601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c878bb-435d-41d4-938a-d8c64b327b0a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:58.391205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0af81-f963-482f-a080-c3cbd4013e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:58.391205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0af81-f963-482f-a080-c3cbd4013e1b service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:58.391205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0af81-f963-482f-a080-c3cbd4013e1b service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:58.391205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0af81-f963-482f-a080-c3cbd4013e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:58.402089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0af81-f963-482f-a080-c3cbd4013e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:58.405088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0af81-f963-482f-a080-c3cbd4013e1b service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:58.422330 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1276/2544] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:58 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:58.438397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1269/2545] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:58 2022] PUT /identity/v3/projects/da4386b854ed4a3a845d3837ec8df45f/users/3b49067c8bf84e588a4cbbd506e104c5/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:58.449998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:58.451163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:58.451983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:58.528949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] MFA Rules not processed for user `3b49067c8bf84e588a4cbbd506e104c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:58.530427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:58.699530 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1277/2546] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:58.705292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:58.847864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53c88-9d8f-4b0a-b890-5b658cbe6fc1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:58.860518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:58.861520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:58.862691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:58.863173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:58.864646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:58.867955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:59.063041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:59.063041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1270/2547] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:54:58 2022] POST /identity/v3/projects => generated 383 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:54:59.067501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:59.094133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27caa02-80ac-4638-a11e-6c18c2c5c601 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:59.232726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:59.233366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:59.235153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:59.235153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:59.235153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:59.236831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:59.353292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1278/2548] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:54:59 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:54:59.364456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:59.395588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56433-0e95-4874-9d22-531b130cd52f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:59.417226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:59.422753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:59.423911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:59.424574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:59.428885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:59.430899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:59.454425 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1271/2549] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:54:59.459152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:59.482028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce596f3-711f-48e7-a690-a1a7a295102c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:59.491625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:59.492755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:59.493249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:59.493902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] PATH_INFO: `/v3/projects/e49f9264a4804c82ac1ae7dfd32cf8e0/users/41e1e100d0a64b5c835470799876ed3a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:59.528467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49f9264a4804c82ac1ae7dfd32cf8e0, user_id=41e1e100d0a64b5c835470799876ed3a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:59.544217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:59.680206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:59.693902 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1279/2550] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:59 2022] PUT /identity/v3/projects/e49f9264a4804c82ac1ae7dfd32cf8e0/users/41e1e100d0a64b5c835470799876ed3a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:54:59.698461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:59.715184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e2bd-4214-4f91-972c-57cff6ea6028 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:59.813654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ca423-7ba2-46ef-8092-3f749f6b45da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:59.815184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca423-7ba2-46ef-8092-3f749f6b45da admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:59.815879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca423-7ba2-46ef-8092-3f749f6b45da admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:59.816520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca423-7ba2-46ef-8092-3f749f6b45da admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:59.817750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ca423-7ba2-46ef-8092-3f749f6b45da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:59.820875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ca423-7ba2-46ef-8092-3f749f6b45da admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:59.836880 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1272/2551] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:54:59.841316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:59.857125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db09609-8e7f-470b-a1e7-f9df0195c057 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:59.871959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:59.871959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:59.871959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:59.872685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] PATH_INFO: `/v3/projects/e49f9264a4804c82ac1ae7dfd32cf8e0/users/41e1e100d0a64b5c835470799876ed3a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:59.875076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49f9264a4804c82ac1ae7dfd32cf8e0, user_id=41e1e100d0a64b5c835470799876ed3a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:59.878654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:59.910292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1280/2552] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:54:59 2022] PUT /identity/v3/projects/e49f9264a4804c82ac1ae7dfd32cf8e0/users/41e1e100d0a64b5c835470799876ed3a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:54:59.994217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:59.995218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:59.995735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:00.051884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] MFA Rules not processed for user `41e1e100d0a64b5c835470799876ed3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:00.053598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:00.198681 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1273/2553] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:54:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:00.242500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:00.245463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:00.360155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379762d-a824-44a4-916b-9f019c2c776f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:00.372127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17367dbc-352e-48cd-9ac1-1e9a551262b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:00.373239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17367dbc-352e-48cd-9ac1-1e9a551262b4 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:00.373556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17367dbc-352e-48cd-9ac1-1e9a551262b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:00.374067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17367dbc-352e-48cd-9ac1-1e9a551262b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:00.393937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17367dbc-352e-48cd-9ac1-1e9a551262b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:00.401014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17367dbc-352e-48cd-9ac1-1e9a551262b4 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:00.423538 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1281/2554] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:01.357563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:01.507979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:02.364882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:02.864469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:03.238672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:03.438185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:04.187061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:04.225909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:04.283937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d0ef-b20f-4bcb-9453-de76d7770b77 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:04.289211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:04.291227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:04.291227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:04.291227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] PATH_INFO: `/v3/users/3b49067c8bf84e588a4cbbd506e104c5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:04.292024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b49067c8bf84e588a4cbbd506e104c5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:04.294345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:04.586299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b49067c8bf84e588a4cbbd506e104c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:04.615177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b49067c8bf84e588a4cbbd506e104c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:04.628582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b49067c8bf84e588a4cbbd506e104c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:04.630274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b49067c8bf84e588a4cbbd506e104c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:04.631344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b49067c8bf84e588a4cbbd506e104c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:04.737440 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1274/2555] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:04 2022] DELETE /identity/v3/users/3b49067c8bf84e588a4cbbd506e104c5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:04.741942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:04.742441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:04.742540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:04.765629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:04.767295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:04.850763 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1282/2556] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:04.857538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:04.861807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:04.949516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5597f9-4e1e-4d4e-8c85-48f44ed41c17 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:04.966237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056432-bae8-4a1c-bbc4-60ec2435618c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:04.966237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056432-bae8-4a1c-bbc4-60ec2435618c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:04.966237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056432-bae8-4a1c-bbc4-60ec2435618c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:04.966708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056432-bae8-4a1c-bbc4-60ec2435618c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:04.985321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94056432-bae8-4a1c-bbc4-60ec2435618c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:04.988312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94056432-bae8-4a1c-bbc4-60ec2435618c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:05.010703 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1275/2557] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:05.157569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:05.159032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:05.172516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05c39-630b-4128-b3bf-a73f4a0db966 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:05.177946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:05.179038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:05.179475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:05.179899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] PATH_INFO: `/v3/users/9dc9a684b2ce4262b578fe9364385bb9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:05.182600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc9a684b2ce4262b578fe9364385bb9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:05.185182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:05.324572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:05.374386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:05.411815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc9a684b2ce4262b578fe9364385bb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:05.414485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc9a684b2ce4262b578fe9364385bb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:05.505599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc9a684b2ce4262b578fe9364385bb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:05.515764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc9a684b2ce4262b578fe9364385bb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:05.516541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc9a684b2ce4262b578fe9364385bb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:05.548505 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1283/2558] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:05 2022] DELETE /identity/v3/users/9dc9a684b2ce4262b578fe9364385bb9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:05.552944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:05.553233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:05.553722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:05.586123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:05.592438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:05.647578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:05.649287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:05.664142 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1276/2559] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:05.692431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:05.701130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:05.734368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515373-7bd4-4c7b-aa0d-0114e5a79016 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:05.740602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:05.741257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:05.741539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:05.741814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] PATH_INFO: `/v3/projects/da4386b854ed4a3a845d3837ec8df45f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:05.743118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4386b854ed4a3a845d3837ec8df45f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:05.746818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:05.829186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9292b32-3b68-4ddd-ab68-ab2a8b4b1504 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:05.829186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:05.829548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:05.829749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:05.830889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:05.842678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:05.844626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:05.858050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1277/2560] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:06.141725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4386b854ed4a3a845d3837ec8df45f', 'request_id': 'req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.159008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4386b854ed4a3a845d3837ec8df45f', 'request_id': 'req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.174674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4386b854ed4a3a845d3837ec8df45f', 'request_id': 'req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.317371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] The token cache is being invalidate because project da4386b854ed4a3a845d3837ec8df45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:06.317902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.319551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.321505 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1284/2561] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:05 2022] DELETE /identity/v3/projects/da4386b854ed4a3a845d3837ec8df45f => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:06.326349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:06.341326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1b05e-51fa-4735-af99-57b517ad2c45 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:06.462271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:06.463310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:06.463746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:06.464097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] PATH_INFO: `/v3/users/41e1e100d0a64b5c835470799876ed3a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:06.465750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e1e100d0a64b5c835470799876ed3a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:06.468093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:06.609761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:06.611238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:06.625923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4f5ab-adaf-4795-b2a9-c5b81ac38335 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:06.632478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:06.633140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:06.633609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:06.633944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] PATH_INFO: `/v3/projects/5a1290b969a84eb897dd8ab368a89fa1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:06.635770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1290b969a84eb897dd8ab368a89fa1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:06.637942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:06.899324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1290b969a84eb897dd8ab368a89fa1', 'request_id': 'req-8c9de2f0-c856-438b-94d9-8621f9fd81fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.908702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1290b969a84eb897dd8ab368a89fa1', 'request_id': 'req-8c9de2f0-c856-438b-94d9-8621f9fd81fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.917620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1290b969a84eb897dd8ab368a89fa1', 'request_id': 'req-8c9de2f0-c856-438b-94d9-8621f9fd81fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.928478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e1e100d0a64b5c835470799876ed3a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.939545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e1e100d0a64b5c835470799876ed3a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.951692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e1e100d0a64b5c835470799876ed3a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.952446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e1e100d0a64b5c835470799876ed3a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:06.953057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e1e100d0a64b5c835470799876ed3a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.050939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] The token cache is being invalidate because project 5a1290b969a84eb897dd8ab368a89fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:07.050939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.050939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.050939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1285/2562] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:06 2022] DELETE /identity/v3/projects/5a1290b969a84eb897dd8ab368a89fa1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:07.052450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:07.054627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:07.152082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9de2f0-c856-438b-94d9-8621f9fd81fa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:07.163852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:07.163852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:07.163852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:07.163852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] PATH_INFO: `/v3/users/2e794b6121aa4f32bf93609d3d098cd2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:07.164299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e794b6121aa4f32bf93609d3d098cd2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:07.164299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:07.184190 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1278/2563] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:06 2022] DELETE /identity/v3/users/41e1e100d0a64b5c835470799876ed3a => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:07.424098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:07.467617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e794b6121aa4f32bf93609d3d098cd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.469444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e794b6121aa4f32bf93609d3d098cd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.586780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e794b6121aa4f32bf93609d3d098cd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.602380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e794b6121aa4f32bf93609d3d098cd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.603582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b992ca55-a30a-4963-bd95-83b002dab065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e794b6121aa4f32bf93609d3d098cd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:07.672236 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1286/2564] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:07 2022] DELETE /identity/v3/users/2e794b6121aa4f32bf93609d3d098cd2 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:07.903956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:07.908026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:08.084046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b08f8e-6501-46fb-b3a3-ccc3704ea738 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:08.181101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:08.186049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.186049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.186049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] PATH_INFO: `/v3/projects/e49f9264a4804c82ac1ae7dfd32cf8e0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.186049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49f9264a4804c82ac1ae7dfd32cf8e0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:08.188266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:08.420459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49f9264a4804c82ac1ae7dfd32cf8e0', 'request_id': 'req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:08.441387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49f9264a4804c82ac1ae7dfd32cf8e0', 'request_id': 'req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:08.452398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49f9264a4804c82ac1ae7dfd32cf8e0', 'request_id': 'req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:08.530724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] The token cache is being invalidate because project e49f9264a4804c82ac1ae7dfd32cf8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:08.531177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:08.532913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:08.535788 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1279/2565] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:07 2022] DELETE /identity/v3/projects/e49f9264a4804c82ac1ae7dfd32cf8e0 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:08.544073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286c09e-a465-4135-a55e-fdd68374a2ec None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.544611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286c09e-a465-4135-a55e-fdd68374a2ec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.545072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286c09e-a465-4135-a55e-fdd68374a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.552682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:08.594725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1286c09e-a465-4135-a55e-fdd68374a2ec None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:08.594725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1286c09e-a465-4135-a55e-fdd68374a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:08.627880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:08.629696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:08.719394 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1287/2566] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:08.727491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.727925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.728370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.802980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:08.804183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:08.816079 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1288/2567] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:08.820969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:08.828707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfed4d-b8dc-4a74-a702-2bbcbc503232 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:08.837938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:08.838302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b6c0-3ee1-4b9f-828d-8f76888bde41 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:08.838974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.839341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.839770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] PATH_INFO: `/v3/projects/078a3e6ce033480ab2d1c9d2ed2f960d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.841972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078a3e6ce033480ab2d1c9d2ed2f960d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:08.845184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:08.845651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:08.846292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.846767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.847060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.847885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:08.850032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:08.853754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:08.870599 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1289/2568] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:08.876692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:08.901474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07629926-90bd-4fac-9a86-765c8fa36324 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:08.907265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:08.907919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.908205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.908484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.909135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:08.911315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.051637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078a3e6ce033480ab2d1c9d2ed2f960d', 'request_id': 'req-c98eac13-8a68-4c76-bcf3-5792ded36b75'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:09.061562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078a3e6ce033480ab2d1c9d2ed2f960d', 'request_id': 'req-c98eac13-8a68-4c76-bcf3-5792ded36b75'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:09.076029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1290/2569] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:08 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:09.087275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078a3e6ce033480ab2d1c9d2ed2f960d', 'request_id': 'req-c98eac13-8a68-4c76-bcf3-5792ded36b75'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:09.087831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.184010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a916ab-3b4d-4a7a-a9a4-ac098ab16f96 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.191949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.192707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.193031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.193312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.194086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.208674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.236154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] The token cache is being invalidate because project 078a3e6ce033480ab2d1c9d2ed2f960d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:09.236879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:09.251742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c98eac13-8a68-4c76-bcf3-5792ded36b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:09.259402 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1280/2570] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:08 2022] DELETE /identity/v3/projects/078a3e6ce033480ab2d1c9d2ed2f960d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:09.266184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a1b8-b491-4740-9aaa-e7e48afa7a3b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.266847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a1b8-b491-4740-9aaa-e7e48afa7a3b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.267369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a1b8-b491-4740-9aaa-e7e48afa7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.296978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2a05a1b8-b491-4740-9aaa-e7e48afa7a3b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:09.297878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2a05a1b8-b491-4740-9aaa-e7e48afa7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.311050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1281/2571] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:09.319273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.320000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.320436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.345703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:09.347369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.372355 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1282/2572] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:55:09.373639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.385839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449ea0c-9f99-42c4-aa45-f6bba24bc8e6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.392790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.393531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.393898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.394305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.395085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:09.395397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.397411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.410862 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1283/2573] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:55:09.418642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.434503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433272a-165e-4b87-8a15-2391cf1a917c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.440893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1728b9-3daa-4b4f-b6c6-dfe274341e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.441529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1728b9-3daa-4b4f-b6c6-dfe274341e96 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.441812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1728b9-3daa-4b4f-b6c6-dfe274341e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.442168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1728b9-3daa-4b4f-b6c6-dfe274341e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.443156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1728b9-3daa-4b4f-b6c6-dfe274341e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.444693 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1291/2574] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:09.448029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1728b9-3daa-4b4f-b6c6-dfe274341e96 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.449429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.453439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.477004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb716-f888-4f4a-90d9-719c10124092 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.485253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.486489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.486909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.487279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.490407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.492426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.508220 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1292/2575] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:55:09.515608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.528618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b15b-27f5-466a-910b-871c5a89c5de admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.534737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.535418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.535696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.535974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.536671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.538530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.551200 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1293/2576] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:09.556323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.569092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7e0aa-b321-4bf3-b25b-c2bb5852814a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.575577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.576265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.576549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.576830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] PATH_INFO: `/v3/projects/9eb35c63e2914408b189d0d4ec9fc76c/users/283a6494676b42e3ab54787c038bb1b6/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.600803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb35c63e2914408b189d0d4ec9fc76c, user_id=283a6494676b42e3ab54787c038bb1b6, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.604081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.644255 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1284/2577] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:09.645541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abf6ad-e5fb-4d6f-aa69-73b37f671c7c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.645830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abf6ad-e5fb-4d6f-aa69-73b37f671c7c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.646234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abf6ad-e5fb-4d6f-aa69-73b37f671c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.681458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c4abf6ad-e5fb-4d6f-aa69-73b37f671c7c None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:09.690163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c4abf6ad-e5fb-4d6f-aa69-73b37f671c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.749532 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1294/2578] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:09 2022] PUT /identity/v3/projects/9eb35c63e2914408b189d0d4ec9fc76c/users/283a6494676b42e3ab54787c038bb1b6/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:09.750900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.808227 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1285/2579] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:09.810531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442794-9620-486c-8368-57690803f97a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.810915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442794-9620-486c-8368-57690803f97a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.811421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442794-9620-486c-8368-57690803f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.846024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1b442794-9620-486c-8368-57690803f97a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:09.847953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1b442794-9620-486c-8368-57690803f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.984765 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1286/2580] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:10.014220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b442794-9620-486c-8368-57690803f97a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.017077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1b442794-9620-486c-8368-57690803f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:10.039296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bfb2e-320d-466f-ba23-99fba1f61d3f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.042369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.043294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.043898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.044362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.045409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.048321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.129277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b442794-9620-486c-8368-57690803f97a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.133452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.134142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.134423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.134748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.165690 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1295/2581] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:09 2022] POST /identity/v3/users => generated 288 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:10.167407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.189170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1a0a-b3f7-45e6-824e-b6f00d34e53d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.197584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.198616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.199134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.199460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.216956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.219181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.235188 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1296/2582] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:10.247223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.262895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.264093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc68a-14a5-4f2f-94f9-17213f3dd44d service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.265197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.270676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.271770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.272231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.272755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.273430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.275113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.281213 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1287/2583] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:10.296550 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1297/2584] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:10.301466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.315003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2552bd-0730-4fb3-9c87-ba046c73125f service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.324679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f71fa6-9166-4fc2-96c4-53d53b4c9a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.325403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f71fa6-9166-4fc2-96c4-53d53b4c9a6e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.325692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f71fa6-9166-4fc2-96c4-53d53b4c9a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.325998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f71fa6-9166-4fc2-96c4-53d53b4c9a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.326821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f71fa6-9166-4fc2-96c4-53d53b4c9a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.328494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f71fa6-9166-4fc2-96c4-53d53b4c9a6e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.344885 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1288/2585] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:10.351518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.368592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176bd0-fa77-4698-a9c8-6ee21c79ecb3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.374908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.375623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.375908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.376181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] PATH_INFO: `/v3/projects/6479f4d063cd482f8f1a67278bb5d688/users/989c707947f741c68a273306880bf596/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.395531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6479f4d063cd482f8f1a67278bb5d688, user_id=989c707947f741c68a273306880bf596, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.398697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.587903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1298/2586] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:10 2022] PUT /identity/v3/projects/6479f4d063cd482f8f1a67278bb5d688/users/989c707947f741c68a273306880bf596/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:10.602777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.603687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.604467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.653323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] MFA Rules not processed for user `989c707947f741c68a273306880bf596`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:10.658474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:10.738971 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1289/2587] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:10.745075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.747511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:10.824602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d844a2-d68e-4a45-8489-547c247ea54c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.833056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.833690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.836196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.836196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.836196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.837192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.992552 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1299/2588] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:10 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:10.998801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.013338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1368bc-6af4-4f0f-bcee-5fd764ce05dd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.120819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.122141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.122547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.123315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.124521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.128909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:11.345006 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1290/2589] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:10 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:55:11.346955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.365200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67925a-ce93-42ad-bdcb-18f59654e3c1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.370980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.371605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.371923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.372137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.372787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.374567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:11.389904 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1300/2590] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:55:11.394220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.408055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc716-ca2c-4286-aed4-f98fa2d13561 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.415259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.416785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.422201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.422201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] PATH_INFO: `/v3/projects/1c5f3b0250bf479ea17d8054586aba1b/users/a1e8fcb655184cceb98f0d4604448511/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.443990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5f3b0250bf479ea17d8054586aba1b, user_id=a1e8fcb655184cceb98f0d4604448511, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.450151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:11.573628 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1291/2591] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:11 2022] PUT /identity/v3/projects/1c5f3b0250bf479ea17d8054586aba1b/users/a1e8fcb655184cceb98f0d4604448511/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:11.574897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.589200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d15118-174e-4bcf-9563-28714291ba81 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.667491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0135d4-3bca-483e-aa2a-19df18745887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.668677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0135d4-3bca-483e-aa2a-19df18745887 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.669219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0135d4-3bca-483e-aa2a-19df18745887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.670255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0135d4-3bca-483e-aa2a-19df18745887 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.671161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0135d4-3bca-483e-aa2a-19df18745887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.675618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0135d4-3bca-483e-aa2a-19df18745887 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:11.690175 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1301/2592] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:11.691596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.702555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf322-21c9-488e-b93d-490334c1ad88 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.707378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.708061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.708419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.708701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] PATH_INFO: `/v3/projects/1c5f3b0250bf479ea17d8054586aba1b/users/a1e8fcb655184cceb98f0d4604448511/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.711094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5f3b0250bf479ea17d8054586aba1b, user_id=a1e8fcb655184cceb98f0d4604448511, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.714329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:11.725494 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1292/2593] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:11 2022] PUT /identity/v3/projects/1c5f3b0250bf479ea17d8054586aba1b/users/a1e8fcb655184cceb98f0d4604448511/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:11.737517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.737805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.738231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.769725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] MFA Rules not processed for user `a1e8fcb655184cceb98f0d4604448511`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:11.771016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:11.820054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:11.869376 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1302/2594] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:11.876763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.889029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6b1f0-5a3c-4951-a55f-eaeee543ba21 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.894002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.894606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.894886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.895160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.895817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:11.896262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.897887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:11.917909 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1293/2595] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:11.921102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:11.930855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aca92-f670-4321-bb99-869356ec6e03 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:11.936256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:11.936892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:11.937156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:11.937635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:11.939017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:11.944095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:12.103894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1303/2596] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:11 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:12.109238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:12.124193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b438-12e2-4e17-bc47-050bbe7833a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:12.223446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:12.224747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.225218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.225665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.226367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:12.226683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:12.228339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccffe1d-400f-4eba-a084-5329c1a6b4b5 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:12.240339 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1294/2597] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:55:12.251931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:12.253754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:12.339688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f561ed-1bcf-4b36-8cb9-eef40c7f3403 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:12.358949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:12.362513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.363124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.363620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.381260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:12.384134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:12.398020 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1304/2598] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:12.430452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c3a8-d473-4260-ae12-0909d81913ef None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.431078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c3a8-d473-4260-ae12-0909d81913ef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.431209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c3a8-d473-4260-ae12-0909d81913ef None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.433706 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1295/2599] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:55:12.439103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:55:12.456403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:12.480996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a90a-7395-4f91-aa67-34c4b63b954e service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:12.487672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:12.488728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.489021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.489297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/projects/18bd5467df124d7c859459da6b0a7e00` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.490713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:get_project(project_id=18bd5467df124d7c859459da6b0a7e00)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:12.494727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:12.503296 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1305/2600] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:55:12 2022] GET /identity/v3/projects/18bd5467df124d7c859459da6b0a7e00 => generated 369 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:12.762600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90d4a7-64df-4804-8391-21e169e6b26b None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.763430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90d4a7-64df-4804-8391-21e169e6b26b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.764013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90d4a7-64df-4804-8391-21e169e6b26b None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.767616 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1296/2601] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:55:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:55:12.778105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:55:12.797006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:12.812076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b69c83-0ee3-40eb-bf69-23e87babf481 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:12.821014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:12.823274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.824140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.827890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/projects/18bd5467df124d7c859459da6b0a7e00` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.829642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:get_project(project_id=18bd5467df124d7c859459da6b0a7e00)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:12.832618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:12.852654 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1306/2602] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:55:12 2022] GET /identity/v3/projects/18bd5467df124d7c859459da6b0a7e00 => generated 369 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:12.902469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90d4a7-64df-4804-8391-21e169e6b26b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:12.925839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90d4a7-64df-4804-8391-21e169e6b26b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:12.944576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:12.944576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:12.944576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:12.944986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:12.944986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:12.944986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:12.956819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:12.999894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1297/2603] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:13.004910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:13.024642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b088-02a9-4d1f-9916-3b4177a7483f tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:13.033229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ef49c-1f43-4a2e-ba5a-5967a4f0af3b tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:13.033993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef49c-1f43-4a2e-ba5a-5967a4f0af3b tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:13.034280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef49c-1f43-4a2e-ba5a-5967a4f0af3b tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:13.034561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef49c-1f43-4a2e-ba5a-5967a4f0af3b tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:13.035270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ef49c-1f43-4a2e-ba5a-5967a4f0af3b tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:13.037578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ef49c-1f43-4a2e-ba5a-5967a4f0af3b tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:13.152685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1307/2604] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:13 2022] POST /identity/v3/users => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:13.157316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:13.174348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6111-fead-4f49-a248-04363d47ee23 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:13.180673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:13.182516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:13.183148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:13.183647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:13.184537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:13.185231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:13.187286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:13.205635 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1298/2605] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:13.363677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:13.480263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105af2-be72-4458-87ca-b6d0a6b13c92 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:13.482124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105af2-be72-4458-87ca-b6d0a6b13c92 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:13.482442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105af2-be72-4458-87ca-b6d0a6b13c92 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:13.484011 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1308/2606] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:55:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:55:13.489377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:55:13.504810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:13.516027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8d3f-d7ae-4b1d-a696-b4d542cceb46 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:13.521351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:13.522300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:13.522442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:13.522910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/projects/18bd5467df124d7c859459da6b0a7e00` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:13.524369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:get_project(project_id=18bd5467df124d7c859459da6b0a7e00)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:13.526721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:13.532735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1299/2607] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:55:13 2022] GET /identity/v3/projects/18bd5467df124d7c859459da6b0a7e00 => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:14.079447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5400ebb-e2d3-436d-8103-8942ba2406a3 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:14.080073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5400ebb-e2d3-436d-8103-8942ba2406a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:14.080073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5400ebb-e2d3-436d-8103-8942ba2406a3 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:14.084449 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1309/2608] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 19:55:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:55:14.093990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:55:14.124274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:14.150246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc5f-014c-4e83-ae4f-9b82c1a8f143 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:14.157788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:14.158466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:14.158750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:14.163703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/projects/18bd5467df124d7c859459da6b0a7e00` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:14.163703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:get_project(project_id=18bd5467df124d7c859459da6b0a7e00)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:14.163703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:14.171736 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1300/2609] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 19:55:14 2022] GET /identity/v3/projects/18bd5467df124d7c859459da6b0a7e00 => generated 369 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:14.215658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5400ebb-e2d3-436d-8103-8942ba2406a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:14.264187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5400ebb-e2d3-436d-8103-8942ba2406a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:14.264187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:14.264187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:14.264862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:14.264862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/users/cb07de6259134f6a9ebb0cd5d76a6296` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:14.283400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cb07de6259134f6a9ebb0cd5d76a6296)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:14.287994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:14.548912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb07de6259134f6a9ebb0cd5d76a6296'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:14.549923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb07de6259134f6a9ebb0cd5d76a6296'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:14.636804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:14.664873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb07de6259134f6a9ebb0cd5d76a6296'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:14.682842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb07de6259134f6a9ebb0cd5d76a6296'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:14.684140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb07de6259134f6a9ebb0cd5d76a6296'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:14.739164 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1310/2610] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:14 2022] DELETE /identity/v3/users/cb07de6259134f6a9ebb0cd5d76a6296 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:14.751336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:14.751336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:14.791106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a25bcf-ecad-4b78-8ed8-60daccc404a8 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:14.979402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e8fcb655184cceb98f0d4604448511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c5f3b0250bf479ea17d8054586aba1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:14.980061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:14.980341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:14.980800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] PATH_INFO: `/v3/projects/18bd5467df124d7c859459da6b0a7e00` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:14.983864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18bd5467df124d7c859459da6b0a7e00)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:14.987179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:15.177507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bd5467df124d7c859459da6b0a7e00', 'request_id': 'req-6e092e92-8911-409d-8909-b09479e147a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:15.197565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bd5467df124d7c859459da6b0a7e00', 'request_id': 'req-6e092e92-8911-409d-8909-b09479e147a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:15.213473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bd5467df124d7c859459da6b0a7e00', 'request_id': 'req-6e092e92-8911-409d-8909-b09479e147a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:15.326960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] The token cache is being invalidate because project 18bd5467df124d7c859459da6b0a7e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:15.327945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:15.330300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:15.342486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:15.343866 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1301/2611] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:14 2022] DELETE /identity/v3/projects/18bd5467df124d7c859459da6b0a7e00 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:15.344049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:15.502354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:15.564638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86bf4d-3a13-4e0f-a42d-85702c3b393e tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:15.708681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:15.710000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:15.710487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:15.711231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] PATH_INFO: `/v3/users/989c707947f741c68a273306880bf596` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:15.713402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989c707947f741c68a273306880bf596)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:15.715498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:15.959462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:15.962442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:16.144372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989c707947f741c68a273306880bf596'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:16.146807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989c707947f741c68a273306880bf596'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:16.156752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092e92-8911-409d-8909-b09479e147a3 tempest-QuotasAdminTestV236-155602134 tempest-QuotasAdminTestV236-155602134-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:16.165045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:16.166241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:16.166624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:16.167253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:16.169942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:16.224029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989c707947f741c68a273306880bf596'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:16.238954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989c707947f741c68a273306880bf596'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:16.240730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-61009a6b-b55c-453f-ab77-9b9f9adbbd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989c707947f741c68a273306880bf596'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:16.316494 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1311/2612] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:15 2022] DELETE /identity/v3/users/989c707947f741c68a273306880bf596 => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:16.324378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:16.324836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:16.325117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:16.396620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:16.401196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:16.413496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:16.421303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:16.452682 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1302/2613] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:16.528727 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1312/2614] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:16.563008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:16.573496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:16.671869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a169e5-9748-411b-9d7c-61b9764cea0c service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:16.768975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd9e41-5244-41f3-b450-7568b3974389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:16.772879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd9e41-5244-41f3-b450-7568b3974389 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:16.772879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd9e41-5244-41f3-b450-7568b3974389 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:16.772879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd9e41-5244-41f3-b450-7568b3974389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:16.788805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd9e41-5244-41f3-b450-7568b3974389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:16.791775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd9e41-5244-41f3-b450-7568b3974389 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:16.807596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1303/2615] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:16.923333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:17.203691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:17.690654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:17.692784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:17.755389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2f02b-f12e-46bb-b6bd-7d979c84490d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:17.767991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:17.768687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:17.768970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:17.769250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] PATH_INFO: `/v3/users/035ab796190f47bf83f0bb58daf66f21` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:17.781138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=035ab796190f47bf83f0bb58daf66f21)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:17.787123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:17.789373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:18.073686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035ab796190f47bf83f0bb58daf66f21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.075270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035ab796190f47bf83f0bb58daf66f21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.186635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035ab796190f47bf83f0bb58daf66f21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.198026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035ab796190f47bf83f0bb58daf66f21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.200757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035ab796190f47bf83f0bb58daf66f21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.252649 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1313/2616] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:17 2022] DELETE /identity/v3/users/035ab796190f47bf83f0bb58daf66f21 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:18.252837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:18.252837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:18.252837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:18.285345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:18.287627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:18.317202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:18.430739 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1304/2617] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:55:18.489560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:18.491103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:18.605149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2998a9-fd61-486b-b33f-231a7eebcb1b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:18.609871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:18.610995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:18.611435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:18.611724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:18.629393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:18.631987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:18.646351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1314/2618] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:18.770047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:18.771568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:18.789216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16204582-abd9-410e-9da0-46364fd850a1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:18.799646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:18.800743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:18.801129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:18.801505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] PATH_INFO: `/v3/projects/6479f4d063cd482f8f1a67278bb5d688` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:18.804192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6479f4d063cd482f8f1a67278bb5d688)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:18.806976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:18.970318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6479f4d063cd482f8f1a67278bb5d688', 'request_id': 'req-796b8e31-ac36-4e66-8d59-d4f795294dc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.977265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6479f4d063cd482f8f1a67278bb5d688', 'request_id': 'req-796b8e31-ac36-4e66-8d59-d4f795294dc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:18.984566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6479f4d063cd482f8f1a67278bb5d688', 'request_id': 'req-796b8e31-ac36-4e66-8d59-d4f795294dc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.055083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] The token cache is being invalidate because project 6479f4d063cd482f8f1a67278bb5d688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:19.055390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.058450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.066995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1305/2619] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:18 2022] DELETE /identity/v3/projects/6479f4d063cd482f8f1a67278bb5d688 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:19.070915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:19.087216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91c51f-55b5-4610-af6e-55c6fb88cbca service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:19.123127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:19.221931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:19.224172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:19.225511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:19.226037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] PATH_INFO: `/v3/users/a1e8fcb655184cceb98f0d4604448511` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:19.227907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e8fcb655184cceb98f0d4604448511)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:19.230233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:19.513246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e8fcb655184cceb98f0d4604448511'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.514887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e8fcb655184cceb98f0d4604448511'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.633215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:19.635151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e8fcb655184cceb98f0d4604448511'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.660621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e8fcb655184cceb98f0d4604448511'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.662069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e8fcb655184cceb98f0d4604448511'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:19.702132 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1315/2620] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:19 2022] DELETE /identity/v3/users/a1e8fcb655184cceb98f0d4604448511 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:19.893092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:19.897559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:19.928520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8e31-ac36-4e66-8d59-d4f795294dc9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:20.158793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:20.159651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:20.160105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:20.160521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] PATH_INFO: `/v3/projects/99d7e142612a407e82beaf28a4defb73` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:20.162040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d7e142612a407e82beaf28a4defb73)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:20.164327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:20.355859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d7e142612a407e82beaf28a4defb73', 'request_id': 'req-3c488764-a103-4f1e-885e-de75530f35c7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.369223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d7e142612a407e82beaf28a4defb73', 'request_id': 'req-3c488764-a103-4f1e-885e-de75530f35c7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.382428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d7e142612a407e82beaf28a4defb73', 'request_id': 'req-3c488764-a103-4f1e-885e-de75530f35c7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.483251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] The token cache is being invalidate because project 99d7e142612a407e82beaf28a4defb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:20.483452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.484832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.487518 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1306/2621] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:19 2022] DELETE /identity/v3/projects/99d7e142612a407e82beaf28a4defb73 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:20.492175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:20.494510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:20.512351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9824913-d49c-45a1-9a93-6c6371f2aebd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:20.702361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:20.703279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:20.703569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:20.703853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] PATH_INFO: `/v3/users/b00096bc62b94d75a5b3aa7dd742bc11` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:20.706361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00096bc62b94d75a5b3aa7dd742bc11)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:20.708931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:20.750887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:20.758962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:20.968333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488764-a103-4f1e-885e-de75530f35c7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:20.977206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00096bc62b94d75a5b3aa7dd742bc11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.978385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00096bc62b94d75a5b3aa7dd742bc11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:20.983351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:21.010226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:21.010873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:21.011162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:21.011433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:21.021621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:21.063789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:21.077009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:21.089028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00096bc62b94d75a5b3aa7dd742bc11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:21.111596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00096bc62b94d75a5b3aa7dd742bc11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:21.112145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d8a4d6b-f331-4a3a-834d-5725ff829c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00096bc62b94d75a5b3aa7dd742bc11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:21.122542 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1307/2622] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:55:21.183611 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1316/2623] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:20 2022] DELETE /identity/v3/users/b00096bc62b94d75a5b3aa7dd742bc11 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:21.565380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:21.567343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:21.615218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2838faa-5f16-4d0f-9b03-af0867315494 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:21.749650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:21.750602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:21.751048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:21.751487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] PATH_INFO: `/v3/projects/1c5f3b0250bf479ea17d8054586aba1b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:21.753121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5f3b0250bf479ea17d8054586aba1b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:21.757359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:21.970749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5f3b0250bf479ea17d8054586aba1b', 'request_id': 'req-883103cf-ff10-44cf-984b-44c3e32444d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:21.986700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5f3b0250bf479ea17d8054586aba1b', 'request_id': 'req-883103cf-ff10-44cf-984b-44c3e32444d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:22.005278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5f3b0250bf479ea17d8054586aba1b', 'request_id': 'req-883103cf-ff10-44cf-984b-44c3e32444d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:22.125989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] The token cache is being invalidate because project 1c5f3b0250bf479ea17d8054586aba1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:22.126417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:22.127337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-883103cf-ff10-44cf-984b-44c3e32444d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:22.136014 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1308/2624] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:21 2022] DELETE /identity/v3/projects/1c5f3b0250bf479ea17d8054586aba1b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:22.145010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:22.145010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:22.145010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:22.194087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:22.195680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:22.304612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1317/2625] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:22.314831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:22.316232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:22.316678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:22.392723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:22.395026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:22.420663 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1309/2626] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:22.426012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:22.446332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37059ab5-f9e1-458e-b7e4-7c810d267a4b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:22.462564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:22.464216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:22.464216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:22.464408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:22.464999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:22.465308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:22.468459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:22.499569 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1318/2627] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:22.502832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:22.533893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3551-8fc0-44d0-b632-c9381a85610f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:22.546579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:22.547222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:22.547504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:22.548001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:22.548680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:22.550974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:22.637345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:22.715677 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1310/2628] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:22 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:22.720444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:22.736436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47761-7f7c-453b-827f-94d47af7ba26 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:22.914062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:22.915211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:22.915725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:22.916083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:22.916830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:22.919142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.038202 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1319/2629] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:22 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:23.042583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:23.063165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b63503-e7c1-48fd-a49b-ffb232d4cba7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:23.078160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:23.079576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.080073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.080579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.082046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:23.083958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.108552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:23.120102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1311/2630] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:23.129675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14484dc4-383b-4230-95c6-051728c070f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:23.139097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2026-79a4-4760-8427-d0cf257d666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:23.140130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2026-79a4-4760-8427-d0cf257d666c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.140629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2026-79a4-4760-8427-d0cf257d666c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.141115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2026-79a4-4760-8427-d0cf257d666c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.142350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2026-79a4-4760-8427-d0cf257d666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:23.144632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2026-79a4-4760-8427-d0cf257d666c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.158890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1320/2631] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:23.163591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:23.178011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ab17-19b9-43eb-89d2-1e40580dfdea admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:23.192865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:23.194304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.195297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.195901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] PATH_INFO: `/v3/projects/641a543e08bc48e884e4e10b41256cb7/users/ba1e1b3d61304d42bf97608fa7b6bf6f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.253702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=641a543e08bc48e884e4e10b41256cb7, user_id=ba1e1b3d61304d42bf97608fa7b6bf6f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:23.260830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.363875 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1312/2632] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:23 2022] PUT /identity/v3/projects/641a543e08bc48e884e4e10b41256cb7/users/ba1e1b3d61304d42bf97608fa7b6bf6f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:23.375655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.376112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.376467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.409935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] MFA Rules not processed for user `ba1e1b3d61304d42bf97608fa7b6bf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:23.411798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:23.512337 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1321/2633] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:23.525239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:23.550675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:23.638767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433bf3-f946-4a3e-a6f0-f30a09f8277a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:23.643594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:23.644200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.644477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.644745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.645397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:23.647636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.761321 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1313/2634] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:23 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:23.767480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:23.775230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624638-fec9-43ed-9e94-311ce3c78421 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:23.880312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:23.881129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.883588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.883588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.885956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:23.891584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.981804 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1322/2635] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:23 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:55:23.986862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:24.031578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecce3-88c8-4c9c-b5e3-03805fa70ded admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:24.042925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:24.044248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:24.044726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:24.045166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:24.045908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:24.048068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:24.064530 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1314/2636] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:24.068026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:24.088304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293440-9ba2-446d-9d6b-3a2af883a7eb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:24.098070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:24.099094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:24.102045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:24.102582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] PATH_INFO: `/v3/projects/513730d15b3b4f43a69ffee706c6786a/users/bd353ccc8e1d44caab8fc439570a9f1f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:24.151944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=513730d15b3b4f43a69ffee706c6786a, user_id=bd353ccc8e1d44caab8fc439570a9f1f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:24.155647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:24.254282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:24.258326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:24.272925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1323/2637] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:24 2022] PUT /identity/v3/projects/513730d15b3b4f43a69ffee706c6786a/users/bd353ccc8e1d44caab8fc439570a9f1f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:24.274166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:24.286506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c78d-043c-4a99-afd9-b21545e4dd3d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:24.411545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092adf-c0d1-4704-be1f-5d547c8906fa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:24.416918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:24.417810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:24.419427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:24.419427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:24.419427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:24.421431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:24.435516 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1324/2638] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:55:24.437555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:24.440138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:24.461927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:24.462202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8fae-f97f-400e-a777-2ada7876c8e2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:24.463196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:24.463756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:24.464244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] PATH_INFO: `/v3/projects/8816433ce4764909a9f0cf35dcf22f81` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:24.465812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8816433ce4764909a9f0cf35dcf22f81)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:24.468188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:24.470258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:24.471245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:24.471835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:24.472905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] PATH_INFO: `/v3/users/0a17e2636e7d4d72840dd07825c47aca` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:24.474593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a17e2636e7d4d72840dd07825c47aca)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:24.478057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:24.663283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8816433ce4764909a9f0cf35dcf22f81', 'request_id': 'req-12d496b7-a8c1-43d4-ada9-31a03e769ab7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.673814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8816433ce4764909a9f0cf35dcf22f81', 'request_id': 'req-12d496b7-a8c1-43d4-ada9-31a03e769ab7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.683926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8816433ce4764909a9f0cf35dcf22f81', 'request_id': 'req-12d496b7-a8c1-43d4-ada9-31a03e769ab7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.742728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a17e2636e7d4d72840dd07825c47aca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.744085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a17e2636e7d4d72840dd07825c47aca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.795130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] The token cache is being invalidate because project 8816433ce4764909a9f0cf35dcf22f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:24.795839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.798586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.802785 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1315/2639] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:24 2022] DELETE /identity/v3/projects/8816433ce4764909a9f0cf35dcf22f81 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:24.805350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:24.810215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:24.876565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a17e2636e7d4d72840dd07825c47aca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.893381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a17e2636e7d4d72840dd07825c47aca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.893381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2087b4fe-bee7-4c8c-8848-06f0305a418f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a17e2636e7d4d72840dd07825c47aca'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:24.905765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:24.954489 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1325/2640] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:24 2022] DELETE /identity/v3/users/0a17e2636e7d4d72840dd07825c47aca => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:24.955600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484e47f-7a13-400b-a94f-bf50d333cb75 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:24.955893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484e47f-7a13-400b-a94f-bf50d333cb75 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:24.956182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484e47f-7a13-400b-a94f-bf50d333cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:24.990950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0484e47f-7a13-400b-a94f-bf50d333cb75 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:24.994019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0484e47f-7a13-400b-a94f-bf50d333cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:25.011711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d496b7-a8c1-43d4-ada9-31a03e769ab7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:25.116088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf891b4-ccb9-41be-8f7b-7a55cc4636f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:25.117536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf891b4-ccb9-41be-8f7b-7a55cc4636f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.118019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf891b4-ccb9-41be-8f7b-7a55cc4636f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.119002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf891b4-ccb9-41be-8f7b-7a55cc4636f2 admin admin] PATH_INFO: `/v3/projects/513730d15b3b4f43a69ffee706c6786a/users/bd353ccc8e1d44caab8fc439570a9f1f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.121378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf891b4-ccb9-41be-8f7b-7a55cc4636f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513730d15b3b4f43a69ffee706c6786a, user_id=bd353ccc8e1d44caab8fc439570a9f1f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:25.127483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf891b4-ccb9-41be-8f7b-7a55cc4636f2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:25.136417 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1326/2641] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:25.144695 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1316/2642] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:24 2022] PUT /identity/v3/projects/513730d15b3b4f43a69ffee706c6786a/users/bd353ccc8e1d44caab8fc439570a9f1f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:25.150356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.150500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.150782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.157150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.157426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.157709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.211455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:25.212756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:25.213685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] MFA Rules not processed for user `bd353ccc8e1d44caab8fc439570a9f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:25.215145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:25.338428 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1317/2643] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:55:25.366544 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1327/2644] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:25.371308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:25.383886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349f17-dc3d-45fd-9608-fead7f7ca8d3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:25.391167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:25.395095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.395557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.396108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.397043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:25.397576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:25.399619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:25.422672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:25.433885 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1318/2645] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:25.435126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f094c7a-04ab-469b-8286-efb8f65967b6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:25.444049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:25.445915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.446420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.447530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.448531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:25.448792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:25.450769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:25.452540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:25.604903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1328/2646] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:25 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:25.608134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:25.628552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:25.633393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caeb4c-bbd1-4aa7-aa96-394731847400 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:25.797135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846151-008c-486d-80f9-cfa8bdb41d63 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:25.804898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:25.805740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.806945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.807618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.808974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:25.811890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:25.826593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:25.829339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:25.829638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:25.829949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:25.975424 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1329/2647] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:25 2022] POST /identity/v3/users => generated 297 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:25.975424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:25.979621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:26.012572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:26.014256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:26.036997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0587c3-7883-44d5-a525-3fff15f49f41 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:26.048116 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1319/2648] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:55:26.049053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:26.051574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:26.052331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.052707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.053078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] PATH_INFO: `/v3/projects/0be42bedb4074f93abad4f02e6c010bc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.055555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be42bedb4074f93abad4f02e6c010bc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:26.059809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:26.071067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d392025-4c6a-47f4-9136-e8a7984384e2 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:26.089530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:26.090209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.090493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.090769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.090901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:26.091424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:26.093161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:26.120971 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1320/2649] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:26.128064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:26.148671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576dd1b-8c07-4379-8fff-189d79695d81 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:26.175139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:26.175777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.176066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.176344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.177004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:26.178872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:26.204869 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1321/2650] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:26.206010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:26.256519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f1dd-439c-4ae4-9c44-2059944d96b0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:26.396946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be42bedb4074f93abad4f02e6c010bc', 'request_id': 'req-5f62962a-6567-4c9d-9794-6fcec4a51b47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:26.440478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be42bedb4074f93abad4f02e6c010bc', 'request_id': 'req-5f62962a-6567-4c9d-9794-6fcec4a51b47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:26.457102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be42bedb4074f93abad4f02e6c010bc', 'request_id': 'req-5f62962a-6567-4c9d-9794-6fcec4a51b47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:26.460088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e248-da4e-4209-a90b-ab07cede7782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:26.460590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e248-da4e-4209-a90b-ab07cede7782 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.461045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e248-da4e-4209-a90b-ab07cede7782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.461680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e248-da4e-4209-a90b-ab07cede7782 admin admin] PATH_INFO: `/v3/projects/3851e56c7da7403bb5a0ddced5d69ef2/users/92b43c6ed5a748d49b012891f65900f0/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.487987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077e248-da4e-4209-a90b-ab07cede7782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3851e56c7da7403bb5a0ddced5d69ef2, user_id=92b43c6ed5a748d49b012891f65900f0, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:26.491149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077e248-da4e-4209-a90b-ab07cede7782 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:26.603779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] The token cache is being invalidate because project 0be42bedb4074f93abad4f02e6c010bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:26.604197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:26.608217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:26.609061 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1330/2651] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:25 2022] DELETE /identity/v3/projects/0be42bedb4074f93abad4f02e6c010bc => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:26.611026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:26.613149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:26.627264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:26.627829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62962a-6567-4c9d-9794-6fcec4a51b47 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:26.634751 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1322/2652] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:26 2022] PUT /identity/v3/projects/3851e56c7da7403bb5a0ddced5d69ef2/users/92b43c6ed5a748d49b012891f65900f0/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:26.636494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32433e-11af-4780-8b2b-e5fd68a4c7cd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.637043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32433e-11af-4780-8b2b-e5fd68a4c7cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.637512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32433e-11af-4780-8b2b-e5fd68a4c7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.678011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5c32433e-11af-4780-8b2b-e5fd68a4c7cd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:26.680956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5c32433e-11af-4780-8b2b-e5fd68a4c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:26.789452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:26.793317 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1323/2653] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:26.794898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5983522-625f-4af2-9e6e-7410de4c2d1c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.795180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5983522-625f-4af2-9e6e-7410de4c2d1c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.795454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5983522-625f-4af2-9e6e-7410de4c2d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.798246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.798581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.798813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] PATH_INFO: `/v3/users/ba1e1b3d61304d42bf97608fa7b6bf6f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:26.800478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1e1b3d61304d42bf97608fa7b6bf6f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:26.806743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:26.864894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e5983522-625f-4af2-9e6e-7410de4c2d1c None None] MFA Rules not processed for user `92b43c6ed5a748d49b012891f65900f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:26.867246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e5983522-625f-4af2-9e6e-7410de4c2d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:26.985371 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1324/2654] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:26.987113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:26.987400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:26.987679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.011822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:27.013019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.022413 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1325/2655] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:27.023667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.025783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.042239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310a394-8048-476a-bee1-df6d83c2d456 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.048552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.049250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.049446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.049744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.050432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.052628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:27.082937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1e1b3d61304d42bf97608fa7b6bf6f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:27.083695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1e1b3d61304d42bf97608fa7b6bf6f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:27.187859 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1326/2656] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:27.188430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.216272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1e1b3d61304d42bf97608fa7b6bf6f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:27.219969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:27.230212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1e1b3d61304d42bf97608fa7b6bf6f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:27.234538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1e1b3d61304d42bf97608fa7b6bf6f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:27.266753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49726-e0c6-4f39-b0a9-4f0fe7d4dff8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.273581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.274428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.275482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.275924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.276763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:27.277277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.279232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569a38-7917-4ab4-98f7-43e1eecb9cef admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:27.282274 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1331/2657] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:26 2022] DELETE /identity/v3/users/ba1e1b3d61304d42bf97608fa7b6bf6f => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:27.283309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.285040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.298822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1327/2658] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:27.300280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.300573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.300849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.340278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:27.343436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.371635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6487750-a6d1-4d75-9088-8d166afdbcc1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.373327 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1328/2659] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:27.374938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.378006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.386668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ea8da-a778-45cf-8484-cc00e1721d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.387026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ea8da-a778-45cf-8484-cc00e1721d2f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.387306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ea8da-a778-45cf-8484-cc00e1721d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.387666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ea8da-a778-45cf-8484-cc00e1721d2f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.388400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ea8da-a778-45cf-8484-cc00e1721d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.390942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ea8da-a778-45cf-8484-cc00e1721d2f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:27.395911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c1810-ec47-4d6d-a75c-3b5c036a394d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.399116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:27.405086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.406203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.406660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.407088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.408212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.411316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:27.596392 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1332/2660] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/users => generated 303 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:27.596975 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1329/2661] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:27.597435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.599481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e826-230d-41a8-b78d-0b3c9dbd89a6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.600074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e826-230d-41a8-b78d-0b3c9dbd89a6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.600577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.600849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e826-230d-41a8-b78d-0b3c9dbd89a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.654616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cb93e826-230d-41a8-b78d-0b3c9dbd89a6 None None] MFA Rules not processed for user `283a6494676b42e3ab54787c038bb1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:27.657488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cb93e826-230d-41a8-b78d-0b3c9dbd89a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.745474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867990ea-4e84-46da-aa9a-f09124870ab7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.745474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.745474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.745474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.745937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.820300 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1333/2662] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:27.824507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6282-1278-4ef9-9353-84ee75a9f2c1 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.826593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6282-1278-4ef9-9353-84ee75a9f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.831685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6282-1278-4ef9-9353-84ee75a9f2c1 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.831685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1334/2663] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 19:55:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:55:27.831685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc6282-1278-4ef9-9353-84ee75a9f2c1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.893613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.895432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:27.919194 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1330/2664] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:27.920090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.946118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244f85-307a-4cdc-a2d8-46667a2127d5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.956008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6e15f-6773-48d0-bc09-af098fd1b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.956701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6e15f-6773-48d0-bc09-af098fd1b497 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.956983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6e15f-6773-48d0-bc09-af098fd1b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.957253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6e15f-6773-48d0-bc09-af098fd1b497 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.957950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6e15f-6773-48d0-bc09-af098fd1b497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.962546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6e15f-6773-48d0-bc09-af098fd1b497 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.023484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc6282-1278-4ef9-9353-84ee75a9f2c1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.038343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.039249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.039566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.039947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.041448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.043501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.060444 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1335/2665] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:28.061474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.063530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:28.081200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb07f-b9f7-4373-8191-bd1b3660eef7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.086868 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1331/2666] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:28.092982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.093178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.093280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.093561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.094035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.094415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.094961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.096441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.098670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.131177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] MFA Rules not processed for user `c56d2d2a803e41b894ab6417646db98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:28.133649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:28.201141 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1336/2667] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:28 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:28.202255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.257287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1332/2668] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 19:55:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:28.258506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.271808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a631-0c91-404f-bd11-6d65d18619a8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.340067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:28.380622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.380622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.380622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.380622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.381150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4399fe-2e45-4b99-aafa-c28f00519056 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.381248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.382573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.396286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.397187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.397593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.397959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] PATH_INFO: `/v3/projects/882b3a641774425b872d09e83fa3a741/users/073325bec0454d7bb6fd534736027ce1/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.405522 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1333/2669] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:28.405522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.421188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350d63b-6660-42e6-950b-cab33b253d09 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.429948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.430425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.430861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.431332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.432635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.435179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.451877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882b3a641774425b872d09e83fa3a741, user_id=073325bec0454d7bb6fd534736027ce1, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.454983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.565289 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1337/2670] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:28 2022] PUT /identity/v3/projects/882b3a641774425b872d09e83fa3a741/users/073325bec0454d7bb6fd534736027ce1/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:28.567548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.567659 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1334/2671] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:28 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:28.568116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.573825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:28.582755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc375-c2c4-4797-916f-49de3874aeb1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.720152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.721329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.721329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.721742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.722635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.724369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.733552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa63f-363c-43f5-971c-ef14fe70aa87 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.740010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.740884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.741262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.741633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.746471 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1335/2672] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:28.748570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.755584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.759030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.770557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046430b1-8032-46b4-9e5a-3788fbc58851 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.776953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.777628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.778103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.778485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.778992 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1338/2673] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:28.779179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.781387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.781861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.793386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24058ed-ef11-4bcb-9275-e4297ebc7730 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.797433 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1336/2674] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:28.797433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.806969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.808235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.809500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0cd7-362e-4cdb-8529-6ef23c9f4625 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.810672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.811090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.813917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.815482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.820035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.821006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.823776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.823776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] PATH_INFO: `/v3/projects/bb88895db2fb4ed8b6430bdb5f16c3a6/users/b098e419f4d240d5b5e3c359dd49a787/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.830710 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1339/2675] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:28.831597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.846653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64db83a-37b9-4efa-bc18-111e6e388b97 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.848346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb88895db2fb4ed8b6430bdb5f16c3a6, user_id=b098e419f4d240d5b5e3c359dd49a787, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.854258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.854503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d9c5-9138-4e90-a59d-051ee88a6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.855309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d9c5-9138-4e90-a59d-051ee88a6161 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.855599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d9c5-9138-4e90-a59d-051ee88a6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.855915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d9c5-9138-4e90-a59d-051ee88a6161 admin admin] PATH_INFO: `/v3/projects/eab82775bb01462ab92667ed241cd7bf/users/ee02dc912e4f428fbcecca4bb833fabe/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.885515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8d9c5-9138-4e90-a59d-051ee88a6161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab82775bb01462ab92667ed241cd7bf, user_id=ee02dc912e4f428fbcecca4bb833fabe, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.888614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8d9c5-9138-4e90-a59d-051ee88a6161 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.948165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:28.954726 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1337/2676] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:28 2022] PUT /identity/v3/projects/bb88895db2fb4ed8b6430bdb5f16c3a6/users/b098e419f4d240d5b5e3c359dd49a787/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:28.956143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.993051 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1340/2677] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:28 2022] PUT /identity/v3/projects/eab82775bb01462ab92667ed241cd7bf/users/ee02dc912e4f428fbcecca4bb833fabe/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:28.995024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.995159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.995431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.024344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:29.025623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:29.110448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4621791-0020-499b-84aa-bedf8311e6f5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:29.148398 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1341/2678] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:29.149435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:29.168392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051fa0-776b-4c2b-bdd0-7138eec152a2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:29.176846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:29.177921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.178594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.179133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] PATH_INFO: `/v3/projects/882b3a641774425b872d09e83fa3a741/users/073325bec0454d7bb6fd534736027ce1/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.182108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882b3a641774425b872d09e83fa3a741, user_id=073325bec0454d7bb6fd534736027ce1, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:29.185380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61e145-81de-46f9-83d1-a8a120ad9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:29.185660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:29.186085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61e145-81de-46f9-83d1-a8a120ad9a0b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.186373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61e145-81de-46f9-83d1-a8a120ad9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.186649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61e145-81de-46f9-83d1-a8a120ad9a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.187369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61e145-81de-46f9-83d1-a8a120ad9a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:29.190048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61e145-81de-46f9-83d1-a8a120ad9a0b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:29.209738 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1338/2679] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:28 2022] PUT /identity/v3/projects/882b3a641774425b872d09e83fa3a741/users/073325bec0454d7bb6fd534736027ce1/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:29.210761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:29.210925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1342/2680] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:29.212680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.213016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.213660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.255073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] MFA Rules not processed for user `073325bec0454d7bb6fd534736027ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:29.262748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:29.303659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c720-3950-4d10-aae5-f36e1ad93020 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:29.313789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:29.326315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.326608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.330581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.391899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1343/2681] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:29.392824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:29.444251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:29.446150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:29.463968 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1339/2682] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:29.465422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:29.477511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:29.497775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480af9f-2037-4405-a480-777485997d7b service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:29.500778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d00a-4abd-4e3e-8ac6-2953077b118f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:29.505771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:29.506800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.507191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.507576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] PATH_INFO: `/v3/projects/641a543e08bc48e884e4e10b41256cb7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.507945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806ef45-1984-467a-b383-feb1dea5aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:29.508892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806ef45-1984-467a-b383-feb1dea5aa7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.509238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641a543e08bc48e884e4e10b41256cb7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:29.509641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806ef45-1984-467a-b383-feb1dea5aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.510099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806ef45-1984-467a-b383-feb1dea5aa7f admin admin] PATH_INFO: `/v3/projects/eab82775bb01462ab92667ed241cd7bf/users/ee02dc912e4f428fbcecca4bb833fabe/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.512471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:29.512655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806ef45-1984-467a-b383-feb1dea5aa7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab82775bb01462ab92667ed241cd7bf, user_id=ee02dc912e4f428fbcecca4bb833fabe, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:29.515611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806ef45-1984-467a-b383-feb1dea5aa7f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:29.529068 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1344/2683] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:29 2022] PUT /identity/v3/projects/eab82775bb01462ab92667ed241cd7bf/users/ee02dc912e4f428fbcecca4bb833fabe/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:29.533403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:29.533403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:29.533403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:29.553348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] MFA Rules not processed for user `92b43c6ed5a748d49b012891f65900f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:29.554903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:29.662029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1345/2684] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:29.681493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:29.684938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:29.755394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641a543e08bc48e884e4e10b41256cb7', 'request_id': 'req-a1d6aac3-db65-41dc-accc-675c4cedc490'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:29.781623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641a543e08bc48e884e4e10b41256cb7', 'request_id': 'req-a1d6aac3-db65-41dc-accc-675c4cedc490'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:29.797679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641a543e08bc48e884e4e10b41256cb7', 'request_id': 'req-a1d6aac3-db65-41dc-accc-675c4cedc490'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:29.850817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f44b-24cd-4c32-b16d-0bff500f1a93 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:29.864502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] The token cache is being invalidate because project 641a543e08bc48e884e4e10b41256cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:29.864990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:29.866022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:29.870614 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1340/2685] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:29 2022] DELETE /identity/v3/projects/641a543e08bc48e884e4e10b41256cb7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:29.875689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:29.878211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:30.024305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6aac3-db65-41dc-accc-675c4cedc490 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:30.029416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:30.030628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:30.031109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:30.031677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:30.034855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:30.044197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:30.045551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:30.049953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:30.050971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] PATH_INFO: `/v3/users/bd353ccc8e1d44caab8fc439570a9f1f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:30.053393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd353ccc8e1d44caab8fc439570a9f1f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:30.055438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:30.202418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:30.204345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:30.206389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:30.233626 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1346/2686] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:30.330879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd353ccc8e1d44caab8fc439570a9f1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:30.356884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd353ccc8e1d44caab8fc439570a9f1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:30.367897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd353ccc8e1d44caab8fc439570a9f1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:30.369372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd353ccc8e1d44caab8fc439570a9f1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:30.370138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-63c80341-9446-47bc-9794-8e84478a51d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd353ccc8e1d44caab8fc439570a9f1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:30.411715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:30.481215 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1341/2687] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:29 2022] DELETE /identity/v3/users/bd353ccc8e1d44caab8fc439570a9f1f => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:31.733606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:32.284799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:32.302944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c27ba-3a79-4af2-92a7-9facde109a73 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:32.437546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:32.439542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.440393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.441323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] PATH_INFO: `/v3/projects/513730d15b3b4f43a69ffee706c6786a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.442901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] RBAC: Authorizing `identity:delete_project(project_id=513730d15b3b4f43a69ffee706c6786a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:32.446072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:32.660781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513730d15b3b4f43a69ffee706c6786a', 'request_id': 'req-458c4ce4-f949-4716-89a1-966cf85714db'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.676243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513730d15b3b4f43a69ffee706c6786a', 'request_id': 'req-458c4ce4-f949-4716-89a1-966cf85714db'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.686375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513730d15b3b4f43a69ffee706c6786a', 'request_id': 'req-458c4ce4-f949-4716-89a1-966cf85714db'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.795512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] The token cache is being invalidate because project 513730d15b3b4f43a69ffee706c6786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:32.796186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.799881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-458c4ce4-f949-4716-89a1-966cf85714db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.807433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.807917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.808000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.812287 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1347/2688] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:32 2022] DELETE /identity/v3/projects/513730d15b3b4f43a69ffee706c6786a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:32.813596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:32.845991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:32.851684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:32.990006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.990294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.990575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.999369 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1342/2689] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:33.013610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:33.016076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:33.032355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.038650 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1348/2690] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:33.046355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43f4a0-68de-4750-9710-f93b508fe9cc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.053322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.054239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.054786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.055281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.056738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:33.057455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.059456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.080468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.087738 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1343/2691] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:33.092626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65502a-6211-4c23-97d3-69020e979372 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.100122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.103224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.103475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.104172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.104888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.107728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.238619 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1349/2692] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:33 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:55:33.243020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.266548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8d0ac-0d57-4232-94bb-166d162226c9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.414720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:33.443404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.444066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.444352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.444621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.445326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.448572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.554768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.556932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:33.572800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1344/2693] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:33 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:33.581935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.616206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f07f-51a1-4f7b-be48-12bc17036471 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.631051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:33.645002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.645002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.645351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.648501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.649235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.655452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.685536 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1345/2694] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:33.686565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.706283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae617495-8827-465b-8b25-3a10060b1a90 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.720215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.721707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.722018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.723752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.725289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.726928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.750234 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1346/2695] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:33.756145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.767701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca0a62-8649-41e8-9cf7-102bb4eb762d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.779847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.780541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.781231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.781476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.783681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ae842-add3-4ff3-a2fa-d688257297c8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.789190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:33.798970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.799648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.799986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.800265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] PATH_INFO: `/v3/projects/fe663852a79b404398b07b33ea453ee0/users/3658a4da4c174ec49718f18181fdc017/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.818402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.820013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25101879-b8c6-4518-b395-a836974ddeaf service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.832239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe663852a79b404398b07b33ea453ee0, user_id=3658a4da4c174ec49718f18181fdc017, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.836643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.846232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1350/2696] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:55:34.059218 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1347/2697] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:33 2022] PUT /identity/v3/projects/fe663852a79b404398b07b33ea453ee0/users/3658a4da4c174ec49718f18181fdc017/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:34.063075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb603fe-df5a-48a8-ad79-6d205d33715a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:34.063360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb603fe-df5a-48a8-ad79-6d205d33715a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:34.063634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb603fe-df5a-48a8-ad79-6d205d33715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:34.091793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5fb603fe-df5a-48a8-ad79-6d205d33715a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:34.093027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5fb603fe-df5a-48a8-ad79-6d205d33715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:34.182686 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1351/2698] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:34.197111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:34.197111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:34.358186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd036-d19e-47e1-be4f-dc993f8d5912 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:34.373167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:34.375073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:34.375282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:34.382519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:34.411741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:34.413226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:34.431609 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1348/2699] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:36.157479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:36.768244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:38.099524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.102543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.104046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.139819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] MFA Rules not processed for user `122174705b7e43ac8f85a8b0160cd693`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:38.143013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:38.253663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:38.339260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1352/2700] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:38.883170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:38.888507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:38.915447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474dbd4-5729-49c4-a078-8e2b9ca870e2 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:38.927116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:38.928260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.929042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.929910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] PATH_INFO: `/v3/users/548435e7f5d7476ea9cf0a226e5cc652` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.934234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=548435e7f5d7476ea9cf0a226e5cc652)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:38.938061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:39.235246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548435e7f5d7476ea9cf0a226e5cc652'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:39.260836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548435e7f5d7476ea9cf0a226e5cc652'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:39.285640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548435e7f5d7476ea9cf0a226e5cc652'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:39.287216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548435e7f5d7476ea9cf0a226e5cc652'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:39.288382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548435e7f5d7476ea9cf0a226e5cc652'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:39.440185 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1349/2701] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:38 2022] DELETE /identity/v3/users/548435e7f5d7476ea9cf0a226e5cc652 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:39.876810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:40.478210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:40.502459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e976efc-3ff3-46ea-9604-d26b80fb925c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:40.612642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:40.613393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:40.613727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:40.614238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] PATH_INFO: `/v3/projects/5fa1cc87ef6548ef83ad4b014f4da077` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:40.615629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa1cc87ef6548ef83ad4b014f4da077)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:40.617681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:40.896170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa1cc87ef6548ef83ad4b014f4da077', 'request_id': 'req-e96aacc6-98c6-462e-9a07-2f2fe686248a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:40.905702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:40.926113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa1cc87ef6548ef83ad4b014f4da077', 'request_id': 'req-e96aacc6-98c6-462e-9a07-2f2fe686248a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:40.938722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa1cc87ef6548ef83ad4b014f4da077', 'request_id': 'req-e96aacc6-98c6-462e-9a07-2f2fe686248a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.027531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] The token cache is being invalidate because project 5fa1cc87ef6548ef83ad4b014f4da077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:41.029480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.030789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.036026 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1353/2702] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:40 2022] DELETE /identity/v3/projects/5fa1cc87ef6548ef83ad4b014f4da077 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:41.037196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:41.042412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:41.101365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6222f-fb2d-4f31-b325-27dcc7daf6ba admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:41.289269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:41.290888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:41.291453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:41.291958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] PATH_INFO: `/v3/users/d1a3ccdf99474015b2a826604ae7a315` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:41.296419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a3ccdf99474015b2a826604ae7a315)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:41.302253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:41.601694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a3ccdf99474015b2a826604ae7a315'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.636901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a3ccdf99474015b2a826604ae7a315'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.656375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a3ccdf99474015b2a826604ae7a315'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.657588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a3ccdf99474015b2a826604ae7a315'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.668351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a1d79fb0-b662-4cca-8d08-2d431dd1fef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a3ccdf99474015b2a826604ae7a315'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:41.757509 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1350/2703] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:41 2022] DELETE /identity/v3/users/d1a3ccdf99474015b2a826604ae7a315 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:42.283307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:43.262931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:43.264930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:43.287556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aacc6-98c6-462e-9a07-2f2fe686248a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:43.515783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:43.516434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:43.516893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:43.517324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] PATH_INFO: `/v3/projects/50fb8f5e5b324db4b4f5a1c131ed6fde` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:43.525122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fb8f5e5b324db4b4f5a1c131ed6fde)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:43.541213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:43.767321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:43.804012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fb8f5e5b324db4b4f5a1c131ed6fde', 'request_id': 'req-3afd992e-1fde-4216-927b-b3406bdea2c5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:43.826177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fb8f5e5b324db4b4f5a1c131ed6fde', 'request_id': 'req-3afd992e-1fde-4216-927b-b3406bdea2c5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:43.835968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fb8f5e5b324db4b4f5a1c131ed6fde', 'request_id': 'req-3afd992e-1fde-4216-927b-b3406bdea2c5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:43.952378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] The token cache is being invalidate because project 50fb8f5e5b324db4b4f5a1c131ed6fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:43.952688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:43.954473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3afd992e-1fde-4216-927b-b3406bdea2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:43.968913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1354/2704] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:43 2022] DELETE /identity/v3/projects/50fb8f5e5b324db4b4f5a1c131ed6fde => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:43.974084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:43.974799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:43.975082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.039914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:44.041930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:44.214152 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1351/2705] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:44.223715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.224008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.224334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.271286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:44.272585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:44.292446 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1355/2706] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:44.294373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:44.331115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bd363-2f90-4ce9-9dd5-f2c5a130786a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:44.362670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:44.365726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.366043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.371208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.371208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:44.371208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:44.373726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:44.403882 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1352/2707] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:44.409161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:44.434863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098036de-2328-46ca-b47d-1a95f7a15d15 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:44.450268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:44.454172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.455588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.456015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.457264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:44.461046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:44.551726 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1356/2708] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:44 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:44.556271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:44.567844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b6f73-4537-439c-bc1b-654d1cced2c9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:44.661815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:44.666485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.666485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.666485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.666485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:44.666485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:44.710416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:44.838902 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1353/2709] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:44 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:44.844410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:44.879797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e210-e083-4637-9845-f476793f013d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:44.890355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:44.891334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.891917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.892280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.900943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:44.903280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:44.961391 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1357/2710] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:44.966194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:44.981927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e029f-fb4e-4b71-acef-fee9ae6a912e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:45.020330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154c5c5-5ef6-4ba2-91f2-7363dcffbce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:45.021137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c5c5-5ef6-4ba2-91f2-7363dcffbce5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:45.021699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c5c5-5ef6-4ba2-91f2-7363dcffbce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:45.022210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c5c5-5ef6-4ba2-91f2-7363dcffbce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:45.023661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154c5c5-5ef6-4ba2-91f2-7363dcffbce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:45.029498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154c5c5-5ef6-4ba2-91f2-7363dcffbce5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:45.062276 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1354/2711] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:45.067289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:45.093644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea57e2f-d7f2-4381-9a0d-aae805f824e4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:45.101124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:45.101745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:45.102218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:45.102494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] PATH_INFO: `/v3/projects/c44a180227e34e98b3286a0fc80ff682/users/0ac7e2023485453a9c40dd7ff60381ac/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:45.123031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44a180227e34e98b3286a0fc80ff682, user_id=0ac7e2023485453a9c40dd7ff60381ac, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:45.130759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:45.268221 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1358/2712] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:45 2022] PUT /identity/v3/projects/c44a180227e34e98b3286a0fc80ff682/users/0ac7e2023485453a9c40dd7ff60381ac/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:45.280108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de01e-7cec-48bb-ae86-56d7bd4c6e69 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:45.280591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de01e-7cec-48bb-ae86-56d7bd4c6e69 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:45.281021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de01e-7cec-48bb-ae86-56d7bd4c6e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:45.390647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-915de01e-7cec-48bb-ae86-56d7bd4c6e69 None None] MFA Rules not processed for user `0ac7e2023485453a9c40dd7ff60381ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:45.392655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-915de01e-7cec-48bb-ae86-56d7bd4c6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:45.558822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1355/2713] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:45.559882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:45.631563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:45.632093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:45.632552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:45.690946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] MFA Rules not processed for user `214b5ab49764481c98a048528f3d2f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:45.695697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:45.732524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a987c-5050-4aaf-99aa-6af7b762501f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:45.744263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:45.745017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:45.745406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:45.745785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:45.746742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:45.753201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:45.855398 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1356/2714] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:45.954293 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1359/2715] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:45 2022] POST /identity/v3/projects => generated 393 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:45.956967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:45.972989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3e6b2-a10b-4268-866f-b0dc44136220 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:46.121593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:46.122283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:46.122571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:46.122847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:46.123497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:46.132976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:46.260474 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1357/2716] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:45 2022] POST /identity/v3/users => generated 303 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:46.262017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:46.279582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290519b-fd7d-419d-9651-b99704d30f5e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:46.292870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:46.293836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:46.294412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:46.295064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:46.295939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:46.299359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:46.320582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:46.338009 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1360/2717] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:46.338410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac796ce-2948-43eb-a7ec-cbf6eb49009a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:46.355802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:46.356823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:46.357104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:46.357392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] PATH_INFO: `/v3/projects/5a729e0496fb4bcd960994a3333345a8/users/5274d5ae480c423980f71343e383af44/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:46.383973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a729e0496fb4bcd960994a3333345a8, user_id=5274d5ae480c423980f71343e383af44, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:46.390179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:46.536477 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1358/2718] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:46 2022] PUT /identity/v3/projects/5a729e0496fb4bcd960994a3333345a8/users/5274d5ae480c423980f71343e383af44/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:46.540811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:46.563358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe6f6c-288a-4da0-85a2-0056aeed32b1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:46.682453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3678b1-599f-4858-a8b0-7056a00b9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:46.683379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3678b1-599f-4858-a8b0-7056a00b9bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:46.683834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3678b1-599f-4858-a8b0-7056a00b9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:46.684270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3678b1-599f-4858-a8b0-7056a00b9bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:46.685112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3678b1-599f-4858-a8b0-7056a00b9bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:46.686982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3678b1-599f-4858-a8b0-7056a00b9bd9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:46.704276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1361/2719] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:46.706059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:46.738561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf8de-73a3-4fbe-97b4-6c3ddd5284d6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:46.743530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74627aa6-deb4-46a0-b514-e6b5d50e7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:46.744580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74627aa6-deb4-46a0-b514-e6b5d50e7e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:46.744994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74627aa6-deb4-46a0-b514-e6b5d50e7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:46.745372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74627aa6-deb4-46a0-b514-e6b5d50e7e2e admin admin] PATH_INFO: `/v3/projects/5a729e0496fb4bcd960994a3333345a8/users/5274d5ae480c423980f71343e383af44/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:46.751840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74627aa6-deb4-46a0-b514-e6b5d50e7e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a729e0496fb4bcd960994a3333345a8, user_id=5274d5ae480c423980f71343e383af44, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:46.770654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74627aa6-deb4-46a0-b514-e6b5d50e7e2e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:46.810435 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1359/2720] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:46 2022] PUT /identity/v3/projects/5a729e0496fb4bcd960994a3333345a8/users/5274d5ae480c423980f71343e383af44/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:46.812366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:46.812720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:46.813221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:46.867239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] MFA Rules not processed for user `5274d5ae480c423980f71343e383af44`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:46.869700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:47.020026 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1362/2721] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:47.201725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:47.618895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:47.619302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:47.619783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:47.682720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] MFA Rules not processed for user `ee02dc912e4f428fbcecca4bb833fabe`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:47.694013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:47.740476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:47.802991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:47.860265 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1360/2722] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:47.936798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e0ba-8ab4-4090-a392-029f47ecfe0d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:47.953866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:47.954796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:47.956004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:47.956004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] PATH_INFO: `/v3/users/0ac7e2023485453a9c40dd7ff60381ac` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:47.959188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac7e2023485453a9c40dd7ff60381ac)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:47.962210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:48.025328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:48.025328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:48.209522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c3abe-3819-499a-a554-dc4c9ef7fb83 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:48.229053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:48.229936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:48.230323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:48.230715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:48.235239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:48.243966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac7e2023485453a9c40dd7ff60381ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:48.245191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac7e2023485453a9c40dd7ff60381ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:48.356374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac7e2023485453a9c40dd7ff60381ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:48.382923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac7e2023485453a9c40dd7ff60381ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:48.382923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1ca64e2d-f224-40c0-9bf1-4fac71dcf920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac7e2023485453a9c40dd7ff60381ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:48.401559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:48.403451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4d4ae-05a5-49d3-8bb1-a2be9d7164d2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:48.417976 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1363/2723] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:47 2022] DELETE /identity/v3/users/0ac7e2023485453a9c40dd7ff60381ac => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:48.417976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:48.417976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:48.417976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:48.420010 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1361/2724] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:48.421689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8b368-41e7-4fc7-98de-b8e6203b5800 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:48.422124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8b368-41e7-4fc7-98de-b8e6203b5800 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:48.422590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8b368-41e7-4fc7-98de-b8e6203b5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:48.485680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] MFA Rules not processed for user `d0becfb3ce834310802d5a152e7de5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:48.487210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:48.505383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b6d8b368-41e7-4fc7-98de-b8e6203b5800 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:48.509864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b6d8b368-41e7-4fc7-98de-b8e6203b5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:48.640460 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1364/2725] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:48.705331 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1362/2726] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:48.715853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:48.717710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:48.861002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:48.923139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2ff4d-5fe4-47e6-9f61-3fb2090f143f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:48.934396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:48.935417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:48.935694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:48.936120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:48.958377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:48.960123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:48.989948 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1365/2727] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:49.602686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:49.603180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:49.603260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:49.689910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] MFA Rules not processed for user `b098e419f4d240d5b5e3c359dd49a787`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:49.697444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:49.876828 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1363/2728] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:50.312183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:50.314519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:50.384351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:50.524864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:50.530375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:50.533070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d09a-5417-4329-a8aa-53b3ae15df05 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:50.566656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b4544-f87b-49d1-8a5a-4e6cffd467bc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:50.569220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:50.575478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:50.575765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:50.577600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:50.578984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:50.579809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:50.581319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:50.581761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] PATH_INFO: `/v3/projects/c44a180227e34e98b3286a0fc80ff682` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:50.583379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44a180227e34e98b3286a0fc80ff682)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:50.586141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:50.618851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:50.624461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:50.674198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:50.679356 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1366/2729] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:50.863626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44a180227e34e98b3286a0fc80ff682', 'request_id': 'req-6a6a4e7e-4986-47d8-b416-6f68cf556c27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:50.887663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44a180227e34e98b3286a0fc80ff682', 'request_id': 'req-6a6a4e7e-4986-47d8-b416-6f68cf556c27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:50.899992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44a180227e34e98b3286a0fc80ff682', 'request_id': 'req-6a6a4e7e-4986-47d8-b416-6f68cf556c27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.044718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] The token cache is being invalidate because project c44a180227e34e98b3286a0fc80ff682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:51.046933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.049937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.057337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1364/2730] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:50 2022] DELETE /identity/v3/projects/c44a180227e34e98b3286a0fc80ff682 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:51.061824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:51.083635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c003ef-9efd-4320-85d7-a77f664859f6 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:51.271214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:51.272309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:51.272858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:51.273377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] PATH_INFO: `/v3/users/5274d5ae480c423980f71343e383af44` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:51.275315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5274d5ae480c423980f71343e383af44)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:51.278400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:51.610624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5274d5ae480c423980f71343e383af44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.611992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5274d5ae480c423980f71343e383af44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.725508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5274d5ae480c423980f71343e383af44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.746233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5274d5ae480c423980f71343e383af44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.749451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-468c2a77-b20a-4906-9133-8f40f3f51969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5274d5ae480c423980f71343e383af44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:51.837712 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1367/2731] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:51 2022] DELETE /identity/v3/users/5274d5ae480c423980f71343e383af44 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:52.985340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:53.532596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:54.053567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:54.059921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:54.112399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a4e7e-4986-47d8-b416-6f68cf556c27 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:54.235001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:54.236030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:54.236723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:54.237261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] PATH_INFO: `/v3/projects/5a729e0496fb4bcd960994a3333345a8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:54.239606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a729e0496fb4bcd960994a3333345a8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:54.244653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:54.317827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:54.318360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:54.318762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:54.396427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] MFA Rules not processed for user `3658a4da4c174ec49718f18181fdc017`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:54.397763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:54.455178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a729e0496fb4bcd960994a3333345a8', 'request_id': 'req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:54.465162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a729e0496fb4bcd960994a3333345a8', 'request_id': 'req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:54.475905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a729e0496fb4bcd960994a3333345a8', 'request_id': 'req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:54.558629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1368/2732] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:55:54.560226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:54.561880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:54.587541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] The token cache is being invalidate because project 5a729e0496fb4bcd960994a3333345a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:54.587864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:54.588546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8b58cc6-298e-4e55-966f-f0c7b6d8dc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:54.591662 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1365/2733] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:54 2022] DELETE /identity/v3/projects/5a729e0496fb4bcd960994a3333345a8 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:54.597787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:54.598122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:54.598378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:54.602470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03a95-e217-40fa-9c8f-3daf142e33db None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:54.631423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:54.631423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:54.681236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608357e-807d-4f41-a9d2-7ce1d3d0b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:54.683504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608357e-807d-4f41-a9d2-7ce1d3d0b319 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:54.683827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608357e-807d-4f41-a9d2-7ce1d3d0b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:54.684107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608357e-807d-4f41-a9d2-7ce1d3d0b319 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:54.684798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608357e-807d-4f41-a9d2-7ce1d3d0b319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:54.686859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608357e-807d-4f41-a9d2-7ce1d3d0b319 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:54.802895 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1369/2734] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:54 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:54.803388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1366/2735] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:54.804208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:54.804493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:54.804774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:54.807647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:54.808876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:54.838267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60f32d-f7f9-4459-9d32-2ec22b26a062 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:54.848173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:54.849338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:55.004153 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1370/2736] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:55.008431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.024967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfa294-9d35-4c1f-bf0d-21c4c17fae4c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.035827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.036646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.038678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.048086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.048785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.049069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.049465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.052784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.053500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.054608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:55.055079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.055764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.057534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.085876 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1371/2737] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:55:55.089796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.103629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf524c34-7c0b-4ada-94eb-35c64ca1fa4e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.129909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.131057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.131300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.131684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.133183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.138842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.233445 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1367/2738] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:54 2022] POST /identity/v3/users => generated 299 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:55:55.234470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.261359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1372/2739] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:55 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:55:55.262654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.276316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43dd9-1d65-4568-b170-b01fe30cd14f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.424990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:55.533975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:55.589098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.604334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.604872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.605355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.606554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.607125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd40ab-a5d4-47ea-9c1a-935f70f3ccbf admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.611500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.622032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.623039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.631453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.631453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.631453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.631453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.642965 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1368/2740] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:55.650615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.676021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3e70-e1b9-4b49-9348-3dbc06500b77 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.689816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.691185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.691185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.691185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] PATH_INFO: `/v3/projects/677d50dbfa3c41139841ed793e9465db/users/59ded61b602d4b44b5bd65a953863613/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.727020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677d50dbfa3c41139841ed793e9465db, user_id=59ded61b602d4b44b5bd65a953863613, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.730828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.808644 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1373/2741] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:55 2022] POST /identity/v3/users => generated 291 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:55.810072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.850216 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1369/2742] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:55 2022] PUT /identity/v3/projects/677d50dbfa3c41139841ed793e9465db/users/59ded61b602d4b44b5bd65a953863613/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:55.851376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.854904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37bc58-9c42-4833-9d4f-31cb2d4b05f6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.957205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.957937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.958398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.959166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.961557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.965261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.979438 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1374/2743] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:55.984236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:56.001680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2872bc-32a3-4c38-ae00-56bfe8d82b36 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:56.010050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:56.011042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:56.011605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:56.012065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:56.012908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:56.016495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:56.019415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97e01-8314-4c91-828d-f135d8cff481 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:56.034731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:56.035497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:56.035781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:56.036054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:56.036726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:56.038438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:56.051980 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1370/2744] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:56.058086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:56.074028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208222b-05bc-4127-a1e4-c3b9b885ab70 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:56.079310 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1375/2745] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:56.083315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56295751-af0e-4908-ab00-89164d96de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:56.084514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295751-af0e-4908-ab00-89164d96de9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:56.085869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:56.086407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295751-af0e-4908-ab00-89164d96de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:56.086683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295751-af0e-4908-ab00-89164d96de9f admin admin] PATH_INFO: `/v3/projects/677d50dbfa3c41139841ed793e9465db/users/59ded61b602d4b44b5bd65a953863613/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:56.089454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56295751-af0e-4908-ab00-89164d96de9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=677d50dbfa3c41139841ed793e9465db, user_id=59ded61b602d4b44b5bd65a953863613, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:56.093588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56295751-af0e-4908-ab00-89164d96de9f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:56.102542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30d24-dbf6-4a4c-a639-eb7ff0bf5fba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:56.127569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1371/2746] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:56 2022] PUT /identity/v3/projects/677d50dbfa3c41139841ed793e9465db/users/59ded61b602d4b44b5bd65a953863613/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:56.241584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:56.243691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:56.244146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:56.244922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] PATH_INFO: `/v3/projects/447dd4c9c96c4c37aea6dc33ab222a77/users/7cfed8c5d12c49c896f72135348d3437/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:56.269700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447dd4c9c96c4c37aea6dc33ab222a77, user_id=7cfed8c5d12c49c896f72135348d3437, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:56.274023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:56.431976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:56.432892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:56.434956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:56.436391 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1376/2747] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:56 2022] PUT /identity/v3/projects/447dd4c9c96c4c37aea6dc33ab222a77/users/7cfed8c5d12c49c896f72135348d3437/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:56.485582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] MFA Rules not processed for user `7cfed8c5d12c49c896f72135348d3437`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:56.487488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:56.641757 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1372/2748] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:56.646061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:56.752305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd670bc-d3f2-4e2b-af7a-282a91836228 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:56.759719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:56.761275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:56.761734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:56.762600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:56.764234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:56.766903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:56.830882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:56.884423 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1377/2749] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:56 2022] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:56.888519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:56.919179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b061c-2eaf-4406-ab73-5309e7666a63 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:57.048691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:57.050112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:57.051399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:57.053035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:57.053736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:57.060031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:57.173587 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1373/2750] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:56 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:57.178450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:57.192357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56054bdb-6614-4123-861d-a98bf99fcce1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:57.206071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:57.207997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:57.209779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:57.210540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:57.216458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:57.219081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:57.249350 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1378/2751] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:57.251788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:57.268991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cd9e8-4b3e-4b77-be93-7460c076999c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:57.288667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:57.289534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:57.289817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:57.290298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] PATH_INFO: `/v3/projects/99af6c40232b4ddaacbaa6b1f93fce56/users/b2f55ee3297549b98027cf8bb38b62c2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:57.334515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99af6c40232b4ddaacbaa6b1f93fce56, user_id=b2f55ee3297549b98027cf8bb38b62c2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:57.337296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:57.457207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1374/2752] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:57 2022] PUT /identity/v3/projects/99af6c40232b4ddaacbaa6b1f93fce56/users/b2f55ee3297549b98027cf8bb38b62c2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:57.468161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:57.484116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969eeace-5a78-4e3c-bcbf-029956164131 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:57.594734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded9d84-4ae8-4b90-bc34-4fbc3dbe9d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:57.595837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded9d84-4ae8-4b90-bc34-4fbc3dbe9d1f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:57.596498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded9d84-4ae8-4b90-bc34-4fbc3dbe9d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:57.596952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded9d84-4ae8-4b90-bc34-4fbc3dbe9d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:57.597915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded9d84-4ae8-4b90-bc34-4fbc3dbe9d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:57.600072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded9d84-4ae8-4b90-bc34-4fbc3dbe9d1f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:57.619913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1379/2753] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:57.622994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:57.655591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a91f7-bc8a-4cc0-9c52-dac0608845a5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:57.669685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:57.671828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:57.673007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:57.674508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] PATH_INFO: `/v3/projects/99af6c40232b4ddaacbaa6b1f93fce56/users/b2f55ee3297549b98027cf8bb38b62c2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:57.682379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99af6c40232b4ddaacbaa6b1f93fce56, user_id=b2f55ee3297549b98027cf8bb38b62c2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:57.685070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:57.698357 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1375/2754] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:57 2022] PUT /identity/v3/projects/99af6c40232b4ddaacbaa6b1f93fce56/users/b2f55ee3297549b98027cf8bb38b62c2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:57.710959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:57.717972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d7e02-fbe0-4684-8425-cab2c58436cb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:57.718645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d7e02-fbe0-4684-8425-cab2c58436cb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:57.720065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d7e02-fbe0-4684-8425-cab2c58436cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:57.763683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ed7d7e02-fbe0-4684-8425-cab2c58436cb None None] MFA Rules not processed for user `b2f55ee3297549b98027cf8bb38b62c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:57.765048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ed7d7e02-fbe0-4684-8425-cab2c58436cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:57.909634 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1380/2755] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:57.921608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:57.925231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:58.100889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb3a3-fd29-43c2-8228-523d01782708 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:58.123485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:58.124503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:58.125040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:58.125602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:58.138212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:58.140244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:58.160414 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1376/2756] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:58.669572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9810a8-3a68-45ae-8560-0a514531d75b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:58.670277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9810a8-3a68-45ae-8560-0a514531d75b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:58.670636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9810a8-3a68-45ae-8560-0a514531d75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:58.720018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-da9810a8-3a68-45ae-8560-0a514531d75b None None] MFA Rules not processed for user `283a6494676b42e3ab54787c038bb1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:58.721326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-da9810a8-3a68-45ae-8560-0a514531d75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:58.806467 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1381/2757] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:59.382123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:00.880313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:01.840155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:01.857904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089158cd-f669-4874-9842-68e504ee4078 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:01.864521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:01.865441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:01.865912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:01.866337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:01.869061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:01.973973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:01.977468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:02.009103 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1377/2758] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:02.032484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc395-bec6-44ad-9de5-abc204ba2b0a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:02.032960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc395-bec6-44ad-9de5-abc204ba2b0a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:02.033057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc395-bec6-44ad-9de5-abc204ba2b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:02.072825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f60cc395-bec6-44ad-9de5-abc204ba2b0a None None] MFA Rules not processed for user `92b43c6ed5a748d49b012891f65900f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:02.073604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f60cc395-bec6-44ad-9de5-abc204ba2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:02.239577 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1382/2759] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:02.332082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:02.425020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230831d1-cfa7-4600-af09-28374c76fd2c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:02.425020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230831d1-cfa7-4600-af09-28374c76fd2c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:02.425020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230831d1-cfa7-4600-af09-28374c76fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:02.472294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-230831d1-cfa7-4600-af09-28374c76fd2c None None] MFA Rules not processed for user `b098e419f4d240d5b5e3c359dd49a787`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:02.482410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-230831d1-cfa7-4600-af09-28374c76fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:02.540046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c756-6b07-4192-979e-f07c0874b79b service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:02.571897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:02.572165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:02.572536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:02.572891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] PATH_INFO: `/v3/users/7cfed8c5d12c49c896f72135348d3437` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:02.579537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfed8c5d12c49c896f72135348d3437)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:02.587921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:02.655000 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1383/2760] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:02.962688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfed8c5d12c49c896f72135348d3437'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:02.983498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfed8c5d12c49c896f72135348d3437'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:03.000907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfed8c5d12c49c896f72135348d3437'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:03.002034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfed8c5d12c49c896f72135348d3437'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:03.002814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfed8c5d12c49c896f72135348d3437'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:03.083107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1378/2761] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:56:02 2022] DELETE /identity/v3/users/7cfed8c5d12c49c896f72135348d3437 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:03.088584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:03.089213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:03.089213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:03.118748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:03.120122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:03.330899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1384/2762] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:03.382101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:03.385446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:03.388387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:03.579757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9647df-bfa4-4ee4-b465-fc0b7ef31a11 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:03.595107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:03.596030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:03.596474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:03.596953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:03.616423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:03.618811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:03.659099 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1379/2763] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:56:04.179882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:05.207279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:05.210031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:05.266336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599cd8-a09d-4300-bc83-332f60ef4919 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:05.284516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:05.286058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:05.286803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:05.287518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] PATH_INFO: `/v3/projects/447dd4c9c96c4c37aea6dc33ab222a77` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:05.291587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=447dd4c9c96c4c37aea6dc33ab222a77)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:05.295700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:05.463288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447dd4c9c96c4c37aea6dc33ab222a77', 'request_id': 'req-c9ebcade-3d21-44d1-9308-42d172b129ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:05.472239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447dd4c9c96c4c37aea6dc33ab222a77', 'request_id': 'req-c9ebcade-3d21-44d1-9308-42d172b129ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:05.482988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447dd4c9c96c4c37aea6dc33ab222a77', 'request_id': 'req-c9ebcade-3d21-44d1-9308-42d172b129ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:05.564336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] The token cache is being invalidate because project 447dd4c9c96c4c37aea6dc33ab222a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:56:05.565705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:05.567376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9ebcade-3d21-44d1-9308-42d172b129ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:05.571416 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1385/2764] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:56:05 2022] DELETE /identity/v3/projects/447dd4c9c96c4c37aea6dc33ab222a77 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:05.575333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:05.594901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153436d1-67e5-48d5-801a-7b07b6474076 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:05.725222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:05.728645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:05.728963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:05.729278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] PATH_INFO: `/v3/users/b2f55ee3297549b98027cf8bb38b62c2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:05.732139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f55ee3297549b98027cf8bb38b62c2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:05.734203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:06.061577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f55ee3297549b98027cf8bb38b62c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:06.083644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f55ee3297549b98027cf8bb38b62c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:06.097139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f55ee3297549b98027cf8bb38b62c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:06.097939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f55ee3297549b98027cf8bb38b62c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:06.098571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f55ee3297549b98027cf8bb38b62c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:06.585697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:06.624159 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1380/2765] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:56:05 2022] DELETE /identity/v3/users/b2f55ee3297549b98027cf8bb38b62c2 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:07.800620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:08.162432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:08.163041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:08.163136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:08.212985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] MFA Rules not processed for user `59ded61b602d4b44b5bd65a953863613`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:08.214931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:08.396464 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1386/2766] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:08.424833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:08.428127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:08.593843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82dfb-06fd-445b-ac67-e9d32c6eb77b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:08.609485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9564b-fa9d-45a2-a5a7-c1b9d6f0826b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:08.612646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9564b-fa9d-45a2-a5a7-c1b9d6f0826b service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:08.612646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9564b-fa9d-45a2-a5a7-c1b9d6f0826b service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:08.612646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9564b-fa9d-45a2-a5a7-c1b9d6f0826b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:08.634817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9564b-fa9d-45a2-a5a7-c1b9d6f0826b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:08.636422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9564b-fa9d-45a2-a5a7-c1b9d6f0826b service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:08.663124 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1381/2767] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:09.127768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:09.129436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:09.291607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:09.351151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:09.359153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390df7a-8696-4e13-9e4c-928181f5f013 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:09.384232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:09.384894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:09.385175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:09.385452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] PATH_INFO: `/v3/projects/99af6c40232b4ddaacbaa6b1f93fce56` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:09.395809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99af6c40232b4ddaacbaa6b1f93fce56)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:09.397771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:09.619978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99af6c40232b4ddaacbaa6b1f93fce56', 'request_id': 'req-dbf5bb6a-60ee-428e-b395-6f34182d18a4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:09.634093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99af6c40232b4ddaacbaa6b1f93fce56', 'request_id': 'req-dbf5bb6a-60ee-428e-b395-6f34182d18a4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:09.662967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99af6c40232b4ddaacbaa6b1f93fce56', 'request_id': 'req-dbf5bb6a-60ee-428e-b395-6f34182d18a4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:09.796976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] The token cache is being invalidate because project 99af6c40232b4ddaacbaa6b1f93fce56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:56:09.797564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:09.802323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf5bb6a-60ee-428e-b395-6f34182d18a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:09.808084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1387/2768] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:56:09 2022] DELETE /identity/v3/projects/99af6c40232b4ddaacbaa6b1f93fce56 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:09.809708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:09.810179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:09.810557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:10.053330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:10.055232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:10.265484 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1382/2769] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:10.274690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:10.274990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:10.275469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:10.291851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:10.364567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:10.366949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:10.375170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:10.419827 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1388/2770] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:10.420708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:10.433495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1ecfc-a70b-4d07-a37e-8ea9cfa99ce0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:10.502175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:10.527592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:10.528595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:10.539922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:10.560068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:56:10.560749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:10.588320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:10.606300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:10.620768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:10.631940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cb8e7-bc20-494c-851d-f897837be3f3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:10.632197 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1383/2771] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:56:10.643067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:10.644771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:10.647813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:10.650743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:10.674095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:10.684038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:10.774117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:10.879690 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1389/2772] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:56:10 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:10.884670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:10.901101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403c818-3f19-4e00-b4e5-d2a937592285 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:11.102548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:11.103115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:11.103451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:11.103762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:11.104791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:11.110644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:11.337103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:11.337820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1384/2773] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:56:10 2022] POST /identity/v3/users => generated 294 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:11.348464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b9fc-f4bc-48bf-a804-2e765f59b5c6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:11.360962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:11.361798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:11.362270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:11.362707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:11.363520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:11.369782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:11.396482 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1390/2774] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:56:11.397893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:11.413144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e72f1-0b31-48c0-b5b4-615c7b055a2c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:11.431604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08803831-4f82-4fea-a899-465a4b6b00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:11.431604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803831-4f82-4fea-a899-465a4b6b00d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:11.431604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803831-4f82-4fea-a899-465a4b6b00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:11.431604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803831-4f82-4fea-a899-465a4b6b00d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:11.432794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803831-4f82-4fea-a899-465a4b6b00d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:11.432794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803831-4f82-4fea-a899-465a4b6b00d1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:11.442514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:11.454999 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1385/2775] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:56:11.459648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:11.472788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdf194-f557-47cc-a16a-c1f1bc0b7ee9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:11.489772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:11.490803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:11.493806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:11.497890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] PATH_INFO: `/v3/projects/fd05b6bc00a9440ab5f616b86b649964/users/bd85627c70cb445cba203914dd07f1ab/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:11.545052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd05b6bc00a9440ab5f616b86b649964, user_id=bd85627c70cb445cba203914dd07f1ab, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:11.548226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:11.656751 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1391/2776] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:56:11 2022] PUT /identity/v3/projects/fd05b6bc00a9440ab5f616b86b649964/users/bd85627c70cb445cba203914dd07f1ab/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:11.664670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:11.665238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:11.665702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:11.762947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] MFA Rules not processed for user `bd85627c70cb445cba203914dd07f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:11.768420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:12.031477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:12.034769 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1386/2777] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:12.054259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:12.216440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:12.224133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548197b-8dcc-4723-bb1f-6b104faffb1f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:12.239662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:12.240617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:12.241199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:12.242849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:12.243722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:12.248571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:12.426937 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1392/2778] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:56:12 2022] POST /identity/v3/projects => generated 387 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:12.432007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:12.452529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598830c-d81d-4fad-abc5-cf1353c507c1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:12.692395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:12.692395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:12.694161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:12.694161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:12.694161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:12.696256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:12.869235 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1387/2779] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:56:12 2022] POST /identity/v3/users => generated 300 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:12.873092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:12.889797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c6169-9f44-4520-8a8e-6ca844497b92 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:12.906712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:12.907658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:12.907936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:12.908377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:12.910514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:12.923589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:12.964162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:12.965669 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1393/2780] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:56:12.976808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca55996-370e-4720-9b68-e5c377f6d681 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:12.994969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:12.995897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:12.996519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:12.997712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] PATH_INFO: `/v3/projects/f49d002177404193b2e546139b0bf40f/users/24083582a5484619a1055095e7d98f66/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:13.035151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49d002177404193b2e546139b0bf40f, user_id=24083582a5484619a1055095e7d98f66, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:13.040750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:13.133539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:13.133732 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1388/2781] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:56:12 2022] PUT /identity/v3/projects/f49d002177404193b2e546139b0bf40f/users/24083582a5484619a1055095e7d98f66/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:13.137933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:13.151999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de68d4c-9844-4253-9484-d34e1f794e6f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:13.280386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:13.434857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaef2e-4eb2-4ca5-a982-c8ec3c81dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:13.436139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaef2e-4eb2-4ca5-a982-c8ec3c81dcfd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:13.436601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaef2e-4eb2-4ca5-a982-c8ec3c81dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:13.437022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaef2e-4eb2-4ca5-a982-c8ec3c81dcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:13.437871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaef2e-4eb2-4ca5-a982-c8ec3c81dcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:13.439652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaef2e-4eb2-4ca5-a982-c8ec3c81dcfd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:13.478785 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1394/2782] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:56:13.482747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:13.497210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a47ff-2f11-46b0-9e0f-8344dd0cba4f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:13.527661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737e165-6430-4f96-9b62-ba948696d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:13.527661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e165-6430-4f96-9b62-ba948696d1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:13.527661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e165-6430-4f96-9b62-ba948696d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:13.527661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e165-6430-4f96-9b62-ba948696d1ae admin admin] PATH_INFO: `/v3/projects/f49d002177404193b2e546139b0bf40f/users/24083582a5484619a1055095e7d98f66/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:13.532334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737e165-6430-4f96-9b62-ba948696d1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49d002177404193b2e546139b0bf40f, user_id=24083582a5484619a1055095e7d98f66, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:13.544793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737e165-6430-4f96-9b62-ba948696d1ae admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:13.582945 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1389/2783] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:56:13 2022] PUT /identity/v3/projects/f49d002177404193b2e546139b0bf40f/users/24083582a5484619a1055095e7d98f66/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:13.603314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:13.603598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:13.604068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:13.675909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] MFA Rules not processed for user `24083582a5484619a1055095e7d98f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:13.699936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:13.883288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a1011-797d-4574-8e4e-ff279cfb5e42 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:13.883575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a1011-797d-4574-8e4e-ff279cfb5e42 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:13.884038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a1011-797d-4574-8e4e-ff279cfb5e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:13.887596 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1395/2784] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:13.922280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b65a1011-797d-4574-8e4e-ff279cfb5e42 None None] MFA Rules not processed for user `bd85627c70cb445cba203914dd07f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:13.924188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b65a1011-797d-4574-8e4e-ff279cfb5e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:13.939927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:14.096815 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1390/2785] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:56:14.140652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:14.516482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:14.731892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:15.174722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:15.184294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:15.396003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be64fb5-b13f-498e-be96-f42f9e40e66c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:15.415472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:15.418617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:15.419186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:15.419768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:15.441445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:15.443394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:15.481911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:15.485953 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1396/2786] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:16.025900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:16.092706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:17.088634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:18.026235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:18.622466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:19.231292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:19.514392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:21.522402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:21.817384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:24.084942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:24.088628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:24.088628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:24.111079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:24.112319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:24.195960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1391/2787] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:24.236463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:24.421132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:24.425222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:24.519816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cc6e-db3d-4488-8f80-89cffa3fb997 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:24.526467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d817-e931-47ca-bed3-804a0bef6abe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:24.527256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d817-e931-47ca-bed3-804a0bef6abe service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:24.527740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d817-e931-47ca-bed3-804a0bef6abe service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:24.528184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d817-e931-47ca-bed3-804a0bef6abe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:24.539776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d817-e931-47ca-bed3-804a0bef6abe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:24.541375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d817-e931-47ca-bed3-804a0bef6abe service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:24.559726 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1397/2788] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:56:24.642853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:25.938852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:27.311056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:27.524521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:28.075945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:29.192511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:30.058613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:30.653652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:31.293742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:32.648155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:33.531025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:35.813658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:36.851061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:38.079926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:38.101929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2105a-c1f4-4726-8817-76270cd081d1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:38.113092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:38.114236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:38.114667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:38.115158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:38.127503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:38.129367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:38.168671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1392/2789] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:38.920665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:38.927270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:38.927270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:38.946784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] MFA Rules not processed for user `bd85627c70cb445cba203914dd07f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:38.949554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:38.967519 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1398/2790] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:56:41.046375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:41.047872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:41.066053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83fa60-5448-448f-8ad1-54c0424b608f service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:41.072771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:41.073509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:41.074111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:41.074111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:41.076087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:41.135295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:41.173231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:41.175443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb6b9-d887-4b9c-b025-42737d60adeb service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:41.189629 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1393/2791] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:42.053063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:42.057053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:42.088376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:42.173419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5e85c-ee02-4853-b50e-dfdf45c08c88 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:42.179140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:42.179785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:42.180075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:42.180339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] PATH_INFO: `/v3/users/92b43c6ed5a748d49b012891f65900f0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:42.181553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b43c6ed5a748d49b012891f65900f0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:42.183545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:42.412314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b43c6ed5a748d49b012891f65900f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:42.413844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b43c6ed5a748d49b012891f65900f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:42.482574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b43c6ed5a748d49b012891f65900f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:42.494494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b43c6ed5a748d49b012891f65900f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:42.495183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b43c6ed5a748d49b012891f65900f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:42.513580 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1399/2792] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:56:42 2022] DELETE /identity/v3/users/92b43c6ed5a748d49b012891f65900f0 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:42.518406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:42.519323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:42.519599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:42.550148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:42.551458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:42.640132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1394/2793] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:42.648061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:42.649616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:42.725733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85c23a-75f0-4d01-a71f-e971593b402e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:42.730211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:42.733871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:42.733871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:42.733871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:42.749538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:42.751730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:42.763847 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1400/2794] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:43.230147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:43.232438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:43.263033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3bbe-dad6-4437-8d28-c1c6c17ba447 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:43.268562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:43.269971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:43.270472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:43.270935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] PATH_INFO: `/v3/projects/3851e56c7da7403bb5a0ddced5d69ef2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:43.272932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3851e56c7da7403bb5a0ddced5d69ef2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:43.275490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:43.446076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3851e56c7da7403bb5a0ddced5d69ef2', 'request_id': 'req-db21f04a-8fdc-4abc-bbd5-d81a0e706377'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:43.451293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3851e56c7da7403bb5a0ddced5d69ef2', 'request_id': 'req-db21f04a-8fdc-4abc-bbd5-d81a0e706377'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:43.458530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3851e56c7da7403bb5a0ddced5d69ef2', 'request_id': 'req-db21f04a-8fdc-4abc-bbd5-d81a0e706377'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:43.541154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] The token cache is being invalidate because project 3851e56c7da7403bb5a0ddced5d69ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:56:43.541836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:43.542383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:43.545055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1395/2795] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:56:43 2022] DELETE /identity/v3/projects/3851e56c7da7403bb5a0ddced5d69ef2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:43.549466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:43.560965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c08c-8361-4bb5-a5e3-ca001d9b5cf5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:43.596364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:43.623188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:43.623826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:43.624106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:43.624384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] PATH_INFO: `/v3/users/073325bec0454d7bb6fd534736027ce1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:43.625538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073325bec0454d7bb6fd534736027ce1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:43.627489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:43.914455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073325bec0454d7bb6fd534736027ce1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:43.915251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073325bec0454d7bb6fd534736027ce1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.044866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073325bec0454d7bb6fd534736027ce1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.054303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073325bec0454d7bb6fd534736027ce1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.055062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e246af1b-c5dd-4172-b683-bed66ff3d443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073325bec0454d7bb6fd534736027ce1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.076336 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1401/2796] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:56:43 2022] DELETE /identity/v3/users/073325bec0454d7bb6fd534736027ce1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:44.462336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:44.465175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:44.485650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f04a-8fdc-4abc-bbd5-d81a0e706377 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:44.588383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:44.589016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:44.589465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:44.589741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] PATH_INFO: `/v3/projects/882b3a641774425b872d09e83fa3a741` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:44.591664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=882b3a641774425b872d09e83fa3a741)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:44.594119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:44.597148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:44.732608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882b3a641774425b872d09e83fa3a741', 'request_id': 'req-75aeee46-a3db-441b-9f17-d467930bccfb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.740295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882b3a641774425b872d09e83fa3a741', 'request_id': 'req-75aeee46-a3db-441b-9f17-d467930bccfb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.747617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882b3a641774425b872d09e83fa3a741', 'request_id': 'req-75aeee46-a3db-441b-9f17-d467930bccfb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.853124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] The token cache is being invalidate because project 882b3a641774425b872d09e83fa3a741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:56:44.853448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.854548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-75aeee46-a3db-441b-9f17-d467930bccfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:56:44.858306 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1396/2797] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:56:44 2022] DELETE /identity/v3/projects/882b3a641774425b872d09e83fa3a741 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:44.872245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:44.873097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:44.873602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:44.913625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:44.914898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:44.982111 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1402/2798] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:44.991311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e97a37-9564-4401-b569-954def4554ac None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:44.991738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e97a37-9564-4401-b569-954def4554ac None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:44.992077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e97a37-9564-4401-b569-954def4554ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.034497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-49e97a37-9564-4401-b569-954def4554ac None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:45.035900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49e97a37-9564-4401-b569-954def4554ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:45.044607 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1397/2799] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:45.049009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:45.059561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a8e85-7efa-4c1c-b631-98ed8e203195 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:45.065826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:45.066672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.067071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.067430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.068164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:56:45.068536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:45.071177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1f313-eb97-477e-bebc-d9337be56934 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:45.089415 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1403/2800] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:56:45.090272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e97a37-9564-4401-b569-954def4554ac None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:45.103863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e97a37-9564-4401-b569-954def4554ac None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:45.108878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:45.109493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.109825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.110389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.111417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:45.113782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:45.140967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.141427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.141779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.164021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] MFA Rules not processed for user `3658a4da4c174ec49718f18181fdc017`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:45.165164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:45.225462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1398/2801] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:56:45 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:45.226992 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1404/2802] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:56:45.229603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:45.335769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827cabc-8b00-4b0b-912b-daa957634d28 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:45.342183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:45.343292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.343468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.343964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.344806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:45.347551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:45.536472 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1399/2803] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:56:45 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:45.540923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:45.556998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309be21-ac22-4fed-82fe-629912823fa0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:45.568169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:45.569474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.569759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.570068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.570893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:45.574083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:45.595501 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1405/2804] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:56:45.597589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:45.612304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64d987-b0ed-4a0d-9596-731909727034 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:45.619546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd09a8-1a26-439a-b351-4cd8e6ca9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:45.620630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd09a8-1a26-439a-b351-4cd8e6ca9e36 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.621114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd09a8-1a26-439a-b351-4cd8e6ca9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.621605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd09a8-1a26-439a-b351-4cd8e6ca9e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.622612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd09a8-1a26-439a-b351-4cd8e6ca9e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:45.624440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd09a8-1a26-439a-b351-4cd8e6ca9e36 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:45.639008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1400/2805] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:56:45.643205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:45.654126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215485f9-4156-4553-947c-0713fd045dde admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:45.659238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:45.659991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.660206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.660487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] PATH_INFO: `/v3/projects/114c1dbf05024fb0b8c494a02b5f16fa/users/8582f801d90b499aba923a3ef99ff02c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.682313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=114c1dbf05024fb0b8c494a02b5f16fa, user_id=8582f801d90b499aba923a3ef99ff02c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:45.682313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:45.776667 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1406/2806] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:56:45 2022] PUT /identity/v3/projects/114c1dbf05024fb0b8c494a02b5f16fa/users/8582f801d90b499aba923a3ef99ff02c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:45.786690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:45.787058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:45.787399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:45.824840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:45.826757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:45.957891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1401/2807] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:56:45.958441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:46.049629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3a7eb-33c9-487b-b2ad-136acded2b5a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:46.056607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:46.058072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:46.058072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:46.058282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:46.059010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:46.062687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:46.339485 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1407/2808] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:56:45 2022] POST /identity/v3/projects => generated 381 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:46.347084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:46.364490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15391-9ed3-4c20-be41-7ec11841a710 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:46.467796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:46.470602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:46.470602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:46.470602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:46.470602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:46.474148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:46.603183 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1402/2809] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:56:46 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:56:46.607854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:46.632210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f522ca-d65f-49e3-a73e-23cdd4a7a3fe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:46.638461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:46.643341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:46.643341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:46.643341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:46.643341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:46.644614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:46.660985 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1408/2810] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:56:46.669749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:46.682519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2872d-73c0-4ef8-8e45-c1ceb6fe311d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:46.688367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:46.688725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:46.689096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:46.689511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] PATH_INFO: `/v3/projects/b1bc20806bbf4c91b45ecb8867ee7461/users/8cbec59587b44ff180559d69f307d66c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:46.713482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bc20806bbf4c91b45ecb8867ee7461, user_id=8cbec59587b44ff180559d69f307d66c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:46.718653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:46.778869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:46.828700 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1403/2811] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:56:46 2022] PUT /identity/v3/projects/b1bc20806bbf4c91b45ecb8867ee7461/users/8cbec59587b44ff180559d69f307d66c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:46.833608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:46.848915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102b32-f913-47fa-91a2-235be9b51948 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:47.007904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0135097-da4c-4ec4-9f01-8e99381125ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:47.007904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135097-da4c-4ec4-9f01-8e99381125ac admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:47.007904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135097-da4c-4ec4-9f01-8e99381125ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:47.007904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135097-da4c-4ec4-9f01-8e99381125ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:47.008739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0135097-da4c-4ec4-9f01-8e99381125ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:47.008739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0135097-da4c-4ec4-9f01-8e99381125ac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:47.022783 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1409/2812] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:56:47.023941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:47.041167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48db23-5c38-4f72-a74c-33cc7c4f215a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:47.049371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035a47-0d13-41e9-97f9-5fd477f7bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:47.050196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035a47-0d13-41e9-97f9-5fd477f7bf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:47.050637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035a47-0d13-41e9-97f9-5fd477f7bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:47.051063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035a47-0d13-41e9-97f9-5fd477f7bf0e admin admin] PATH_INFO: `/v3/projects/b1bc20806bbf4c91b45ecb8867ee7461/users/8cbec59587b44ff180559d69f307d66c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:47.060691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8814-b7ea-48d4-af40-51c6ffb962b7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:47.061751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8814-b7ea-48d4-af40-51c6ffb962b7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:47.062300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8814-b7ea-48d4-af40-51c6ffb962b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:47.076090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035a47-0d13-41e9-97f9-5fd477f7bf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bc20806bbf4c91b45ecb8867ee7461, user_id=8cbec59587b44ff180559d69f307d66c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:47.097013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035a47-0d13-41e9-97f9-5fd477f7bf0e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:47.129262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5eaf8814-b7ea-48d4-af40-51c6ffb962b7 None None] MFA Rules not processed for user `214b5ab49764481c98a048528f3d2f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:47.130671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5eaf8814-b7ea-48d4-af40-51c6ffb962b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:47.143772 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1404/2813] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:56:47 2022] PUT /identity/v3/projects/b1bc20806bbf4c91b45ecb8867ee7461/users/8cbec59587b44ff180559d69f307d66c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:56:47.147651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:47.148094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:47.148683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:47.218352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] MFA Rules not processed for user `8cbec59587b44ff180559d69f307d66c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:47.219737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:47.256648 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1410/2814] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:47.338798 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1405/2815] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:47.351116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb693731-2659-4a7d-9ebb-fc4c00042efd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:47.351400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb693731-2659-4a7d-9ebb-fc4c00042efd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:47.351673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb693731-2659-4a7d-9ebb-fc4c00042efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:47.380818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:47.383599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fb693731-2659-4a7d-9ebb-fc4c00042efd None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:47.385390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb693731-2659-4a7d-9ebb-fc4c00042efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:47.471452 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1411/2816] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:47.483488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:47.484920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:47.586360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f61cb-9b00-4a5d-bc02-a442e4fdf8dd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:47.593791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:47.594555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:47.594904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:47.595251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:47.620486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:47.622295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:47.636951 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1406/2817] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:48.502599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:49.042620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:51.031412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:51.032008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:51.032119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:51.053463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:56:51.055769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:51.128111 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1412/2818] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:56:51.148064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:51.150399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:51.259456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be99513-9ec1-4c93-98e7-874e4ca46452 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:51.267999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290440c2-7ca3-4d64-a965-c3e0ffc178eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:51.268912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290440c2-7ca3-4d64-a965-c3e0ffc178eb service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:51.269415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290440c2-7ca3-4d64-a965-c3e0ffc178eb service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:51.270081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290440c2-7ca3-4d64-a965-c3e0ffc178eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:51.283400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290440c2-7ca3-4d64-a965-c3e0ffc178eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:51.286595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290440c2-7ca3-4d64-a965-c3e0ffc178eb service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:51.312914 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1407/2819] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:57:01.120587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=65 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:01.302702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=62 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:11.188837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:11.191344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:11.472684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d823-ccb5-4525-84e9-9be646440a46 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:11.477801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:11.478464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:11.478742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:11.479604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] PATH_INFO: `/v3/users/bd85627c70cb445cba203914dd07f1ab` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:11.480801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd85627c70cb445cba203914dd07f1ab)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:11.482958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:11.688981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd85627c70cb445cba203914dd07f1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:11.690661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd85627c70cb445cba203914dd07f1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:11.766520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd85627c70cb445cba203914dd07f1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:11.776726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd85627c70cb445cba203914dd07f1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:11.777479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd85627c70cb445cba203914dd07f1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:11.799617 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1413/2820] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:57:11 2022] DELETE /identity/v3/users/bd85627c70cb445cba203914dd07f1ab => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:11.804595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30826599-5687-4942-a94b-457c5677adcf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:11.808869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30826599-5687-4942-a94b-457c5677adcf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:11.809154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30826599-5687-4942-a94b-457c5677adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:11.848045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-30826599-5687-4942-a94b-457c5677adcf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:11.849530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-30826599-5687-4942-a94b-457c5677adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:11.931077 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1408/2821] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:11.941288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:11.942708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:11.970498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:12.047946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45801626-5829-460b-9762-b7b8f211b30b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:12.051726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:12.052963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:12.053240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:12.053511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:12.063133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:12.064561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:12.075328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1414/2822] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:12.417289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30826599-5687-4942-a94b-457c5677adcf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:12.419468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-30826599-5687-4942-a94b-457c5677adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:12.433277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30826599-5687-4942-a94b-457c5677adcf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:12.438290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:12.438932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:12.445365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:12.445365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] PATH_INFO: `/v3/projects/fd05b6bc00a9440ab5f616b86b649964` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:12.445365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd05b6bc00a9440ab5f616b86b649964)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:12.445365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:12.584503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd05b6bc00a9440ab5f616b86b649964', 'request_id': 'req-ceb9b33b-f363-4368-bc58-cd509ed2f55a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:12.590934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd05b6bc00a9440ab5f616b86b649964', 'request_id': 'req-ceb9b33b-f363-4368-bc58-cd509ed2f55a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:12.597971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd05b6bc00a9440ab5f616b86b649964', 'request_id': 'req-ceb9b33b-f363-4368-bc58-cd509ed2f55a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:12.767588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] The token cache is being invalidate because project fd05b6bc00a9440ab5f616b86b649964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:57:12.777936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:12.777936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:12.781764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:12.791986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1409/2823] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:57:12 2022] DELETE /identity/v3/projects/fd05b6bc00a9440ab5f616b86b649964 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:12.795509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871434d-6a86-48f8-a0c8-1a59395ceb11 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:12.913954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:12.914961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:12.915472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:12.915817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] PATH_INFO: `/v3/users/24083582a5484619a1055095e7d98f66` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:12.917115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24083582a5484619a1055095e7d98f66)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:12.919272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:13.122294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24083582a5484619a1055095e7d98f66'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.122903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24083582a5484619a1055095e7d98f66'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.254022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24083582a5484619a1055095e7d98f66'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.267342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24083582a5484619a1055095e7d98f66'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.269719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ca8f94b-90ee-411c-b055-2d5308fb505c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24083582a5484619a1055095e7d98f66'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.320498 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1415/2824] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:57:12 2022] DELETE /identity/v3/users/24083582a5484619a1055095e7d98f66 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:13.597138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:13.599270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:13.617773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b33b-f363-4368-bc58-cd509ed2f55a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:13.702057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:13.702625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:13.702913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:13.703190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] PATH_INFO: `/v3/projects/f49d002177404193b2e546139b0bf40f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:13.705750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49d002177404193b2e546139b0bf40f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:13.707426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:13.736530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:13.849447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49d002177404193b2e546139b0bf40f', 'request_id': 'req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.857098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49d002177404193b2e546139b0bf40f', 'request_id': 'req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:13.865210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49d002177404193b2e546139b0bf40f', 'request_id': 'req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:14.011984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] The token cache is being invalidate because project f49d002177404193b2e546139b0bf40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:57:14.016903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:14.016903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d05e5b7-a058-437a-bdeb-fd8eea1d39ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:14.016903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1410/2825] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:57:13 2022] DELETE /identity/v3/projects/f49d002177404193b2e546139b0bf40f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:14.020661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.021678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.022212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.030376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:14.083130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:14.084506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:14.149556 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1416/2826] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:57:14.157829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.158276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.158622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.195509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:14.195509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:14.195509 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1411/2827] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:14.198785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:14.210581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee5d6e-8622-4933-9acc-7352496262a7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:14.216152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:14.216911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.217264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.217697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.218907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:57:14.218907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:14.221120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:14.239497 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1417/2828] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:57:14.249260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:14.259142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d408-e378-4019-ac2e-56932fa6772c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:14.264781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:14.265490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.265814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.266760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.266913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:14.268999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:14.380704 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1412/2829] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:57:14 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:57:14.385020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:14.396679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5f45-b03c-4ee5-ba8c-c85211c030ca admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:14.510976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:14.512448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.513397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.513995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.515681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:14.517805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:14.651552 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1418/2830] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:57:14 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:57:14.652762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:14.665062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849f189-bfa7-41fa-ac3f-ec7198b485fb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:14.670259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:14.671176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.671628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.672060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.672963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:14.674774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:14.690109 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1413/2831] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:57:14.695887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:14.708764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc54a43-b6c6-41da-9ffb-7906e71731b0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:14.714721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4c49b-96bb-4402-bc9a-b0c65fe63163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:14.715566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4c49b-96bb-4402-bc9a-b0c65fe63163 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.716001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4c49b-96bb-4402-bc9a-b0c65fe63163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.716427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4c49b-96bb-4402-bc9a-b0c65fe63163 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.717343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4c49b-96bb-4402-bc9a-b0c65fe63163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:14.719136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4c49b-96bb-4402-bc9a-b0c65fe63163 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:14.734129 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1419/2832] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:57:14.738504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:14.749987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bf813-be64-47a4-95c7-d01a8eca3970 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:14.755402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:14.770258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.770635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.771602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] PATH_INFO: `/v3/projects/b17b22bb35cc4f958d5d71f17e8af7fd/users/c57647deea08499999217def99872956/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.806528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17b22bb35cc4f958d5d71f17e8af7fd, user_id=c57647deea08499999217def99872956, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:14.809252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:14.908865 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1414/2833] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:57:14 2022] PUT /identity/v3/projects/b17b22bb35cc4f958d5d71f17e8af7fd/users/c57647deea08499999217def99872956/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:57:14.911158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588120-b68e-4023-b25d-05888f6d1155 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:14.911795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588120-b68e-4023-b25d-05888f6d1155 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:14.912079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588120-b68e-4023-b25d-05888f6d1155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:14.948805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-54588120-b68e-4023-b25d-05888f6d1155 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:14.950575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54588120-b68e-4023-b25d-05888f6d1155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:15.064443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:15.102038 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1420/2834] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:15.123621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:15.125649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:15.231124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48d15-c0b5-439d-8043-34c6aad9d7d7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:15.236595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:15.237276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:15.238165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:15.238165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:15.250124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:15.251605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:15.264762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1415/2835] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:17.580193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551f67-a35a-4157-bb80-6c2a13dd5aca None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:17.581060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551f67-a35a-4157-bb80-6c2a13dd5aca None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:17.581773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551f67-a35a-4157-bb80-6c2a13dd5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:17.632159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e7551f67-a35a-4157-bb80-6c2a13dd5aca None None] MFA Rules not processed for user `d0becfb3ce834310802d5a152e7de5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:17.635198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e7551f67-a35a-4157-bb80-6c2a13dd5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:17.761980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1421/2836] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:25.259074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:26.538095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:26.541265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:26.695963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9ec75-753c-4423-8b23-4bc0c337e2b3 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:26.706727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:26.709334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:26.711056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:26.711731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:26.716415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:26.950177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:26.952519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6a96c-0aaa-4bbd-af50-31db703ee28e service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:26.996572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1416/2837] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:27.481573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:27.482201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:27.482422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:27.573591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] MFA Rules not processed for user `c57647deea08499999217def99872956`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:27.575301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:27.683815 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1422/2838] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:27.699898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a843-1310-49cd-bfa7-a9039450e00b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:27.701237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a843-1310-49cd-bfa7-a9039450e00b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:27.701715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a843-1310-49cd-bfa7-a9039450e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:27.756357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-34a0a843-1310-49cd-bfa7-a9039450e00b None None] MFA Rules not processed for user `c57647deea08499999217def99872956`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:27.762118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-34a0a843-1310-49cd-bfa7-a9039450e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:27.786994 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1417/2839] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:28.257104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:28.260276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:28.285473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda973f8-2142-4937-8ed2-2623cc55a20b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:28.293755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:28.294797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:28.295104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:28.295421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:28.308977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:28.311170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:28.335613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1423/2840] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:28.887902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:28.888947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:28.889345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:28.929346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:28.930874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:29.053698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1418/2841] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:57:35.201241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:35.201241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:35.240689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a37f0-85ce-447b-83e3-0f0d5bbcb53d service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:35.249224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:35.251658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:35.253542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:35.253958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] PATH_INFO: `/v3/users/b098e419f4d240d5b5e3c359dd49a787` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:35.256762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b098e419f4d240d5b5e3c359dd49a787)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:35.259337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:35.596134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b098e419f4d240d5b5e3c359dd49a787'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:35.596907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b098e419f4d240d5b5e3c359dd49a787'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:35.723743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b098e419f4d240d5b5e3c359dd49a787'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:35.735311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b098e419f4d240d5b5e3c359dd49a787'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:35.736895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14ad60a0-9a5b-4246-8441-ec0000f61646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b098e419f4d240d5b5e3c359dd49a787'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:35.741203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:35.832367 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1424/2842] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:57:35 2022] DELETE /identity/v3/users/b098e419f4d240d5b5e3c359dd49a787 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:36.655319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:36.671077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6cc4f-320f-49a3-b44f-c384d6b8c5aa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:36.715567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:36.805106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:36.805106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:36.806045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:36.806395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] PATH_INFO: `/v3/projects/bb88895db2fb4ed8b6430bdb5f16c3a6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:36.808213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb88895db2fb4ed8b6430bdb5f16c3a6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:36.810559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:36.989815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb88895db2fb4ed8b6430bdb5f16c3a6', 'request_id': 'req-6fe02d43-59f2-4c6a-82ff-465787c270c1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:36.996208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb88895db2fb4ed8b6430bdb5f16c3a6', 'request_id': 'req-6fe02d43-59f2-4c6a-82ff-465787c270c1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:37.005133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb88895db2fb4ed8b6430bdb5f16c3a6', 'request_id': 'req-6fe02d43-59f2-4c6a-82ff-465787c270c1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:37.111633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] The token cache is being invalidate because project bb88895db2fb4ed8b6430bdb5f16c3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:57:37.111929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:37.112639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fe02d43-59f2-4c6a-82ff-465787c270c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:57:37.114535 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1419/2843] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:57:36 2022] DELETE /identity/v3/projects/bb88895db2fb4ed8b6430bdb5f16c3a6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:37.119451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.119936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.120087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.146551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:37.147826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:37.213676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1425/2844] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:57:37.221815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.222052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.222370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.244080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:37.245612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:37.254913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1420/2845] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:37.259113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:37.269682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab6f4-d335-424b-a2c0-10e1d6538b8d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:37.275587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:37.276201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.276482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.276754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.277408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:57:37.277716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:37.279413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:37.296630 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1426/2846] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:57:37.298910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:37.309775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461694-121f-41fc-8d27-5dc1682e5222 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:37.316795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:37.317684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.318179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.318674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.319475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:37.322500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:37.455176 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1421/2847] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:57:37 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:57:37.456965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:37.484152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c43335-7c8f-490f-a560-aef05f3907d8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:37.596999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:37.598634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.599221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.599612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.600400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:37.603558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:37.748784 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1427/2848] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:57:37 2022] POST /identity/v3/users => generated 290 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:57:37.751699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:37.784003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f111c3a-d695-4909-9129-ba099f3e5c70 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:37.813081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:37.814180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.814691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.815186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.816237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:37.819565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:37.852857 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1422/2849] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:57:37.854650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:37.880639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae28903-81b2-46c0-a77f-c6a1e34c5cd3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:37.885949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e6fcc-30c7-4ccc-af73-91f4ec7e76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:37.887200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e6fcc-30c7-4ccc-af73-91f4ec7e76ad admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.887618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e6fcc-30c7-4ccc-af73-91f4ec7e76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.887866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e6fcc-30c7-4ccc-af73-91f4ec7e76ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.888528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e6fcc-30c7-4ccc-af73-91f4ec7e76ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:37.890198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e6fcc-30c7-4ccc-af73-91f4ec7e76ad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:37.914152 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1428/2850] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:57:37.915932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:37.933024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7248c-138f-4633-82c5-dbcf43cc9556 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:37.942940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:37.944870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:37.945540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:37.946101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] PATH_INFO: `/v3/projects/7ea8fec20f5940b986a3fc14b785cf05/users/7d2e6a93b433421095bd041f50f7071a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:37.983443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea8fec20f5940b986a3fc14b785cf05, user_id=7d2e6a93b433421095bd041f50f7071a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:37.986709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:38.102282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1423/2851] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:57:37 2022] PUT /identity/v3/projects/7ea8fec20f5940b986a3fc14b785cf05/users/7d2e6a93b433421095bd041f50f7071a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:57:38.106769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:38.107561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:38.108002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:38.146051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:38.147355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:38.244129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:38.271627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1429/2852] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:38.284764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:38.291681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:38.292009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:38.296072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:38.375918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70170-4419-4966-9aae-bb1e28944b9c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:38.378278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:38.380686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:38.381662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:38.382195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:38.382684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:38.393886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:38.395466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:38.406218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc5b4-f6ed-40b3-8c39-3cdbad83095c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:38.406595 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1430/2853] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:57:38.424244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:38.425117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:38.425117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:38.425384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:38.427908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:38.523875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:38.525832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:38.540603 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1424/2854] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:41.638755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:41.656945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8b82-7a44-4275-bb8c-0cda4130cfed service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:41.669732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:41.670481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:41.670771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:41.678691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:41.681344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:41.701139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:41.702799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:41.743171 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1431/2855] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:43.015976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:43.018071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:43.185676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65f855-7e5d-48ff-b98c-d00291b54798 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:43.192486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:43.193581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:43.194746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:43.195273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:43.198078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:43.224031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:43.227642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:43.258939 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1425/2856] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:44.075611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:44.078673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:44.095000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1687da-fd2c-4795-be39-d4b4297f05c6 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:44.106705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:44.107668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:44.108450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:44.109068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:44.112626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:44.135278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:44.137999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558437e-5cea-4242-b728-efcee58644c9 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:44.171471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1432/2857] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:57:45.033422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:45.034919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:45.053783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b236-5301-4e29-9956-b584580d3d60 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:45.059766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:45.060652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:45.061096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:45.061525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:45.064815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:45.094294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:45.096064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ff649-b50d-4fdc-9e11-fb18bf73df61 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:45.126208 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1426/2858] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:47.630156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:47.638083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:47.638083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:47.671151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] MFA Rules not processed for user `7d2e6a93b433421095bd041f50f7071a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:47.672850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:47.787390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2573b-ca7a-4376-ac5f-469cfabb0d00 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:47.788030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2573b-ca7a-4376-ac5f-469cfabb0d00 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:47.788030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2573b-ca7a-4376-ac5f-469cfabb0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:47.788180 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1433/2859] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:47.821779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-19c2573b-ca7a-4376-ac5f-469cfabb0d00 None None] MFA Rules not processed for user `7d2e6a93b433421095bd041f50f7071a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:47.826009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-19c2573b-ca7a-4376-ac5f-469cfabb0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:47.857544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1427/2860] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:48.029890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:48.050723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd143df-ac2e-40d6-83bc-4c1f649765f0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:48.062858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:48.064144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:48.064676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:48.065397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:48.075237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:48.077310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:48.108166 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1434/2861] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:48.241222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:48.242237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:48.242676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:48.285325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] MFA Rules not processed for user `283a6494676b42e3ab54787c038bb1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:48.286813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:48.378727 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1428/2862] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:55.046769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:55.065198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3680a-8ffe-446d-af88-e21994fe7217 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:55.070328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:55.071200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:55.071647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:55.072108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:55.089419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:55.111907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:55.113575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54038a92-a4c7-4d75-a024-2a55562d3a8a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:55.134489 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1435/2863] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:58.102390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:58.112615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:58.118587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb9f88-06c2-4921-9677-ced0499a6291 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:58.131776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:58.131776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:58.131776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:58.131776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:58.132273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:58.145321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:58.147525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:58.162890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1429/2864] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:59.618868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320defc9-9f2b-4076-84df-1f7fc5c7c5bd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:59.619429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320defc9-9f2b-4076-84df-1f7fc5c7c5bd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:59.619429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320defc9-9f2b-4076-84df-1f7fc5c7c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:59.664835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-320defc9-9f2b-4076-84df-1f7fc5c7c5bd None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:59.666175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-320defc9-9f2b-4076-84df-1f7fc5c7c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:59.686485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:59.743602 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1436/2865] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:59.790629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:59.792435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:59.879370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148d846-6e2a-4c2c-9c7f-0270c8f61321 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:59.887390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:59.888160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:59.888536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:59.888797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:59.902742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:59.904435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:59.905185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:59.905673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:59.906137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:59.914801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1430/2866] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:57:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:57:59.934529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:59.936249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:00.039810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1437/2867] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:58:08.870441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:08.894750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3124ed6-7d0f-47d2-a23b-6bbf85950c55 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:08.916833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:08.921149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:08.921769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:08.922323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:08.928469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:08.973673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:08.992356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc51a7-1ebf-449c-8e90-7524a9e15759 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:09.078012 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1431/2868] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:10.028422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=42 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:10.793538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:10.813276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa055e9-695c-4800-b260-a6402870b08f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:10.825052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:10.826014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:10.827594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:10.829173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:10.837990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:10.867830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:10.873032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:10.897210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1438/2869] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:58:18.060482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edeb3c-0585-4077-89c2-69189f183d93 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:18.061020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edeb3c-0585-4077-89c2-69189f183d93 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:18.061226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edeb3c-0585-4077-89c2-69189f183d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:18.103388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d4edeb3c-0585-4077-89c2-69189f183d93 None None] MFA Rules not processed for user `7d2e6a93b433421095bd041f50f7071a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:58:18.106492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d4edeb3c-0585-4077-89c2-69189f183d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:18.138770 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1432/2870] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:58:18.328387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:18.358952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fedd4-154a-434d-847e-1c7fb86d817a service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:18.378477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:18.382220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:18.382220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:18.382993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:18.393969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:18.558826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:18.561067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845154c7-a6cc-4468-b130-84f5fc3fefd1 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:18.614589 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1439/2871] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:58:19.465121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:19.466121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:19.466548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:19.496438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] MFA Rules not processed for user `122174705b7e43ac8f85a8b0160cd693`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:58:19.497991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:19.591455 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1433/2872] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:58:20.694406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:20.694995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:20.695365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:20.722714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:58:20.724205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:20.746022 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1440/2873] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:58:20.746873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:20.766835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde32da3-894d-4a82-b526-03dabf933044 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:20.774175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2774f-bd82-40c5-969d-dd95d3396fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:20.775202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2774f-bd82-40c5-969d-dd95d3396fd8 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:20.775730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2774f-bd82-40c5-969d-dd95d3396fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:20.776290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2774f-bd82-40c5-969d-dd95d3396fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:20.794786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2774f-bd82-40c5-969d-dd95d3396fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:20.797126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2774f-bd82-40c5-969d-dd95d3396fd8 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:20.830932 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1434/2874] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:58:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:58:20.909714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:20.927444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de419b0-cd02-436b-9d8c-591f4d08f1c1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:20.936803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:20.950869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:20.954835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:20.954835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:20.968256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:20.994729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:20.997104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:21.014213 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1441/2875] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:23.348623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df4ae7-f3b9-4d29-96f0-780f4b8203f8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:23.349123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df4ae7-f3b9-4d29-96f0-780f4b8203f8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:23.349226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df4ae7-f3b9-4d29-96f0-780f4b8203f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:23.452578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-25df4ae7-f3b9-4d29-96f0-780f4b8203f8 None None] MFA Rules not processed for user `c57647deea08499999217def99872956`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:58:23.454694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-25df4ae7-f3b9-4d29-96f0-780f4b8203f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:23.634648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:23.667556 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1435/2876] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:58:24.377296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:24.391641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdcc15-f3e1-4e8d-bf4f-721e68fac51b service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:24.402610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:24.403309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:24.403601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:24.403880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:24.407982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:24.439118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:24.448445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:24.470280 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1442/2877] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:32.562390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:32.563430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:32.563893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:32.618861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:58:32.620136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:32.636584 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1436/2878] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:58:34.465061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=49 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:42.594138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:46.158457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:46.158457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:46.266385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82848d4-261e-49c6-9f32-534dc680847f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:46.271186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:46.271913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:46.286852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:46.287145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:46.289876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:46.307803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:46.309331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee197c28-9989-46f4-9c29-93c32d0c103b service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:46.325626 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1443/2879] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:51.651001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:51.653473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:51.678095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c61a-d651-45bf-85c2-6baf959bbb0e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:51.697185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:51.698623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:51.699317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:51.699944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:51.702585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:51.835967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:51.838294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:51.862286 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1437/2880] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:56.317867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=26 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:57.106330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:57.106913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:57.107386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:57.135618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:58:57.137533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:57.147254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1444/2881] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:58:57.169662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:57.227036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb485a6-48c3-4d3b-9ffc-2accfec9f182 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:57.250384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:57.256879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:57.256879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:57.256879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:57.270741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:57.272987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:57.292729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1438/2882] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:58:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:59:00.262102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:00.276019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128e166-c03f-495f-95d3-c794814f90b2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:00.283246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:00.283917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:00.284457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:00.284457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:00.286937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:00.302209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:00.304548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d982b-14fd-49ab-b2ce-a6681c4109f9 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:00.319926 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1445/2883] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:02.434643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:02.460572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8c7f3-caab-425f-acd8-08f9c92b1a76 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:02.473339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:02.475916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:02.476560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:02.477075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:02.484727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:02.511251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:02.515151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:02.538616 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1439/2884] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:06.668831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:06.669512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:06.669512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:06.693710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:06.695035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:06.715856 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1446/2885] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:11.136748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:11.166926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbf133-6787-46ec-a9b1-2da5ff2c4e7b service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:11.171877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:11.174597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:11.175210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:11.176347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:11.180046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:11.207026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:11.209247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:11.263700 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1440/2886] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:12.528163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:12.541532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd892c1-4a98-4e11-8628-23d2e728b57c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:12.547999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:12.548998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:12.549930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:12.550037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] PATH_INFO: `/v3/users/7d2e6a93b433421095bd041f50f7071a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:12.551650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2e6a93b433421095bd041f50f7071a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:12.553776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:12.871424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2e6a93b433421095bd041f50f7071a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:12.877072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2e6a93b433421095bd041f50f7071a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:12.936743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2e6a93b433421095bd041f50f7071a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:12.951567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2e6a93b433421095bd041f50f7071a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:12.953730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-def331ca-cc0a-4988-8730-ce35ba921154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2e6a93b433421095bd041f50f7071a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:12.982681 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1447/2887] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:12 2022] DELETE /identity/v3/users/7d2e6a93b433421095bd041f50f7071a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:59:13.948987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:13.955580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=49 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:13.970525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830d4e9-9684-4b91-a785-e0adc2c60966 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:14.218547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:14.221522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:14.222307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:14.223117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] PATH_INFO: `/v3/projects/7ea8fec20f5940b986a3fc14b785cf05` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:14.228814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea8fec20f5940b986a3fc14b785cf05)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:14.228814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:14.429472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea8fec20f5940b986a3fc14b785cf05', 'request_id': 'req-25d14f1c-d3a3-492a-9970-54513b791201'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:14.442951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea8fec20f5940b986a3fc14b785cf05', 'request_id': 'req-25d14f1c-d3a3-492a-9970-54513b791201'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:14.450760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea8fec20f5940b986a3fc14b785cf05', 'request_id': 'req-25d14f1c-d3a3-492a-9970-54513b791201'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:14.535479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] The token cache is being invalidate because project 7ea8fec20f5940b986a3fc14b785cf05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:14.535479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:14.535825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25d14f1c-d3a3-492a-9970-54513b791201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:14.548537 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1441/2888] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:13 2022] DELETE /identity/v3/projects/7ea8fec20f5940b986a3fc14b785cf05 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:14.548640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:14.548640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:14.548640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:14.603898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:14.609216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:14.765985 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1448/2889] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:14.776316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:14.776951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:14.777422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:14.824723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:14.828589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:14.848315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1442/2890] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:14.854464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:14.876856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ba595-fc1c-43c7-a538-24ad77f27310 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:14.900976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:14.902194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:14.902881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:14.903390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:14.904345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:59:14.904905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:14.908106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:14.960251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1449/2891] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:59:14.967076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:14.984107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef7f0c-f0e9-4c8e-bd67-446a20f7a220 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:15.003458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:15.004605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:15.005134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:15.008040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:15.009417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:15.014379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:15.192482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1443/2892] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:59:14 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:15.194671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:15.218163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3c5a-bbe0-4a82-8f9f-ac1642aa5cad admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:15.306186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:15.375170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:15.376424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:15.377562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:15.377885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:15.378553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:15.382931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:15.603100 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1450/2893] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:59:15 2022] POST /identity/v3/users => generated 291 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:59:15.607446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:15.628384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e384235-f0e1-46fb-8d09-15516f06a553 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:15.648746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:15.649517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:15.649802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:15.650108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:15.650768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:15.660345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:15.691098 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1444/2894] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:15.703089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:15.724477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773e8f8-c88b-4c75-bbfb-679bf2bf195d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:15.746959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450bd86-65ba-43ac-8d57-bed3a7c19713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:15.747615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bd86-65ba-43ac-8d57-bed3a7c19713 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:15.750117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bd86-65ba-43ac-8d57-bed3a7c19713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:15.750604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bd86-65ba-43ac-8d57-bed3a7c19713 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:15.755664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450bd86-65ba-43ac-8d57-bed3a7c19713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:15.758204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450bd86-65ba-43ac-8d57-bed3a7c19713 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:15.790179 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1451/2895] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:15.794724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:15.815325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d831-8339-4ff8-a273-8bf66eb350f2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:15.828683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:15.829693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:15.830357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:15.831006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] PATH_INFO: `/v3/projects/bdde347dfb5b40d5b3f7d1da61f062c2/users/1672b0b7c93c4959a3e803902333f823/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:15.872618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdde347dfb5b40d5b3f7d1da61f062c2, user_id=1672b0b7c93c4959a3e803902333f823, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:15.883545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:15.983885 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1445/2896] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:59:15 2022] PUT /identity/v3/projects/bdde347dfb5b40d5b3f7d1da61f062c2/users/1672b0b7c93c4959a3e803902333f823/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:15.986587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:15.986877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:15.987383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:16.041504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:16.043382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:16.192102 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1452/2897] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:16.228509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:16.230376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:16.277521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:16.317328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3afd0-aee8-4720-ae2a-e64a20c2936f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:16.323131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:16.324364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:16.325511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:16.326108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:16.361256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:16.363602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:16.392177 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1446/2898] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:59:25.111081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:25.113131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:25.217095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c035-71ab-40b4-878f-f8dff05519f6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:25.226052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:25.226979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:25.227458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:25.228071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:25.230986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:25.269425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:25.276861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:25.324143 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1453/2899] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:25.511615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:25.515431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:25.559128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877e172-5d57-48ec-a8b3-4643470f4f12 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:25.587984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:25.588683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:25.588909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:25.589220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] PATH_INFO: `/v3/users/283a6494676b42e3ab54787c038bb1b6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:25.594932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283a6494676b42e3ab54787c038bb1b6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:25.602983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:25.897713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283a6494676b42e3ab54787c038bb1b6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:25.947545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283a6494676b42e3ab54787c038bb1b6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:25.958588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283a6494676b42e3ab54787c038bb1b6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:25.959216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283a6494676b42e3ab54787c038bb1b6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:25.959835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283a6494676b42e3ab54787c038bb1b6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:26.104949 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1447/2900] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:25 2022] DELETE /identity/v3/users/283a6494676b42e3ab54787c038bb1b6 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:26.639428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:26.644404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72ee9-7ebc-4ab5-9a67-f6c0641272b7 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:26.740547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:26.761770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:26.762597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:26.762880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:26.763407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] PATH_INFO: `/v3/projects/9eb35c63e2914408b189d0d4ec9fc76c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:26.764388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb35c63e2914408b189d0d4ec9fc76c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:26.766716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:26.910112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb35c63e2914408b189d0d4ec9fc76c', 'request_id': 'req-6807d04f-951d-4712-8fde-ce6bc86d9e28'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:26.927329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb35c63e2914408b189d0d4ec9fc76c', 'request_id': 'req-6807d04f-951d-4712-8fde-ce6bc86d9e28'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:26.941039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb35c63e2914408b189d0d4ec9fc76c', 'request_id': 'req-6807d04f-951d-4712-8fde-ce6bc86d9e28'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.029129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] The token cache is being invalidate because project 9eb35c63e2914408b189d0d4ec9fc76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:27.029736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.030928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.035005 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1454/2901] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:26 2022] DELETE /identity/v3/projects/9eb35c63e2914408b189d0d4ec9fc76c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:27.039139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:27.040735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:27.059309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f463a2-6907-4aad-b4ef-afc056678ba5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:27.146438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:27.149457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:27.177078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:27.181667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:27.181667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:27.181667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] PATH_INFO: `/v3/users/ee02dc912e4f428fbcecca4bb833fabe` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:27.181667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee02dc912e4f428fbcecca4bb833fabe)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:27.183389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:27.271697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807d04f-951d-4712-8fde-ce6bc86d9e28 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:27.278000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:27.278657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:27.278935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:27.279522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] PATH_INFO: `/v3/users/d0becfb3ce834310802d5a152e7de5ee` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:27.280779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0becfb3ce834310802d5a152e7de5ee)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:27.283319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:27.498836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:27.502398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee02dc912e4f428fbcecca4bb833fabe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.522646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee02dc912e4f428fbcecca4bb833fabe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.532406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee02dc912e4f428fbcecca4bb833fabe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.533250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee02dc912e4f428fbcecca4bb833fabe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.534947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-071ebe6a-eb6a-4b82-870b-58523f250b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee02dc912e4f428fbcecca4bb833fabe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.571496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0becfb3ce834310802d5a152e7de5ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.572332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0becfb3ce834310802d5a152e7de5ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.608551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1448/2902] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:27 2022] DELETE /identity/v3/users/ee02dc912e4f428fbcecca4bb833fabe => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:27.684918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0becfb3ce834310802d5a152e7de5ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.695902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0becfb3ce834310802d5a152e7de5ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.697437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0becfb3ce834310802d5a152e7de5ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:27.723867 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1455/2903] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:27 2022] DELETE /identity/v3/users/d0becfb3ce834310802d5a152e7de5ee => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:27.728303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:27.728600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:27.728863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:27.752015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:27.753445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:27.787914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:27.834613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1449/2904] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:27.923658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:27.925485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:28.014510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec998070-9623-4eb2-890d-b46b10e67ad4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:28.021978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc417f-2185-4ce7-8965-9f1ce56cc68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:28.023331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc417f-2185-4ce7-8965-9f1ce56cc68d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:28.023613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc417f-2185-4ce7-8965-9f1ce56cc68d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:28.023890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc417f-2185-4ce7-8965-9f1ce56cc68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:28.037822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc417f-2185-4ce7-8965-9f1ce56cc68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:28.042136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc417f-2185-4ce7-8965-9f1ce56cc68d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:28.067197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1456/2905] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:28.225568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:28.228885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:28.249474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1900b-3434-4c3b-aedb-6cad20eeb522 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:28.268452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:28.270037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:28.270717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:28.271183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] PATH_INFO: `/v3/projects/eab82775bb01462ab92667ed241cd7bf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:28.273159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab82775bb01462ab92667ed241cd7bf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:28.275935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:28.464845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab82775bb01462ab92667ed241cd7bf', 'request_id': 'req-28951a77-2869-434f-a3fe-c75a96cb464a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:28.474872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab82775bb01462ab92667ed241cd7bf', 'request_id': 'req-28951a77-2869-434f-a3fe-c75a96cb464a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:28.484808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab82775bb01462ab92667ed241cd7bf', 'request_id': 'req-28951a77-2869-434f-a3fe-c75a96cb464a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:28.605321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] The token cache is being invalidate because project eab82775bb01462ab92667ed241cd7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:28.605822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:28.606935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-28951a77-2869-434f-a3fe-c75a96cb464a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:28.614657 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1450/2906] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:28 2022] DELETE /identity/v3/projects/eab82775bb01462ab92667ed241cd7bf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:28.616351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:28.616898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:28.617317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:28.675925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:28.677426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:28.778987 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1457/2907] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:28.787517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:28.787873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:28.788049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:28.840891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:28.840891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:28.863506 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1451/2908] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:28.864717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:28.880178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c51e6e-e681-4125-b0bb-d25e895c9a24 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:28.919994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:28.919994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:28.920278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:28.920278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:28.920278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:28.920278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:28.920644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:59:28.920644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:28.920644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:28.924035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf136-872d-4697-9273-85329dbfe212 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:28.952219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:28.952219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:28.952219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:28.952219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] PATH_INFO: `/v3/projects/4fddc9a2293a464c96194c53aa8d4ef2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:28.952896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fddc9a2293a464c96194c53aa8d4ef2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:28.952896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:28.953140 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1458/2909] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:59:28.953140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:28.977251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22937f46-e55f-4805-bfb4-8d7ef0507eb8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:29.001983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:29.003927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.008888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.008888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.009710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:29.023800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:29.152696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:29.188077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fddc9a2293a464c96194c53aa8d4ef2', 'request_id': 'req-a4616669-1e60-4fdf-a436-3205f7a2089c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.195118 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1459/2910] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:59:28 2022] POST /identity/v3/projects => generated 413 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:59:29.197187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:29.214583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fddc9a2293a464c96194c53aa8d4ef2', 'request_id': 'req-a4616669-1e60-4fdf-a436-3205f7a2089c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.230439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fddc9a2293a464c96194c53aa8d4ef2', 'request_id': 'req-a4616669-1e60-4fdf-a436-3205f7a2089c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.309013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea90860-a2fa-4653-a800-920e2310332a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:29.315157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:29.316677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.316969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.317239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.317955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:29.320405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:29.399098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] The token cache is being invalidate because project 4fddc9a2293a464c96194c53aa8d4ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:29.399888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.402645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.404694 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1452/2911] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:28 2022] DELETE /identity/v3/projects/4fddc9a2293a464c96194c53aa8d4ef2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:29.409262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:29.420313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:29.476992 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1460/2912] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:59:29 2022] POST /identity/v3/users => generated 307 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:29.482507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:29.486777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:29.506408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:29.527433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764287-1598-4d5e-8833-65b9439996aa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:29.540537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:29.541915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.541915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.541915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.542419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:29.544107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:29.578954 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1461/2913] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:59:29.583896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:29.586379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4616669-1e60-4fdf-a436-3205f7a2089c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:29.595169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:29.600606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.601047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.601314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] PATH_INFO: `/v3/users/c5d3c25f451f4dd6900d45d643081fe2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.603544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa02f02-5de2-41ea-86e2-7a63fbc15fae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:29.604519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d3c25f451f4dd6900d45d643081fe2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:29.607170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:29.612330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:29.614362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.618457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.618457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.618457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:29.620060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:29.646231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1462/2914] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:59:29.650406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:29.667850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329220b3-c656-4445-bea0-a6b5ea314588 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:29.675936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aa269-94bd-4773-be4f-9b192ba24dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:29.676699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aa269-94bd-4773-be4f-9b192ba24dac admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.677057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aa269-94bd-4773-be4f-9b192ba24dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.677679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aa269-94bd-4773-be4f-9b192ba24dac admin admin] PATH_INFO: `/v3/projects/4b790fd7dc704073bc96021037e72f7d/users/264d1977751b4b938f1f752856cb0735/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.701910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517aa269-94bd-4773-be4f-9b192ba24dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b790fd7dc704073bc96021037e72f7d, user_id=264d1977751b4b938f1f752856cb0735, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:29.706343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517aa269-94bd-4773-be4f-9b192ba24dac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:29.833683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1463/2915] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:59:29 2022] PUT /identity/v3/projects/4b790fd7dc704073bc96021037e72f7d/users/264d1977751b4b938f1f752856cb0735/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:29.833683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:29.833683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:29.833683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:29.862082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:29.864025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:29.955507 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1464/2916] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:29.965906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d3c25f451f4dd6900d45d643081fe2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.977802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:29.981727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:29.982007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d3c25f451f4dd6900d45d643081fe2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.998605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d3c25f451f4dd6900d45d643081fe2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:29.999702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d3c25f451f4dd6900d45d643081fe2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:30.001223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d3c25f451f4dd6900d45d643081fe2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:30.094580 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1453/2917] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:29 2022] DELETE /identity/v3/users/c5d3c25f451f4dd6900d45d643081fe2 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:59:30.109821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058e8e-beef-40c4-a08f-4537da4b1ac6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:30.232406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:30.233048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:30.233334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:30.233614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:30.243611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:30.376069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:30.378677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:30.398564 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1465/2918] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:30.805334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:30.807539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:30.832020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6872a-ac14-472d-b5eb-db9cb4dfb526 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:30.838786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:30.839886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:30.840495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:30.841128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] PATH_INFO: `/v3/projects/241ad903721446d4b69b2b289c9cd052` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:30.843039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241ad903721446d4b69b2b289c9cd052)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:30.846180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:30.891843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:30.893667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:30.910753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfa3ff-f0af-4fe2-8f46-e6ed222302f8 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:30.935971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:30.938853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:30.939416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:30.940121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] PATH_INFO: `/v3/users/3658a4da4c174ec49718f18181fdc017` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:30.944348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3658a4da4c174ec49718f18181fdc017)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:30.947529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:31.029350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:31.051563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241ad903721446d4b69b2b289c9cd052', 'request_id': 'req-1fba4dad-124b-4e4b-85c2-cbe4338107b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.058009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241ad903721446d4b69b2b289c9cd052', 'request_id': 'req-1fba4dad-124b-4e4b-85c2-cbe4338107b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.069344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241ad903721446d4b69b2b289c9cd052', 'request_id': 'req-1fba4dad-124b-4e4b-85c2-cbe4338107b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.200512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] The token cache is being invalidate because project 241ad903721446d4b69b2b289c9cd052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:31.201974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.204611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1fba4dad-124b-4e4b-85c2-cbe4338107b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.208442 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1454/2919] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:30 2022] DELETE /identity/v3/projects/241ad903721446d4b69b2b289c9cd052 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:31.210707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2aa3-1306-425f-9eee-8f786d286e8b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:31.211111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2aa3-1306-425f-9eee-8f786d286e8b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:31.211539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2aa3-1306-425f-9eee-8f786d286e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:31.223161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:31.252267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3658a4da4c174ec49718f18181fdc017'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.253947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3658a4da4c174ec49718f18181fdc017'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.277155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9b6e2aa3-1306-425f-9eee-8f786d286e8b None None] MFA Rules not processed for user `8582f801d90b499aba923a3ef99ff02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:31.279131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b6e2aa3-1306-425f-9eee-8f786d286e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:31.358833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3658a4da4c174ec49718f18181fdc017'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.372863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3658a4da4c174ec49718f18181fdc017'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.374401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77d21dfb-61d2-4ee9-8b50-3b456aa06930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3658a4da4c174ec49718f18181fdc017'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:31.447585 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1455/2920] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:31.451836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:31.455124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:31.455528 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1466/2921] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:30 2022] DELETE /identity/v3/users/3658a4da4c174ec49718f18181fdc017 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:31.460317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:31.534978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:31.536658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:31.740624 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1456/2922] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:31.759960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:31.761721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:31.762055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:31.819647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:31.823581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:31.861893 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1467/2923] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:31.863126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:31.878284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c88d03-41f4-4067-8ab4-c6255a64808b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:31.899949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:31.900622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:31.900903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:31.901177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:31.901862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:59:31.902320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:31.903838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:31.972407 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1457/2924] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:59:31.974127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:31.990396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448b06d-5bac-4932-82d2-12e83650dd2f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:32.009935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512dec6-ee8d-461c-9ad7-2b0f4c91a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:32.011021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512dec6-ee8d-461c-9ad7-2b0f4c91a23e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:32.011463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512dec6-ee8d-461c-9ad7-2b0f4c91a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:32.011929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512dec6-ee8d-461c-9ad7-2b0f4c91a23e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:32.012758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512dec6-ee8d-461c-9ad7-2b0f4c91a23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:32.015737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512dec6-ee8d-461c-9ad7-2b0f4c91a23e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:32.160569 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1468/2925] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:59:31 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:32.162687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:32.178346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c47a4-a4d7-4353-b320-e5bdb895bc2f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:32.360912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:32.361725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:32.362191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:32.362688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:32.363501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:32.365947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:32.391113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:32.391113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:32.391113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:32.481628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:32.486310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:32.550736 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1458/2926] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:59:32 2022] POST /identity/v3/users => generated 294 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:32.552663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:32.564834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:32.590847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:32.616177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3780e1-3a92-4083-b12a-0a94b3eb6e4f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:32.623288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:32.623987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:32.624268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:32.625589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] PATH_INFO: `/v3/projects/fe663852a79b404398b07b33ea453ee0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:32.626958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe663852a79b404398b07b33ea453ee0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:32.628957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:32.696111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:32.762593 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1469/2927] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:32.764898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:32.842966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e30ccb-d46b-4934-a272-9a7a0a108011 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:32.847754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe663852a79b404398b07b33ea453ee0', 'request_id': 'req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:32.879992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe663852a79b404398b07b33ea453ee0', 'request_id': 'req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:32.898748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe663852a79b404398b07b33ea453ee0', 'request_id': 'req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:32.981543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] The token cache is being invalidate because project fe663852a79b404398b07b33ea453ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:32.981843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:32.983589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cec409c-16e4-47de-bcfd-f8f35e8a2c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:32.986079 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1459/2928] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:32 2022] DELETE /identity/v3/projects/fe663852a79b404398b07b33ea453ee0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:32.993605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:32.995461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:32.995950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.037370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:33.038107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:33.038587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:33.039062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.039925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:33.041887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:33.061754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:33.064045 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1470/2929] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:33.065964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:33.066720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:33.068379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:33.087790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361d16-a695-4d2f-aceb-1ebebf60760e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:33.094610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:33.095580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:33.096042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:33.096514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] PATH_INFO: `/v3/users/59ded61b602d4b44b5bd65a953863613` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.099495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ded61b602d4b44b5bd65a953863613)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:33.101789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:33.187500 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1460/2930] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:33.187500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:33.187500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:33.213362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077b5ca-9a1c-4482-9e8c-c24eff35bd7d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:33.221746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:33.223484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:33.223868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:33.224212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.224973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:33.227107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:33.250631 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1461/2931] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:33.254882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:33.255407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:33.343680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ded61b602d4b44b5bd65a953863613'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:33.347585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ded61b602d4b44b5bd65a953863613'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:33.415099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d1351-959b-42c7-94e5-7407e91b1aab admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:33.426978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:33.428081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:33.428713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:33.429435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.431533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:33.447568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:33.450761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:33.465770 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1462/2932] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:33.467627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:33.479365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ded61b602d4b44b5bd65a953863613'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:33.494447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594176-66db-48f7-b1e6-9068cc4879f8 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:33.494447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:33.494447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:33.494447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:33.494857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] PATH_INFO: `/v3/projects/203148593a554dd4b297a0d4a38231a4/users/46a88ed23acb4b2a9e343e13756c6d12/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.495703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ded61b602d4b44b5bd65a953863613'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:33.496537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-374c7c5c-2e21-4fdb-96f1-24c1b892dad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ded61b602d4b44b5bd65a953863613'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:33.541914 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1471/2933] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 19:59:33 2022] DELETE /identity/v3/users/59ded61b602d4b44b5bd65a953863613 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:33.550895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=203148593a554dd4b297a0d4a38231a4, user_id=46a88ed23acb4b2a9e343e13756c6d12, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:33.560688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:33.570686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:33.680330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1463/2934] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:59:33 2022] PUT /identity/v3/projects/203148593a554dd4b297a0d4a38231a4/users/46a88ed23acb4b2a9e343e13756c6d12/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:33.694302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:33.694894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:33.695197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:33.767551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] MFA Rules not processed for user `46a88ed23acb4b2a9e343e13756c6d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:33.772304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:33.903429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:34.002256 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1472/2935] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:34.007325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.013887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:34.039395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.042356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:34.184403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f1b2-c184-4ac2-8920-f11a8870ebc4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.196142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.198284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.201241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.201636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] PATH_INFO: `/v3/projects/677d50dbfa3c41139841ed793e9465db` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.210544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=677d50dbfa3c41139841ed793e9465db)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.217815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:34.241774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51728c04-5b2b-4d74-95a4-a3bc358dabfc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.254912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.255844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.255844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.256087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.256924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.270489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:34.425739 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1464/2936] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:59:34 2022] POST /identity/v3/projects => generated 389 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:34.431650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.465352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677d50dbfa3c41139841ed793e9465db', 'request_id': 'req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:34.481241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677d50dbfa3c41139841ed793e9465db', 'request_id': 'req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:34.490942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677d50dbfa3c41139841ed793e9465db', 'request_id': 'req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:34.588438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb2443-db25-4993-972b-a67dd4d50728 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.602943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.603707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.604251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.604374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.605738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.607986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:34.612497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] The token cache is being invalidate because project 677d50dbfa3c41139841ed793e9465db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:59:34.614283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:34.614283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2c35b9ec-bb82-4c71-8cbe-f2fb508003fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:59:34.616884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1473/2937] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 19:59:34 2022] DELETE /identity/v3/projects/677d50dbfa3c41139841ed793e9465db => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:34.634979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d1bd-afe3-4866-b313-aed60d0aeeb6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.635539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d1bd-afe3-4866-b313-aed60d0aeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.636188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d1bd-afe3-4866-b313-aed60d0aeeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.706280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e6c3d1bd-afe3-4866-b313-aed60d0aeeb6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:34.710949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e6c3d1bd-afe3-4866-b313-aed60d0aeeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:34.738308 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1465/2938] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:59:34 2022] POST /identity/v3/users => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:34.740701 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1474/2939] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:34.743309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.747802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.748903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:34.749336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.750638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.797638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdf2eb-de38-4556-bcd5-3c5da2a0e2c1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.814995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.816656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.818337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.819096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.819414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:34.820909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.825549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:34.828772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:34.851838 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1475/2940] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:34.856344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.863769 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1466/2941] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:34.867783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.879405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c9bb-fb4a-45bd-bf8d-871f078892e6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.890643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.891952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b7477-2028-4fd1-8a03-aa3e01260191 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.893553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.893553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.894742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.898712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:59:34.898712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.900661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:34.905524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.907997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.908430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.909033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] PATH_INFO: `/v3/projects/487ddbc4bf5644e594720ca72bdf67fe/users/fc34c013f92f4068ba41f63d7f042f3d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.942303 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1476/2942] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 19:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:59:34.945903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:34.957381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=487ddbc4bf5644e594720ca72bdf67fe, user_id=fc34c013f92f4068ba41f63d7f042f3d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.961207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:34.967864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01831105-ac99-459a-b33b-10e6c40c8347 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:34.975811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:34.976698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:34.976865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:34.977132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:34.977878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:34.980310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:35.112135 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1467/2943] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:59:34 2022] PUT /identity/v3/projects/487ddbc4bf5644e594720ca72bdf67fe/users/fc34c013f92f4068ba41f63d7f042f3d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:35.112705 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1477/2944] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 19:59:34 2022] POST /identity/v3/projects => generated 391 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:35.122869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.123749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.144633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:35.188782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:35.274378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86a401-0a98-4314-9edb-269f7d732188 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.277108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:35.277742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.278045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.278537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.279365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:35.281714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:35.286690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a1df5-f643-4bda-9caa-5715cad8f4bd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.303773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:35.304680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.305058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.305463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.306242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:35.309152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:35.309921 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1478/2945] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:35.313398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.338039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e655145-7ac9-42a6-b3b9-73c70e3f582b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.354606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a53f3-deed-4ef0-8f8f-505564aad66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:35.355521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a53f3-deed-4ef0-8f8f-505564aad66b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.356079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a53f3-deed-4ef0-8f8f-505564aad66b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.357219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a53f3-deed-4ef0-8f8f-505564aad66b admin admin] PATH_INFO: `/v3/projects/487ddbc4bf5644e594720ca72bdf67fe/users/fc34c013f92f4068ba41f63d7f042f3d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.363420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a53f3-deed-4ef0-8f8f-505564aad66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=487ddbc4bf5644e594720ca72bdf67fe, user_id=fc34c013f92f4068ba41f63d7f042f3d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:35.370098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a53f3-deed-4ef0-8f8f-505564aad66b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:35.393973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1479/2946] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:59:35 2022] PUT /identity/v3/projects/487ddbc4bf5644e594720ca72bdf67fe/users/fc34c013f92f4068ba41f63d7f042f3d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:35.410277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0baf06-3dd9-4021-bb45-f991c8fa6ddf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.410277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0baf06-3dd9-4021-bb45-f991c8fa6ddf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.410277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0baf06-3dd9-4021-bb45-f991c8fa6ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.419827 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1468/2947] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 19:59:35 2022] POST /identity/v3/users => generated 296 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:59:35.420719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.482080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac9536-b135-4738-aca6-3d3a0c745b7f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.508349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bb0baf06-3dd9-4021-bb45-f991c8fa6ddf None None] MFA Rules not processed for user `fc34c013f92f4068ba41f63d7f042f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:35.508349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bb0baf06-3dd9-4021-bb45-f991c8fa6ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:35.682958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:35.683493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.683869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.684092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.684795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:35.687120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:35.713943 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1469/2948] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:59:35.717660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.739765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c240ee-c4bc-492b-aa4c-ab99fba3bf97 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.760064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:35.766903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.766903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.766903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.766903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:35.766903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:35.775427 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1480/2949] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:59:35.775427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.775427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.775427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:35.786979 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1470/2950] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:59:35.789221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.794259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:35.818174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:35.820291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:35.944430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430736-5c9b-4dc5-9bc8-3750fccb1304 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.975838 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1481/2951] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 19:59:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:35.977307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:35.983324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:35.994317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807e5e9-dcf4-4645-9c9a-56ab3de2ebb3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:35.995936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:35.996834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:35.998100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:36.003072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40966ed2-9473-4cc8-bdae-00f5ecaa2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:36.003262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:36.004999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40966ed2-9473-4cc8-bdae-00f5ecaa2f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:36.005832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40966ed2-9473-4cc8-bdae-00f5ecaa2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:36.006442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40966ed2-9473-4cc8-bdae-00f5ecaa2f08 admin admin] PATH_INFO: `/v3/projects/a779170f0bbb4b02b5f79007804a5221/users/b6d6d7e4361c44feb38e31f6edee14ae/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:36.052260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:36.071726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40966ed2-9473-4cc8-bdae-00f5ecaa2f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a779170f0bbb4b02b5f79007804a5221, user_id=b6d6d7e4361c44feb38e31f6edee14ae, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:36.076853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40966ed2-9473-4cc8-bdae-00f5ecaa2f08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:36.164129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:36.168509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:36.181920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1471/2952] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:36.182792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:36.185056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:36.198127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1482/2953] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 19:59:35 2022] PUT /identity/v3/projects/a779170f0bbb4b02b5f79007804a5221/users/b6d6d7e4361c44feb38e31f6edee14ae/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:59:36.213829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:36.214167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:36.214682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:36.289349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:36.291238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:36.306637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:36.368132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687b8e5-14dd-4fe6-b655-d8c65397aa22 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:36.464478 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1483/2954] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:36.573393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:36.575231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:36.596327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:36.597015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:36.597302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:36.597577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:36.720040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6afa63-a4b7-4dec-8484-920e82647be9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:36.727370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:36.728027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:36.735851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:36.736138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:36.758557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:36.765964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:36.766195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:36.766285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:36.783313 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1472/2955] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 19:59:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:59:36.799348 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1484/2956] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:38.736504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:40.196024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:40.197523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:40.397408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9136a-2c5e-469b-a9d0-8e6dc72633b5 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:40.406848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6988a0-a4eb-4dc9-9310-1620cb880810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:40.408189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6988a0-a4eb-4dc9-9310-1620cb880810 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:40.408732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6988a0-a4eb-4dc9-9310-1620cb880810 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:40.409231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6988a0-a4eb-4dc9-9310-1620cb880810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:40.560343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6988a0-a4eb-4dc9-9310-1620cb880810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:40.565421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6988a0-a4eb-4dc9-9310-1620cb880810 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:40.612211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1473/2957] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:48.930741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:48.950382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0889c18-0d0c-4469-baa0-26ef124573a7 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:48.979525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:48.980170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:48.980450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:48.980729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:48.982908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:49.130838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:49.132500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17798dc-a306-4f73-89f1-bcd8ca4f4879 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:49.159609 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1485/2958] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:50.596517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=58 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:52.207611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:52.209021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:52.210148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:52.322230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] MFA Rules not processed for user `264d1977751b4b938f1f752856cb0735`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:52.323971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:52.552412 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1474/2959] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:52.563543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:52.566811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:52.566811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:52.600094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] MFA Rules not processed for user `264d1977751b4b938f1f752856cb0735`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:52.601356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:52.631272 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1486/2960] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:53.142928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:53.175221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99905771-49f7-481c-ae7a-c89448a53587 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:53.188459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:53.189882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:53.203292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:53.207883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:53.208451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:53.212136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:53.232136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:53.234414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:53.266647 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1475/2961] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:53 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:53.349457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:53.509273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8d05-16b5-4350-9a97-535301a8a3d6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:53.535397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:53.536612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:53.537667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:53.538365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:53.541728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:53.810137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:53.816830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029255b-7145-428e-aba9-32c3198b29cd service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:53.855764 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1487/2962] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:59:57.849970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:57.853099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:57.898982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407cb78-c706-45dc-ba28-490ec372ab09 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:57.908768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:57.909387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:57.914339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:57.914984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:57.917440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:57.959199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:57.961041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:58.000746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:58.001298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:58.001298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:58.032767 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1476/2963] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:58.105478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] MFA Rules not processed for user `b6d6d7e4361c44feb38e31f6edee14ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:59:58.106898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:59:58.334548 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1488/2964] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:59:59.686277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:59.706169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f03b00-9ee0-44f6-baf1-b056895a676c service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:59.724470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5748e-7a52-4ec6-ba51-d30ad14ed1db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:59.725223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5748e-7a52-4ec6-ba51-d30ad14ed1db service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:59.725511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5748e-7a52-4ec6-ba51-d30ad14ed1db service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:59.725790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5748e-7a52-4ec6-ba51-d30ad14ed1db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:59.760271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5748e-7a52-4ec6-ba51-d30ad14ed1db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:59.762643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5748e-7a52-4ec6-ba51-d30ad14ed1db service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:59.790188 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1477/2965] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:01.777191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:01.828348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92041fda-bb90-44bd-8d08-5f44790b6921 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:01.853567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:01.856625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:01.857292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:01.861762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] PATH_INFO: `/v3/users/46a88ed23acb4b2a9e343e13756c6d12` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:01.864887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a88ed23acb4b2a9e343e13756c6d12)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:01.867664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:02.210901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a88ed23acb4b2a9e343e13756c6d12'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:02.216910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a88ed23acb4b2a9e343e13756c6d12'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:02.340140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a88ed23acb4b2a9e343e13756c6d12'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:02.357337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a88ed23acb4b2a9e343e13756c6d12'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:02.359968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:02.363269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a88ed23acb4b2a9e343e13756c6d12'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:02.404169 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1489/2966] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:01 2022] DELETE /identity/v3/users/46a88ed23acb4b2a9e343e13756c6d12 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:00:02.410282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:02.411478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:02.413293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:02.471766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:02.479695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:02.744958 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1478/2967] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:02.794726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:02.796373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:03.027142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f87a-6db4-425e-9768-5bfcc53b4914 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:03.047112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:03.047112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:03.047112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:03.047112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:03.074972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:03.079173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:03.112958 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1490/2968] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:03.683335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:03.687959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:03.719535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24905b1c-fbdc-40b3-8424-9221298dc3b8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:03.724265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:03.725114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:03.725555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:03.726095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] PATH_INFO: `/v3/projects/203148593a554dd4b297a0d4a38231a4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:03.729469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203148593a554dd4b297a0d4a38231a4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:03.731687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:03.931869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:03.948793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203148593a554dd4b297a0d4a38231a4', 'request_id': 'req-0ffb9b95-2027-42ec-b5ff-2ff397176141'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:03.958768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203148593a554dd4b297a0d4a38231a4', 'request_id': 'req-0ffb9b95-2027-42ec-b5ff-2ff397176141'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:03.969983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203148593a554dd4b297a0d4a38231a4', 'request_id': 'req-0ffb9b95-2027-42ec-b5ff-2ff397176141'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.109775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] The token cache is being invalidate because project 203148593a554dd4b297a0d4a38231a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:04.109775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.111513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0ffb9b95-2027-42ec-b5ff-2ff397176141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.118107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1479/2969] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:03 2022] DELETE /identity/v3/projects/203148593a554dd4b297a0d4a38231a4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:04.122730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:04.145468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15fc2e-3483-44d9-80ed-2e4724951979 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:04.321242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:04.321984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:04.322625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:04.323083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] PATH_INFO: `/v3/users/fc34c013f92f4068ba41f63d7f042f3d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:04.324936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc34c013f92f4068ba41f63d7f042f3d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:04.336214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:04.578733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc34c013f92f4068ba41f63d7f042f3d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.588185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc34c013f92f4068ba41f63d7f042f3d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.616756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184552e-c3af-4025-acba-abcdd70b91d5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:04.620887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184552e-c3af-4025-acba-abcdd70b91d5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:04.621453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184552e-c3af-4025-acba-abcdd70b91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:04.690317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc34c013f92f4068ba41f63d7f042f3d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.698840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc34c013f92f4068ba41f63d7f042f3d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.700267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc34c013f92f4068ba41f63d7f042f3d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:04.701074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a184552e-c3af-4025-acba-abcdd70b91d5 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:04.702703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a184552e-c3af-4025-acba-abcdd70b91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:04.732714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:04.743167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1491/2970] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:04 2022] DELETE /identity/v3/users/fc34c013f92f4068ba41f63d7f042f3d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:04.827411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1480/2971] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:05.455891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:05.459762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:05.604648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307cd4d-3b03-416c-bd64-37525d890273 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:05.615226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:05.616237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:05.616688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:05.617129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] PATH_INFO: `/v3/projects/487ddbc4bf5644e594720ca72bdf67fe` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:05.626849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] RBAC: Authorizing `identity:delete_project(project_id=487ddbc4bf5644e594720ca72bdf67fe)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:05.628850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:05.681089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdcd7d-e739-423f-b464-bdc57830504b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:05.681669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdcd7d-e739-423f-b464-bdc57830504b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:05.682173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdcd7d-e739-423f-b464-bdc57830504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:05.710012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-aefdcd7d-e739-423f-b464-bdc57830504b None None] MFA Rules not processed for user `214b5ab49764481c98a048528f3d2f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:05.712223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aefdcd7d-e739-423f-b464-bdc57830504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:05.799116 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1481/2972] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:05.813014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487ddbc4bf5644e594720ca72bdf67fe', 'request_id': 'req-74ca182b-7974-40eb-a6c2-9b39eb8736de'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:05.822269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487ddbc4bf5644e594720ca72bdf67fe', 'request_id': 'req-74ca182b-7974-40eb-a6c2-9b39eb8736de'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:05.852644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487ddbc4bf5644e594720ca72bdf67fe', 'request_id': 'req-74ca182b-7974-40eb-a6c2-9b39eb8736de'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:05.952455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] The token cache is being invalidate because project 487ddbc4bf5644e594720ca72bdf67fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:05.953014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:05.962363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-74ca182b-7974-40eb-a6c2-9b39eb8736de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:05.964767 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1492/2973] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:05 2022] DELETE /identity/v3/projects/487ddbc4bf5644e594720ca72bdf67fe => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:05.971884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeaac0-2a23-4934-9d54-9d798b6ece59 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:05.972469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeaac0-2a23-4934-9d54-9d798b6ece59 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:05.974704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeaac0-2a23-4934-9d54-9d798b6ece59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.016332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-64aeaac0-2a23-4934-9d54-9d798b6ece59 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:06.019748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64aeaac0-2a23-4934-9d54-9d798b6ece59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:06.138041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1482/2974] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:06.147928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.148674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.151963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.154056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcedbac-3826-4596-a61d-79693061b296 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.155426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcedbac-3826-4596-a61d-79693061b296 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.156302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcedbac-3826-4596-a61d-79693061b296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.180267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:06.182123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:06.195845 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1493/2975] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:06.200812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:06.234208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab956da-cb6c-40ab-8109-6ca59550a124 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:06.236768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-abcedbac-3826-4596-a61d-79693061b296 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:06.240391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-abcedbac-3826-4596-a61d-79693061b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:06.246962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:06.263766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.264729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.265915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.268417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:00:06.268858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:06.273930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:06.319574 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1494/2976] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:00:06.326259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:06.351321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13ddd-7110-4191-9216-fe74cdf58399 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:06.365450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:06.366805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.367374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.368153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.370256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:06.375723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:06.376774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:06.478621 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1483/2977] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:06.488162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcedbac-3826-4596-a61d-79693061b296 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:06.492220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-abcedbac-3826-4596-a61d-79693061b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:06.589621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1495/2978] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:00:06 2022] POST /identity/v3/projects => generated 377 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:00:06.592935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:06.679293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcedbac-3826-4596-a61d-79693061b296 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:06.687653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:06.706723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75eae9-a59c-40f9-ad5c-60375eea6046 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:06.713479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:06.714133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.714519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.714774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.716259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:06.719290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:06.804789 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1496/2979] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:00:06 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:00:06.808162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:06.847141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938769-9bc1-4320-b347-ec9d8ad2d904 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:06.869121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:06.873484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.874943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.875250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.876794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:06.880588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:06.881517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0809c8a-2500-47c5-94a8-04cd6b99128e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:06.882213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0809c8a-2500-47c5-94a8-04cd6b99128e service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.882488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0809c8a-2500-47c5-94a8-04cd6b99128e service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.882765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0809c8a-2500-47c5-94a8-04cd6b99128e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.912226 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1497/2980] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:00:06.915015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:06.943521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695436-cd09-4175-80f7-0c963305ab77 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:06.961531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:06.964805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:06.965051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:06.965422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:06.966211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:06.971943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:07.007309 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1498/2981] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:07.012136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:07.042954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2c17-d62f-47f8-bd11-82ead32ea3f6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:07.056947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:07.057744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:07.058112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:07.058395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] PATH_INFO: `/v3/projects/6bf9550cb1334609ab5108a513c1a0e0/users/c586841d9c1a4a55a90eb41e5cf72908/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:07.064279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0809c8a-2500-47c5-94a8-04cd6b99128e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:07.066600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0809c8a-2500-47c5-94a8-04cd6b99128e service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:07.086658 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1484/2982] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:00:07.097571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf9550cb1334609ab5108a513c1a0e0, user_id=c586841d9c1a4a55a90eb41e5cf72908, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:07.103569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:07.333292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1499/2983] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:00:07 2022] PUT /identity/v3/projects/6bf9550cb1334609ab5108a513c1a0e0/users/c586841d9c1a4a55a90eb41e5cf72908/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:07.415241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815413d4-a11e-4562-9e92-b28082b9c964 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:07.415621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815413d4-a11e-4562-9e92-b28082b9c964 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:07.416014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815413d4-a11e-4562-9e92-b28082b9c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:07.453017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:07.457469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-815413d4-a11e-4562-9e92-b28082b9c964 None None] MFA Rules not processed for user `c586841d9c1a4a55a90eb41e5cf72908`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:07.459152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-815413d4-a11e-4562-9e92-b28082b9c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:07.614986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1485/2984] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:08.814401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:08.814401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:09.023975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e259a-2670-4c13-babd-e92f05be034b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:09.038909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd8d9-ae19-4d78-9eea-1a3b12843ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:09.039851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd8d9-ae19-4d78-9eea-1a3b12843ae0 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:09.040141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd8d9-ae19-4d78-9eea-1a3b12843ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:09.041705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd8d9-ae19-4d78-9eea-1a3b12843ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:09.075634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd8d9-ae19-4d78-9eea-1a3b12843ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:09.077677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd8d9-ae19-4d78-9eea-1a3b12843ae0 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:09.130714 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1500/2985] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:09.702523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:09.703568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:09.704071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:09.794833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:09.797641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:09.955582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226ac1b-aa09-4857-af42-7c1758836eb0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:09.956462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226ac1b-aa09-4857-af42-7c1758836eb0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:09.956462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226ac1b-aa09-4857-af42-7c1758836eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:10.011727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6226ac1b-aa09-4857-af42-7c1758836eb0 None None] MFA Rules not processed for user `c57647deea08499999217def99872956`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:10.013243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6226ac1b-aa09-4857-af42-7c1758836eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:10.050513 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1486/2986] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:00:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:10.071918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:10.256230 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1501/2987] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:10.321909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7e5c2-39f7-426f-b4ce-9c1f707844e8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:10.337786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348b779-5732-46e0-a82b-3f2df2168e1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:10.338412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348b779-5732-46e0-a82b-3f2df2168e1f service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:10.338696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348b779-5732-46e0-a82b-3f2df2168e1f service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:10.339033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348b779-5732-46e0-a82b-3f2df2168e1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:10.361295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348b779-5732-46e0-a82b-3f2df2168e1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:10.362515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348b779-5732-46e0-a82b-3f2df2168e1f service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:10.389658 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1487/2988] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:00:11.249383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:11.249984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:11.250104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:11.286346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] MFA Rules not processed for user `c586841d9c1a4a55a90eb41e5cf72908`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:11.287899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:11.305078 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1502/2989] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:12.521098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:12.521652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:12.521652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:12.571775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:12.573064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:12.603567 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1488/2990] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:12.618750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:12.655685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e098ef2-35cf-4dc4-a1f2-326b493e134b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:12.676916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b451f97-608e-4085-9bd7-8208b8e95184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:12.680961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b451f97-608e-4085-9bd7-8208b8e95184 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:12.682232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b451f97-608e-4085-9bd7-8208b8e95184 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:12.682544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b451f97-608e-4085-9bd7-8208b8e95184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:12.725486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b451f97-608e-4085-9bd7-8208b8e95184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:12.729939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b451f97-608e-4085-9bd7-8208b8e95184 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:12.762815 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1503/2991] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:00:13.463500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:13.522404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:13.628361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663f25f-13c5-4c10-ab60-b36bd927928f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:13.670716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:13.680922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:13.680922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:13.707172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] PATH_INFO: `/v3/users/c586841d9c1a4a55a90eb41e5cf72908` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:13.710950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c586841d9c1a4a55a90eb41e5cf72908)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:13.720034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:14.231796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c586841d9c1a4a55a90eb41e5cf72908'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:14.323346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c586841d9c1a4a55a90eb41e5cf72908'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:14.352255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c586841d9c1a4a55a90eb41e5cf72908'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:14.352255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c586841d9c1a4a55a90eb41e5cf72908'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:14.354587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c586841d9c1a4a55a90eb41e5cf72908'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:14.480605 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1489/2992] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:13 2022] DELETE /identity/v3/users/c586841d9c1a4a55a90eb41e5cf72908 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:14.485676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:14.487075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:14.487561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:14.499361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:14.523719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:14.529210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:14.764205 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1504/2993] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:14.888792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:14.890972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:15.095195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef251d9-a77c-44d8-bad8-0a7a1201374e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:15.099660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:15.100496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:15.100995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:15.101442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:15.116341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:15.118345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:15.137335 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1490/2994] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:16.808317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:16.808317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:16.828154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:16.832038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:16.884657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791fa8-6728-438d-ba2b-da9671c415cd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:16.885134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a15ae-1b8a-42db-9d9c-bac1c6a00f17 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:16.904106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:16.904252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:16.904996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:16.905284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] PATH_INFO: `/v3/projects/6bf9550cb1334609ab5108a513c1a0e0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:16.912476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:16.914138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:16.914795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:16.915583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] PATH_INFO: `/v3/users/b6d6d7e4361c44feb38e31f6edee14ae` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:16.918656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d6d7e4361c44feb38e31f6edee14ae)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:16.921551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf9550cb1334609ab5108a513c1a0e0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:16.922616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:16.923413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:17.424415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf9550cb1334609ab5108a513c1a0e0', 'request_id': 'req-21187648-c2e2-4c7f-8046-8afae7adc47d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.428892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:17.441696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d6d7e4361c44feb38e31f6edee14ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.444565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d6d7e4361c44feb38e31f6edee14ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.461284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf9550cb1334609ab5108a513c1a0e0', 'request_id': 'req-21187648-c2e2-4c7f-8046-8afae7adc47d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.484648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf9550cb1334609ab5108a513c1a0e0', 'request_id': 'req-21187648-c2e2-4c7f-8046-8afae7adc47d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.603711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d6d7e4361c44feb38e31f6edee14ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.616421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d6d7e4361c44feb38e31f6edee14ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.617257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd4475f2-f1d9-4a1d-87b5-849cb1227d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d6d7e4361c44feb38e31f6edee14ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.644260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1505/2995] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:16 2022] DELETE /identity/v3/users/b6d6d7e4361c44feb38e31f6edee14ae => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:17.686280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] The token cache is being invalidate because project 6bf9550cb1334609ab5108a513c1a0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:17.686280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.686280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21187648-c2e2-4c7f-8046-8afae7adc47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:17.695401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1491/2996] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:16 2022] DELETE /identity/v3/projects/6bf9550cb1334609ab5108a513c1a0e0 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:17.696611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:17.696976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:17.697326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:17.739982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:17.744819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:17.948134 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1506/2997] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:17.957353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:17.957951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:17.957951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:17.994382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:17.996390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:18.031430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1492/2998] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:18.040739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:18.051363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf79f-5d85-4ae7-b400-e30a6b29b79b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:18.071169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:18.072122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:18.072575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:18.073029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:18.073921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:00:18.074432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:18.077374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:18.116291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1507/2999] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:00:18.123488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:18.153984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ab195-cdab-4a6a-827c-cb28a6ce98cd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:18.175779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:18.178433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:18.178433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:18.178433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:18.179218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:18.181648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:18.385338 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1493/3000] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:00:18 2022] POST /identity/v3/projects => generated 395 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:00:18.393469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:18.395934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:18.401496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:18.438288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:18.447904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1228bad-c242-42e3-bf7b-4948cb49fee8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:18.558247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:18.558910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:18.559312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:18.560119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] PATH_INFO: `/v3/projects/a779170f0bbb4b02b5f79007804a5221` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:18.562239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a779170f0bbb4b02b5f79007804a5221)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:18.564081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:18.607253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d7fa-71be-4ef5-8ab1-1570263d4d4a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:18.622272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:18.622903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:18.623923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:18.624243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:18.624898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:18.626884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:18.753743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a779170f0bbb4b02b5f79007804a5221', 'request_id': 'req-117e2b36-cb67-4889-ad49-f871fb8086c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:18.762977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a779170f0bbb4b02b5f79007804a5221', 'request_id': 'req-117e2b36-cb67-4889-ad49-f871fb8086c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:18.775381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a779170f0bbb4b02b5f79007804a5221', 'request_id': 'req-117e2b36-cb67-4889-ad49-f871fb8086c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:18.805365 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1494/3001] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:00:18 2022] POST /identity/v3/users => generated 298 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:00:18.806720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:18.819541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af30a5-9bfd-48be-bedb-15c0c1c38860 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:18.891746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] The token cache is being invalidate because project a779170f0bbb4b02b5f79007804a5221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:18.892683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:18.893977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-117e2b36-cb67-4889-ad49-f871fb8086c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:18.897769 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1508/3002] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:18 2022] DELETE /identity/v3/projects/a779170f0bbb4b02b5f79007804a5221 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:18.903190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:18.903922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:18.906018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:18.962627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e70561-c746-493b-9d78-020a284a4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:18.963253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70561-c746-493b-9d78-020a284a4f89 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:18.965264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70561-c746-493b-9d78-020a284a4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:18.965655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70561-c746-493b-9d78-020a284a4f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:18.966363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:18.967329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70561-c746-493b-9d78-020a284a4f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:18.974458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:18.974704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70561-c746-493b-9d78-020a284a4f89 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:18.993784 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1509/3003] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:19.006164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:19.007343 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1495/3004] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:19.010895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:19.042673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd8e8-b83e-4376-aedf-31020a86d272 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:19.059465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:19.060395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.061049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.061490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.062363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:19.069455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:19.073238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.077274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.078098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.087838 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1510/3005] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:00:19.099177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:19.124361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561831-0f38-4747-8701-1202184768ff admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:19.125480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:19.129523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:19.147827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5798-a7d7-43bd-a708-f0849577257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:19.147827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5798-a7d7-43bd-a708-f0849577257c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.148336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5798-a7d7-43bd-a708-f0849577257c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.148747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5798-a7d7-43bd-a708-f0849577257c admin admin] PATH_INFO: `/v3/projects/b5d50beedc114cf39e5be5d67ecbcd13/users/e1efb701dd164c62a6faa4579a5ebd5a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.174825 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1496/3006] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:19.177168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5798-a7d7-43bd-a708-f0849577257c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d50beedc114cf39e5be5d67ecbcd13, user_id=e1efb701dd164c62a6faa4579a5ebd5a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:19.181028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5798-a7d7-43bd-a708-f0849577257c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:19.185889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:19.216027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfd25c-b195-4e53-984f-915a287b14f5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:19.224154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:19.231445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.231445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.231445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.231445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:00:19.231445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:19.231445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:19.263350 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1497/3007] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:00:19.273314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:19.297484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5a77-a499-4168-8aa7-977faf410373 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:19.306368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:19.306368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.306368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.306696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.307400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:19.309463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:19.367521 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1511/3008] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:00:19 2022] PUT /identity/v3/projects/b5d50beedc114cf39e5be5d67ecbcd13/users/e1efb701dd164c62a6faa4579a5ebd5a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:19.417830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.417830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.417830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.465927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] MFA Rules not processed for user `e1efb701dd164c62a6faa4579a5ebd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:19.480896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:19.581238 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1512/3009] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:19.595531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:19.611117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1498/3010] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:00:19 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:00:19.614303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:19.615571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:19.780154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dd1ba-a0ff-4c0a-ab71-8dd5118ef490 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:19.787632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:19.788353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.788682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.789016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.790665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:19.794451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:19.854572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1edf2a-2f03-4516-8b7b-d4e53ea6020b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:19.961233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd28d8a-9545-4958-a3a8-4dc84e0a58cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:19.962525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd28d8a-9545-4958-a3a8-4dc84e0a58cd service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:19.962813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd28d8a-9545-4958-a3a8-4dc84e0a58cd service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:19.963091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd28d8a-9545-4958-a3a8-4dc84e0a58cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:19.987047 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1499/3011] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:00:19 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:00:19.987745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:20.006211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c12ca2-f2bf-47e0-9220-0154afc615a4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:20.012499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:20.017049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:20.017049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:20.017049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:20.017049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:20.017049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:20.028749 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1500/3012] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:00:20.033176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:20.046211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7918747-3476-4560-9802-f6c0539df9a1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:20.058358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:20.059359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:20.059639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:20.061593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:20.062557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:20.068027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:20.091699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd28d8a-9545-4958-a3a8-4dc84e0a58cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:20.113578 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1501/3013] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:00:20.115429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:20.118244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd28d8a-9545-4958-a3a8-4dc84e0a58cd service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:20.130419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd9e2f-99e5-4975-9183-7f5e769bea8d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:20.138004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:20.139930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:20.140950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:20.141409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] PATH_INFO: `/v3/projects/a8f7c5a28ffb4feb8c097ff9b8e0f6ba/users/4dd3d5fbdde2487aa0fab3516d810ca2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:20.149729 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1513/3014] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:19 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:00:20.170554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f7c5a28ffb4feb8c097ff9b8e0f6ba, user_id=4dd3d5fbdde2487aa0fab3516d810ca2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:20.173738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:20.290660 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1502/3015] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:00:20 2022] PUT /identity/v3/projects/a8f7c5a28ffb4feb8c097ff9b8e0f6ba/users/4dd3d5fbdde2487aa0fab3516d810ca2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:20.295615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:20.295916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:20.296174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:20.327825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:20.329682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:20.428241 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1514/3016] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:20.447021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:20.448906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:20.520274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3819445-e684-4d43-bb24-902be99d18b1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:20.526685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0d5a-65ad-435c-8f04-33ebe8f3b531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:20.527879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0d5a-65ad-435c-8f04-33ebe8f3b531 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:20.528168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0d5a-65ad-435c-8f04-33ebe8f3b531 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:20.528885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0d5a-65ad-435c-8f04-33ebe8f3b531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:20.540187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c0d5a-65ad-435c-8f04-33ebe8f3b531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:20.542156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c0d5a-65ad-435c-8f04-33ebe8f3b531 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:20.554328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1503/3017] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:21.359501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:23.422024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:23.851807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:23.884041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7775b4-6d4c-4e30-aa2a-e4c6bfa863ef None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:23.914634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:23.917350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:23.918621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:23.919572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] PATH_INFO: `/v3/users/e1efb701dd164c62a6faa4579a5ebd5a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:23.929596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1efb701dd164c62a6faa4579a5ebd5a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:23.934767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:24.489165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1efb701dd164c62a6faa4579a5ebd5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:24.490845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1efb701dd164c62a6faa4579a5ebd5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:24.626923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1efb701dd164c62a6faa4579a5ebd5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:24.661581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1efb701dd164c62a6faa4579a5ebd5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:24.667471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1efb701dd164c62a6faa4579a5ebd5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:24.749906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1515/3018] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:23 2022] DELETE /identity/v3/users/e1efb701dd164c62a6faa4579a5ebd5a => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:24.758105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:24.758971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:24.758971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:24.824261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:24.826081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:25.333173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1504/3019] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:25.340248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:25.343463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:25.483129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:25.523153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97345f-f14c-45cf-a3a2-7959fd4ac626 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:25.543963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aa918-0236-46c8-94dc-89bdba9a3a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:25.545009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa918-0236-46c8-94dc-89bdba9a3a9a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:25.546781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa918-0236-46c8-94dc-89bdba9a3a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:25.547131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa918-0236-46c8-94dc-89bdba9a3a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:25.592145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aa918-0236-46c8-94dc-89bdba9a3a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:25.593807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aa918-0236-46c8-94dc-89bdba9a3a9a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:25.625683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1516/3020] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:27.475798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:27.480114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:27.493969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2717b-2cd3-4879-ae08-458dd5a254dd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:27.515288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:27.516594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:27.518638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:27.519736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] PATH_INFO: `/v3/projects/b5d50beedc114cf39e5be5d67ecbcd13` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:27.524742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d50beedc114cf39e5be5d67ecbcd13)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:27.529283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:27.666514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:27.789871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d50beedc114cf39e5be5d67ecbcd13', 'request_id': 'req-13671851-40d9-4c44-91ba-42f099600d5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:27.805910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d50beedc114cf39e5be5d67ecbcd13', 'request_id': 'req-13671851-40d9-4c44-91ba-42f099600d5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:27.838118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d50beedc114cf39e5be5d67ecbcd13', 'request_id': 'req-13671851-40d9-4c44-91ba-42f099600d5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:27.934732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] The token cache is being invalidate because project b5d50beedc114cf39e5be5d67ecbcd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:27.937097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:27.937097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:27.938965 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1505/3021] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:27 2022] DELETE /identity/v3/projects/b5d50beedc114cf39e5be5d67ecbcd13 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:27.943966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5fee3-234f-41b7-9b12-b1dbe2f9fb90 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:27.944297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5fee3-234f-41b7-9b12-b1dbe2f9fb90 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:27.944572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5fee3-234f-41b7-9b12-b1dbe2f9fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:28.018482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-54e5fee3-234f-41b7-9b12-b1dbe2f9fb90 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:28.027626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54e5fee3-234f-41b7-9b12-b1dbe2f9fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:28.064669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:28.066493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:28.330394 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1517/3022] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:28.337884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:28.338183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:28.338467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:28.431835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:28.433077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:28.465500 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1518/3023] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:28.467288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:28.478896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671851-40d9-4c44-91ba-42f099600d5f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:28.495378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:28.495871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4c266-68d4-4e3e-b947-f403b8b4a667 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:28.496034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:28.496268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:28.496537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:28.506463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:28.512200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:28.512841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:28.513128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:28.513436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:28.514142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:00:28.514435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:28.516039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:28.530599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:28.535040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:28.554848 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1519/3024] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:00:28.556184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:28.570170 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1506/3025] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:28.576121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc140bf-e909-4680-bb0c-46fdad9feffb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:28.593734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:28.594400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:28.594678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:28.594988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:28.595708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:28.598327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:28.744700 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1520/3026] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:00:28 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:00:28.745377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:28.751533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f383-2fab-4f2d-8912-9d457bc8171e service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:28.808102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:28.853631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:28.854265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:28.854557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:28.854840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:28.855510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:28.859913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:28.890146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:29.100966 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1507/3027] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:00:28 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:00:29.105504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:29.120946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6c38-2313-4b46-bc45-88d9f2d091de admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:29.145003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:29.148567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:29.149003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:29.149292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:29.150189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:29.151867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:29.191512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1521/3028] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:29.195745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:29.214517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c78f27-5529-44ca-890c-364846cae330 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:29.230085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4b622-49a7-42da-bde8-764e9c1dd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:29.230921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b622-49a7-42da-bde8-764e9c1dd5ee admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:29.231303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b622-49a7-42da-bde8-764e9c1dd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:29.231842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b622-49a7-42da-bde8-764e9c1dd5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:29.232904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4b622-49a7-42da-bde8-764e9c1dd5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:29.237364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4b622-49a7-42da-bde8-764e9c1dd5ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:29.265957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1508/3029] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:29.271445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:29.289744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026ab68-3243-4732-9d88-31b2394e8b6e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:29.298945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:29.300551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:29.301080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:29.301593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] PATH_INFO: `/v3/projects/dd06399e867649408cf6f443c2d2ba6a/users/bf6f4a713af940f2b81d0ce67758d2f7/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:29.334861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd06399e867649408cf6f443c2d2ba6a, user_id=bf6f4a713af940f2b81d0ce67758d2f7, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:29.339426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:29.517631 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1522/3030] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:00:29 2022] PUT /identity/v3/projects/dd06399e867649408cf6f443c2d2ba6a/users/bf6f4a713af940f2b81d0ce67758d2f7/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:00:29.533461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:29.534495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:29.534998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:29.612006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] MFA Rules not processed for user `bf6f4a713af940f2b81d0ce67758d2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:29.615004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:29.795146 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1509/3031] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:31.381946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:31.383878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:31.601756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df038c5-4972-4c74-8ca1-6c91af69261e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:31.621459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:31.623020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:31.623591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:31.624042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:31.650306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:31.652746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:31.680742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1523/3032] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:34.594649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:34.782289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3694-4147-4458-93fe-91cd2b69e9e6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:34.789084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:34.789816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:34.790166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:34.790436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:34.792620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:34.810123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:34.811765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac35a67-888f-4f00-ba92-e339d764dae6 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:34.882034 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1510/3033] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:37.679592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:37.783582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:37.834234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8f9cc-e6ef-4e5d-ba30-2340a1e71daa service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:37.846684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:37.848060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:37.849521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:37.850062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] PATH_INFO: `/v3/users/bf6f4a713af940f2b81d0ce67758d2f7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:37.852839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6f4a713af940f2b81d0ce67758d2f7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:37.855096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:37.919741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73367-d14f-486b-8973-449554ee95a7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:37.919741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73367-d14f-486b-8973-449554ee95a7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:37.919741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73367-d14f-486b-8973-449554ee95a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:37.948103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-74d73367-d14f-486b-8973-449554ee95a7 None None] MFA Rules not processed for user `4dd3d5fbdde2487aa0fab3516d810ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:37.949762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-74d73367-d14f-486b-8973-449554ee95a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:37.972735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:38.037776 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1511/3034] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:38.337173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6f4a713af940f2b81d0ce67758d2f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:38.338048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6f4a713af940f2b81d0ce67758d2f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:38.568487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6f4a713af940f2b81d0ce67758d2f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:38.572163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6f4a713af940f2b81d0ce67758d2f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:38.574257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6f4a713af940f2b81d0ce67758d2f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:38.647112 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1524/3035] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:37 2022] DELETE /identity/v3/users/bf6f4a713af940f2b81d0ce67758d2f7 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:38.650821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:38.651425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:38.651979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:38.705012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:38.711782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:38.885092 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1512/3036] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:38.901588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:38.905787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:38.945303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:38.948361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:39.026247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c78f1-beb7-4855-bc3f-fab8c6a74074 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:39.041553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:39.042591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:39.046076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:39.046584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:39.090061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:39.099385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:39.106358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4517-f79e-44e7-a510-693bffa6e549 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:39.122114 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1525/3037] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:39.139001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:39.139965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:39.142305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:39.142797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:39.146592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:39.363307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:39.363307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825598-c338-406e-9c88-5e5297e86cac service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:39.396284 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1513/3038] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:00:40.026725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:41.130012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:41.130705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:41.174311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69731f-f5de-48ed-a6ab-59505d17f657 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:41.198826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:41.199589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:41.199788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:41.200073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] PATH_INFO: `/v3/projects/dd06399e867649408cf6f443c2d2ba6a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:41.202569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd06399e867649408cf6f443c2d2ba6a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:41.204592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:41.468435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd06399e867649408cf6f443c2d2ba6a', 'request_id': 'req-2e1a1007-287c-4cdd-ba18-3f0731d275e6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:41.483832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:41.485317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd06399e867649408cf6f443c2d2ba6a', 'request_id': 'req-2e1a1007-287c-4cdd-ba18-3f0731d275e6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:41.501110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd06399e867649408cf6f443c2d2ba6a', 'request_id': 'req-2e1a1007-287c-4cdd-ba18-3f0731d275e6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:41.714166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] The token cache is being invalidate because project dd06399e867649408cf6f443c2d2ba6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:41.714843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:41.717697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e1a1007-287c-4cdd-ba18-3f0731d275e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:41.721052 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1526/3039] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:41 2022] DELETE /identity/v3/projects/dd06399e867649408cf6f443c2d2ba6a => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:41.726020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:41.727068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:41.727565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:41.771053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:41.772755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:41.884178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1514/3040] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:41.891813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:41.892102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:41.892659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:41.921346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:41.923294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:41.934731 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1527/3041] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:41.939677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:41.964728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc8be-bf99-4e61-825b-c0d5b1743b4c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:41.981194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:41.985365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:41.985693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:41.986065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:41.986911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:00:41.987709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:41.989255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:42.005178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1515/3042] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:00:42.009652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:42.022728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b340a-31fc-4f9d-9ce9-0fccb9e006b8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:42.055291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:42.055924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:42.056207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:42.056494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:42.057151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:42.059251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:42.294567 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1528/3043] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:00:42 2022] POST /identity/v3/projects => generated 371 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:00:42.299388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:42.311939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa79af-f100-4811-a4c7-bf01ae8947fc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:42.411479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:42.411479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:42.411479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:42.411479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:42.412009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:42.412849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:42.548999 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1516/3044] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:00:42 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:00:42.552999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:42.571378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082d32-d58b-41dd-a4fa-c388db6f8c57 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:42.580490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:42.582683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:42.583039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:42.583376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:42.584052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:42.585672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:42.599567 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1529/3045] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:42.603368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:42.620882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82093c3f-e90e-4ce1-b24c-52c16029bb97 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:42.627059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7548c22-7984-4205-932a-140c89a574b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:42.628057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7548c22-7984-4205-932a-140c89a574b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:42.628553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7548c22-7984-4205-932a-140c89a574b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:42.629208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7548c22-7984-4205-932a-140c89a574b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:42.630390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7548c22-7984-4205-932a-140c89a574b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:42.632214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7548c22-7984-4205-932a-140c89a574b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:42.645925 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1517/3046] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:42.650149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:42.661753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb3df9-0548-431a-b032-07391c51f2e4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:42.666989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:42.667657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:42.667933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:42.668206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] PATH_INFO: `/v3/projects/78ea0f6205074cbc86aa0c466245c0f9/users/59acc1ad07484effb4b033f271920a00/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:42.690844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ea0f6205074cbc86aa0c466245c0f9, user_id=59acc1ad07484effb4b033f271920a00, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:42.693730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:42.958570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1530/3047] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:00:42 2022] PUT /identity/v3/projects/78ea0f6205074cbc86aa0c466245c0f9/users/59acc1ad07484effb4b033f271920a00/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:42.961991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123070c8-8884-40d7-a989-a43ca54e42c8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:42.962485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123070c8-8884-40d7-a989-a43ca54e42c8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:42.962579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123070c8-8884-40d7-a989-a43ca54e42c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:43.004528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-123070c8-8884-40d7-a989-a43ca54e42c8 None None] MFA Rules not processed for user `59acc1ad07484effb4b033f271920a00`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:43.005828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-123070c8-8884-40d7-a989-a43ca54e42c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:43.089735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:43.111923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1518/3048] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:43.799398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:43.801349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:43.921499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d197-4ef3-425c-a3ce-77f9822f804b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:43.929579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:43.930272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:43.930581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:43.930861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:43.942290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:43.944240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:43.966134 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1531/3049] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:45.684039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4dc4b-6af2-403c-9014-a453cae1552e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:45.685143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4dc4b-6af2-403c-9014-a453cae1552e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:45.685483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4dc4b-6af2-403c-9014-a453cae1552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:45.711515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fea4dc4b-6af2-403c-9014-a453cae1552e None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:45.714106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fea4dc4b-6af2-403c-9014-a453cae1552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:45.780107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1519/3050] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:46.739498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:46.817572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ee627-87c1-4b08-9ca6-0c51e7c919b4 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:46.823293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:46.824031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:46.824471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:46.824759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] PATH_INFO: `/v3/users/59acc1ad07484effb4b033f271920a00` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:46.826693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59acc1ad07484effb4b033f271920a00)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:46.828630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:46.845499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:47.135894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59acc1ad07484effb4b033f271920a00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:47.136688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59acc1ad07484effb4b033f271920a00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:47.221297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59acc1ad07484effb4b033f271920a00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:47.231735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59acc1ad07484effb4b033f271920a00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:47.232852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59acc1ad07484effb4b033f271920a00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:47.264562 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1532/3051] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:00:46 2022] DELETE /identity/v3/users/59acc1ad07484effb4b033f271920a00 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:47.269724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:47.273489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:47.274159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:47.299070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:47.300463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:47.424864 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1520/3052] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:47.447681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:47.451315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:47.533033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232fa82-4c65-418d-b920-1a63cd0da0f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:47.539852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b425e-79f8-441c-8722-bb85b1dbb5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:47.539852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b425e-79f8-441c-8722-bb85b1dbb5bd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:47.539852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b425e-79f8-441c-8722-bb85b1dbb5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:47.539852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b425e-79f8-441c-8722-bb85b1dbb5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:47.551987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b425e-79f8-441c-8722-bb85b1dbb5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:47.560028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b425e-79f8-441c-8722-bb85b1dbb5bd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:47.571335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1533/3053] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:48.303044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:48.304520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:48.323523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7efd-06c4-4184-8b51-2873ce03d28b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:48.343575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:48.344240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.344549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.347374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] PATH_INFO: `/v3/projects/78ea0f6205074cbc86aa0c466245c0f9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.355545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ea0f6205074cbc86aa0c466245c0f9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:48.357724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:48.531501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ea0f6205074cbc86aa0c466245c0f9', 'request_id': 'req-f958a525-1989-491e-b61d-a5a777bf403b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:48.537204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ea0f6205074cbc86aa0c466245c0f9', 'request_id': 'req-f958a525-1989-491e-b61d-a5a777bf403b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:48.545179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ea0f6205074cbc86aa0c466245c0f9', 'request_id': 'req-f958a525-1989-491e-b61d-a5a777bf403b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:48.672689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] The token cache is being invalidate because project 78ea0f6205074cbc86aa0c466245c0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:00:48.673069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:48.673769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f958a525-1989-491e-b61d-a5a777bf403b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:00:48.676325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1521/3054] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:00:48 2022] DELETE /identity/v3/projects/78ea0f6205074cbc86aa0c466245c0f9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:48.683274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.683851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.683851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.708255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:48.710077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:48.775603 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1534/3055] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:48.787371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.787669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.788058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.815766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:48.817063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:48.827617 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1522/3056] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:48.832278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:48.845014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec746e9-7d8f-4160-b1c0-6e21887bb3a2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:48.851329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:48.860612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.860612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.860612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.860612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:00:48.860612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:48.860612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfab1e-0c16-44b7-b59a-0eaef59e3114 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:48.873911 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1535/3057] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:00:48.878236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:48.888828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de594c-f4a5-4552-b902-b6adbd34d75b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:48.895547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:48.895547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.896106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.896106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.896978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:48.899012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:48.921961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:49.003851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.004395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.004851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.031820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:49.033595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:49.056016 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1523/3058] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:00:48 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:00:49.061468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:49.129897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1536/3059] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:00:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:00:49.166135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:49.168140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:49.195791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f284-3146-4cc8-bda8-d598a7f2482c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:49.202598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:49.203217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.203494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.203765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.204411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:49.206446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:49.273031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc66df-06d1-4923-85b5-f7e876fb2279 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:49.368401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1524/3060] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:00:49 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:00:49.377563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:49.398322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a2429-2b9f-4317-bafb-9315a471b39c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:49.398953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a2429-2b9f-4317-bafb-9315a471b39c service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.399235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a2429-2b9f-4317-bafb-9315a471b39c service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.399514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a2429-2b9f-4317-bafb-9315a471b39c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.399972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d442-4328-483c-ab01-17be33d701bb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:49.440357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:49.441206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.441698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.442199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.443040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:49.445060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:49.457465 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1525/3061] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:00:49.469841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:49.505646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035ddf4-a008-4232-b65e-d15c62ba2901 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:49.517002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:49.517498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.517987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.519539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.520997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:49.524176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a2429-2b9f-4317-bafb-9315a471b39c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:49.525904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a2429-2b9f-4317-bafb-9315a471b39c service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:49.526287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:49.554773 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1526/3062] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:00:49.560670 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1537/3063] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:00:49.561065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:49.577596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d68a-2ad2-4b2b-b4cf-1afb7a39b5d1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:49.582843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:49.583545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.584031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.584312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] PATH_INFO: `/v3/projects/31cbbf3c56794fbc85d1da77afc6c03f/users/8dcc80a057c04b39b55bafd45fc95e20/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.604100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cbbf3c56794fbc85d1da77afc6c03f, user_id=8dcc80a057c04b39b55bafd45fc95e20, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:49.607898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:49.685509 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1527/3064] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:00:49 2022] PUT /identity/v3/projects/31cbbf3c56794fbc85d1da77afc6c03f/users/8dcc80a057c04b39b55bafd45fc95e20/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:00:49.688017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732c7d-0bab-4e32-a763-3de10209d938 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.688639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732c7d-0bab-4e32-a763-3de10209d938 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.688639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732c7d-0bab-4e32-a763-3de10209d938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.717309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-40732c7d-0bab-4e32-a763-3de10209d938 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:49.719123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-40732c7d-0bab-4e32-a763-3de10209d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:49.798346 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1538/3065] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:49.811237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:49.813568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:49.893830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08862c-0a2f-43ee-b5e9-951be2965733 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:49.898381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec531-abcb-4095-b254-347783f59b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:49.899142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec531-abcb-4095-b254-347783f59b78 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:49.899507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec531-abcb-4095-b254-347783f59b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:49.899853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec531-abcb-4095-b254-347783f59b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:49.911671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec531-abcb-4095-b254-347783f59b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:49.914995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec531-abcb-4095-b254-347783f59b78 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:49.929356 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1528/3066] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:50.479989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:53.083894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a4bb-2489-4fea-8faf-e4c941b88ec3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:53.084395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a4bb-2489-4fea-8faf-e4c941b88ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:53.084395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a4bb-2489-4fea-8faf-e4c941b88ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:53.179407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4797a4bb-2489-4fea-8faf-e4c941b88ec3 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:53.179407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4797a4bb-2489-4fea-8faf-e4c941b88ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:53.443101 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1539/3067] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:54.648740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:01.333793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:01.342627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:01.342627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:01.382516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:01.384436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:01.405426 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1529/3068] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:01:06.653313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48192f-2f3a-48c9-a0eb-51a72f5d41ba None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:06.654495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48192f-2f3a-48c9-a0eb-51a72f5d41ba None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:06.655041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48192f-2f3a-48c9-a0eb-51a72f5d41ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:06.684394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:06.686048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:06.699925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1d48192f-2f3a-48c9-a0eb-51a72f5d41ba None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:06.704706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0b32-97d4-48ef-a850-d2ee830eba09 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:06.706452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d48192f-2f3a-48c9-a0eb-51a72f5d41ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:06.711165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:06.712146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:06.712654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:06.713131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] PATH_INFO: `/v3/users/8582f801d90b499aba923a3ef99ff02c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:06.715711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8582f801d90b499aba923a3ef99ff02c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:06.720565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:06.741807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1540/3069] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:06.950815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:07.129187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8582f801d90b499aba923a3ef99ff02c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:07.167113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8582f801d90b499aba923a3ef99ff02c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:07.197211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8582f801d90b499aba923a3ef99ff02c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:07.203368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8582f801d90b499aba923a3ef99ff02c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:07.205682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8582f801d90b499aba923a3ef99ff02c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:07.343105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1530/3070] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:06 2022] DELETE /identity/v3/users/8582f801d90b499aba923a3ef99ff02c => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:07.346859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1934d-8763-425a-87b0-f0999f59892c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:07.347451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1934d-8763-425a-87b0-f0999f59892c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:07.347913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1934d-8763-425a-87b0-f0999f59892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:07.400534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dde1934d-8763-425a-87b0-f0999f59892c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:07.407452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dde1934d-8763-425a-87b0-f0999f59892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:07.710137 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1541/3071] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:07.783805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:07.786822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:07.979342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ef43-241f-4177-8dec-ca114c5ad0a8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:07.990291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:07.990938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:07.991276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:07.991561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:08.045444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:08.053399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:08.103474 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1531/3072] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:09.403136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:09.403718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:09.403718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:09.575730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:09.583174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:09.854202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:09.946290 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1542/3073] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:09.974920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:09.977051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:10.018226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51e9a-673e-46c4-8c35-90e1d5932cb7 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:10.041842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:10.043109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:10.044785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:10.045305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] PATH_INFO: `/v3/projects/114c1dbf05024fb0b8c494a02b5f16fa` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:10.050039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=114c1dbf05024fb0b8c494a02b5f16fa)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:10.053617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:10.268518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114c1dbf05024fb0b8c494a02b5f16fa', 'request_id': 'req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:10.306210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114c1dbf05024fb0b8c494a02b5f16fa', 'request_id': 'req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:10.343318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114c1dbf05024fb0b8c494a02b5f16fa', 'request_id': 'req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:10.520361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] The token cache is being invalidate because project 114c1dbf05024fb0b8c494a02b5f16fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:10.521699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:10.522653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:10.525954 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1532/3074] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:09 2022] DELETE /identity/v3/projects/114c1dbf05024fb0b8c494a02b5f16fa => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:10.533933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:10.560119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84a06a-5e73-433c-b222-faa6932a15a5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:10.751259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:10.752758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:10.839291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:10.876485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:10.880683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:10.882522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:10.884244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] PATH_INFO: `/v3/users/8cbec59587b44ff180559d69f307d66c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:10.886101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754897b-ef63-4f7a-a70f-c5182e8a7c5e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:10.888754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbec59587b44ff180559d69f307d66c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:10.892089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:10.892730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:10.893034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:10.893298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] PATH_INFO: `/v3/users/264d1977751b4b938f1f752856cb0735` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:10.896943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264d1977751b4b938f1f752856cb0735)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:10.899851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:10.900226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:11.164155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264d1977751b4b938f1f752856cb0735'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.216957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264d1977751b4b938f1f752856cb0735'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.239796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264d1977751b4b938f1f752856cb0735'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.242257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264d1977751b4b938f1f752856cb0735'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.242905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9d090330-b4eb-47bd-9dcd-94e589d0ae77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264d1977751b4b938f1f752856cb0735'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.288774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbec59587b44ff180559d69f307d66c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.293884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbec59587b44ff180559d69f307d66c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.362999 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1533/3075] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:10 2022] DELETE /identity/v3/users/264d1977751b4b938f1f752856cb0735 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:11.458354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbec59587b44ff180559d69f307d66c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.472300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbec59587b44ff180559d69f307d66c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.474303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbec59587b44ff180559d69f307d66c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:11.578393 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1543/3076] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:10 2022] DELETE /identity/v3/users/8cbec59587b44ff180559d69f307d66c => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:11.799952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:11.800473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:11.800908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:11.891077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] MFA Rules not processed for user `8dcc80a057c04b39b55bafd45fc95e20`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:11.892896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:12.193394 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1534/3077] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:12.202928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:12.205884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:12.443335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4738c-45b6-47bc-a0f9-7c43b05993f4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:12.448277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:12.450174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:12.450332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:12.450556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:12.451208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:12.453705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:12.508382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:12.604107 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1544/3078] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:01:12 2022] POST /identity/v3/projects => generated 389 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:12.608437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:12.632383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c7187-8e41-4fa0-8c03-8b6945ee68f8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:12.772034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:12.829422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:12.830449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:12.830901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:12.831371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:12.832270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:12.834463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:12.978820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1535/3079] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:01:12 2022] POST /identity/v3/users => generated 301 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:12.984540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:13.003366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf09b-43fb-48d6-aaf0-b8510af93e1c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:13.015859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:13.016575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:13.024519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:13.024519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:13.024519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:13.025681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:13.055851 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1545/3080] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:13.059724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:13.075183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e9c98-0b92-4d21-9b0b-345aa1450bb4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:13.091670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:13.092641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:13.093117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:13.093560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] PATH_INFO: `/v3/projects/b3d963f0a9494415a7028b031cf7078d/users/fcc8c171b6924b6db1dae66f78cc39e4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:13.133413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d963f0a9494415a7028b031cf7078d, user_id=fcc8c171b6924b6db1dae66f78cc39e4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:13.136515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:13.226210 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1536/3081] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:13 2022] PUT /identity/v3/projects/b3d963f0a9494415a7028b031cf7078d/users/fcc8c171b6924b6db1dae66f78cc39e4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:13.230678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:13.248225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9a170-aad7-42a0-83fe-400be2e62983 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:13.359834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:13.361881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:13.397256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:13.399031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:13.399031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:13.399586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:13.400512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:13.406628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:13.537539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1546/3082] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:13.545598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:13.560577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ce6b2-c820-443e-97f9-fdfab13467f3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:13.570775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:13.586210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:13.590119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:13.590853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727001-7fcf-46bb-a84f-4388b9ebcc0f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:13.598048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] PATH_INFO: `/v3/projects/b1bc20806bbf4c91b45ecb8867ee7461` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:13.606382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bc20806bbf4c91b45ecb8867ee7461)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:13.608668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:13.617558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:13.622229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:13.622806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:13.623948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] PATH_INFO: `/v3/projects/b3d963f0a9494415a7028b031cf7078d/users/fcc8c171b6924b6db1dae66f78cc39e4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:13.630362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d963f0a9494415a7028b031cf7078d, user_id=fcc8c171b6924b6db1dae66f78cc39e4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:13.633261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:13.666254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1547/3083] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:13 2022] PUT /identity/v3/projects/b3d963f0a9494415a7028b031cf7078d/users/fcc8c171b6924b6db1dae66f78cc39e4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:13.717790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:13.720228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:13.857397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bc20806bbf4c91b45ecb8867ee7461', 'request_id': 'req-44402897-095c-497d-ac19-693163a7c269'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:13.873880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bc20806bbf4c91b45ecb8867ee7461', 'request_id': 'req-44402897-095c-497d-ac19-693163a7c269'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:13.904864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bc20806bbf4c91b45ecb8867ee7461', 'request_id': 'req-44402897-095c-497d-ac19-693163a7c269'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:13.936671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6121-6711-4aa1-9532-776c0da5b853 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:14.002890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] The token cache is being invalidate because project b1bc20806bbf4c91b45ecb8867ee7461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:14.003256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.004008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-44402897-095c-497d-ac19-693163a7c269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.013980 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1537/3084] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:13 2022] DELETE /identity/v3/projects/b1bc20806bbf4c91b45ecb8867ee7461 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:14.016201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f11ee-846d-4ae0-9538-deee2ab63209 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.018361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f11ee-846d-4ae0-9538-deee2ab63209 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.018670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f11ee-846d-4ae0-9538-deee2ab63209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.070648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e49f11ee-846d-4ae0-9538-deee2ab63209 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:14.072102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e49f11ee-846d-4ae0-9538-deee2ab63209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:14.155007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:14.249351 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1538/3085] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:14.249351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f601-e6ba-420b-8923-2023a21627a4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.249351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f601-e6ba-420b-8923-2023a21627a4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.249351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f601-e6ba-420b-8923-2023a21627a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.262539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:14.263370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.263775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.264152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] PATH_INFO: `/v3/projects/4b790fd7dc704073bc96021037e72f7d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.268141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b790fd7dc704073bc96021037e72f7d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:14.272232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:14.287394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fb97f601-e6ba-420b-8923-2023a21627a4 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:14.288649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb97f601-e6ba-420b-8923-2023a21627a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:14.334849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:14.432544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1539/3086] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:14.434511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.434697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.435062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.502847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b790fd7dc704073bc96021037e72f7d', 'request_id': 'req-64b729f5-b19d-4b04-958d-812dd5ab4f87'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.506284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:14.510295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:14.530454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b790fd7dc704073bc96021037e72f7d', 'request_id': 'req-64b729f5-b19d-4b04-958d-812dd5ab4f87'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.565661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b790fd7dc704073bc96021037e72f7d', 'request_id': 'req-64b729f5-b19d-4b04-958d-812dd5ab4f87'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.698386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1540/3087] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:14.702575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:14.711180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] The token cache is being invalidate because project 4b790fd7dc704073bc96021037e72f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:14.712176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.715639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64b729f5-b19d-4b04-958d-812dd5ab4f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:14.716018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110facc7-aeda-4bf5-8727-ed18f2b48f05 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:14.717646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1548/3088] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:13 2022] DELETE /identity/v3/projects/4b790fd7dc704073bc96021037e72f7d => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:01:14.724065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6a774-c590-4ca9-87f7-f22e9f67312b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.724746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6a774-c590-4ca9-87f7-f22e9f67312b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.727857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6a774-c590-4ca9-87f7-f22e9f67312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.732654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:14.733370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.733655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.738235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.747782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:01:14.748180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:14.754367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:14.779071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4fa6a774-c590-4ca9-87f7-f22e9f67312b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:14.780799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4fa6a774-c590-4ca9-87f7-f22e9f67312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:14.807811 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1541/3089] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:01:14.816661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:14.819216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:14.820411 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1549/3090] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:14.822139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.822687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.823183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.852038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958201f4-31c4-4f92-a4b5-bb86914b8a2b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:14.865525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:14.866219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.866507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.866790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.867440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:14.872397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:14.875203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:14.875357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:14.901615 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1550/3091] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:14.903111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:14.935778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e747e-f02f-4496-b441-0ce45732adba None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:14.954356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:14.956236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:14.957233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:14.959191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:14.960199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:01:14.961320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:14.963971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.002212 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1551/3092] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:01:15.006208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.013928 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1542/3093] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:01:14 2022] POST /identity/v3/projects => generated 397 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:15.016884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.020881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec25d66-3517-4b78-a83c-03eccad5d7ab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.170306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:15.214795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2c1d5-6726-4cd9-b244-13e98ab7778b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.222808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.223491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.224007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.224464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.225972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.232885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.250454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.251733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.253948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.254215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.258325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.265471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.338520 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1543/3094] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:01:15 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:15.338520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.362907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc4c68-af1b-46e9-a63f-c7d4642f1404 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.377446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.378108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.378393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.378669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.379332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.380958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.412977 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1544/3095] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:15.420945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.443071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4f9f3-7722-47fd-9387-af33ac1b178f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.475519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.485745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.485745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.485745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.485745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.485745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.488526 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1552/3096] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:01:15 2022] POST /identity/v3/projects => generated 397 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:15.494388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.567960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1545/3097] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:15.576514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.619624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9dce-318e-4b85-a37f-19bfae783836 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.678145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad08c-81d9-4416-8610-1e9921a7f627 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.692724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.694650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.694900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.697800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.699993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.707171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.728054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:15.822091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1553/3098] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:01:15 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:01:15.823327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.855098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba4261-4ae3-480e-b0fe-f76696fe8856 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:15.856511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcd7f3-0ebf-4415-8f12-644b7522708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.857211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd7f3-0ebf-4415-8f12-644b7522708f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.857466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd7f3-0ebf-4415-8f12-644b7522708f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.857745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd7f3-0ebf-4415-8f12-644b7522708f admin admin] PATH_INFO: `/v3/projects/2cfe92f7e31c4c4eb8886f256f57df8e/users/f789eab7f7554fc1839bdaced7a2d64f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.877935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:15.880158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.881682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.882837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.893273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.898595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd7f3-0ebf-4415-8f12-644b7522708f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfe92f7e31c4c4eb8886f256f57df8e, user_id=f789eab7f7554fc1839bdaced7a2d64f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:15.898954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.901507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd7f3-0ebf-4415-8f12-644b7522708f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:15.932458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1554/3099] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:01:15.937397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:15.974648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1546/3100] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:15 2022] PUT /identity/v3/projects/2cfe92f7e31c4c4eb8886f256f57df8e/users/f789eab7f7554fc1839bdaced7a2d64f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:15.979883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:15.980724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:15.981000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:15.996420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c40db-7929-4a78-beaa-421c4dc4b960 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:16.033259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:16.034793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:16.199505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1547/3101] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:16.223717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:16.224629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:16.225141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:16.225710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:16.226853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:16.228714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:16.264895 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1555/3102] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:16.268792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:16.279952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6773d-aea1-44c0-a9e9-09b96acbba2e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:16.295953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950e2b8-8891-458a-afba-b4aee37fcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:16.298840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e2b8-8891-458a-afba-b4aee37fcc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:16.299310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e2b8-8891-458a-afba-b4aee37fcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:16.299766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e2b8-8891-458a-afba-b4aee37fcc89 admin admin] PATH_INFO: `/v3/projects/4e5de8d4e7f24d7a862e84b8afc72088/users/3350031712934a5c82660d4503d6f84d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:16.365928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e2b8-8891-458a-afba-b4aee37fcc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5de8d4e7f24d7a862e84b8afc72088, user_id=3350031712934a5c82660d4503d6f84d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:16.369139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e2b8-8891-458a-afba-b4aee37fcc89 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:16.375773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:16.378193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:16.468333 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1548/3103] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:16 2022] PUT /identity/v3/projects/4e5de8d4e7f24d7a862e84b8afc72088/users/3350031712934a5c82660d4503d6f84d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:16.487406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73f9a9-1dff-4f70-9481-628904641ffb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:16.487857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73f9a9-1dff-4f70-9481-628904641ffb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:16.488221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73f9a9-1dff-4f70-9481-628904641ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:16.551112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:16.587145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5e73f9a9-1dff-4f70-9481-628904641ffb None None] MFA Rules not processed for user `3350031712934a5c82660d4503d6f84d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:16.588445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5e73f9a9-1dff-4f70-9481-628904641ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:16.653197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904075-8e83-4c59-b726-d7d9a8da7c08 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:16.758444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1549/3104] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:01:16.868448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:16.869282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:16.869448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:16.869596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:17.084686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:17.143199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:17.146267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86964fba-ecc3-4bb8-be08-e9d56cf83883 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:17.146538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86964fba-ecc3-4bb8-be08-e9d56cf83883 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:17.146823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86964fba-ecc3-4bb8-be08-e9d56cf83883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:17.151563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:17.220120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-86964fba-ecc3-4bb8-be08-e9d56cf83883 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:17.227962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1556/3105] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 853 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:17.229822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-86964fba-ecc3-4bb8-be08-e9d56cf83883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:17.483367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:17.484940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:17.512351 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1550/3106] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:17.792978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162465-fad6-4c41-87dc-480b096987a1 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:17.833808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:17.834467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:17.834748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:17.835021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:17.863233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:17.864859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:17.884895 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1557/3107] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:18.046122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a491-b2b0-43f7-bec8-e25e12c4a02b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:18.046624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a491-b2b0-43f7-bec8-e25e12c4a02b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:18.047070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a491-b2b0-43f7-bec8-e25e12c4a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:18.108417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9726a491-b2b0-43f7-bec8-e25e12c4a02b None None] MFA Rules not processed for user `3350031712934a5c82660d4503d6f84d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:18.110190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9726a491-b2b0-43f7-bec8-e25e12c4a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:18.158452 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1551/3108] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:19.690240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:19.700517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722b1f-be09-4a05-83fb-db9366e340b9 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:19.716576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:19.717235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:19.717524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:19.718168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] PATH_INFO: `/v3/users/3350031712934a5c82660d4503d6f84d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:19.722805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] RBAC: Authorizing `identity:delete_user(user_id=3350031712934a5c82660d4503d6f84d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:19.744025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:20.094947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3350031712934a5c82660d4503d6f84d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:20.096178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3350031712934a5c82660d4503d6f84d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:20.281661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118cb9-244a-44b5-a9d7-65c485162442 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:20.282537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118cb9-244a-44b5-a9d7-65c485162442 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:20.282537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118cb9-244a-44b5-a9d7-65c485162442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:20.298563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3350031712934a5c82660d4503d6f84d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:20.320499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3350031712934a5c82660d4503d6f84d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:20.320499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3350031712934a5c82660d4503d6f84d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:20.363200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-15118cb9-244a-44b5-a9d7-65c485162442 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:20.364834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-15118cb9-244a-44b5-a9d7-65c485162442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:20.397001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1552/3109] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:01:20.409187 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1558/3110] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:19 2022] DELETE /identity/v3/users/3350031712934a5c82660d4503d6f84d => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:20.411908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8a7b-8b8e-4d4d-aac7-bf52237d93b0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:20.412639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8a7b-8b8e-4d4d-aac7-bf52237d93b0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:20.413266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8a7b-8b8e-4d4d-aac7-bf52237d93b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:20.472036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fafd8a7b-8b8e-4d4d-aac7-bf52237d93b0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:20.473260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fafd8a7b-8b8e-4d4d-aac7-bf52237d93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:20.626899 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1553/3111] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:20.653433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:20.654913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:20.688795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:20.813759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93451-f33f-444f-8017-e1e9ded2aace admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:20.827816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:20.828470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:20.828915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:20.829977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:20.851326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:20.853010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:20.893772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1559/3112] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:21.132321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971d75-38d6-423b-8029-0b7c0d1f8031 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:21.132610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971d75-38d6-423b-8029-0b7c0d1f8031 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:21.132893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971d75-38d6-423b-8029-0b7c0d1f8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:21.204114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-aa971d75-38d6-423b-8029-0b7c0d1f8031 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:21.210264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa971d75-38d6-423b-8029-0b7c0d1f8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:21.311088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:21.406391 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1554/3113] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:21.430476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:21.432169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:21.618006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c85d6-cfd6-4a69-9df9-2474af8246ea service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:21.629226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ef10-d2f7-4820-a1ad-55fcfcfce154 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:21.629878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ef10-d2f7-4820-a1ad-55fcfcfce154 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:21.630752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ef10-d2f7-4820-a1ad-55fcfcfce154 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:21.630752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ef10-d2f7-4820-a1ad-55fcfcfce154 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:21.649609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ef10-d2f7-4820-a1ad-55fcfcfce154 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:21.651340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ef10-d2f7-4820-a1ad-55fcfcfce154 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:21.672825 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1560/3114] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:01:21.766867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:21.767152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:21.767702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:21.807200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:21.817593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:21.962778 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1555/3115] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:23.665606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8198-32a7-4935-a45c-a4a206797bb2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:23.666092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8198-32a7-4935-a45c-a4a206797bb2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:23.666213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8198-32a7-4935-a45c-a4a206797bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:23.740725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-718d8198-32a7-4935-a45c-a4a206797bb2 None None] MFA Rules not processed for user `c57647deea08499999217def99872956`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:23.742640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-718d8198-32a7-4935-a45c-a4a206797bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:23.840821 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1561/3116] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:24.129539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:24.131232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:24.167251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d603cd9-7ccc-407f-bd62-433ff71be5cd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:24.193689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:24.194465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:24.194816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:24.195167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] PATH_INFO: `/v3/projects/4e5de8d4e7f24d7a862e84b8afc72088` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:24.197049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5de8d4e7f24d7a862e84b8afc72088)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:24.208578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:24.425198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5de8d4e7f24d7a862e84b8afc72088', 'request_id': 'req-e3f40f7d-e57f-401b-9af8-f564d91fca9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:24.436276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5de8d4e7f24d7a862e84b8afc72088', 'request_id': 'req-e3f40f7d-e57f-401b-9af8-f564d91fca9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:24.451719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5de8d4e7f24d7a862e84b8afc72088', 'request_id': 'req-e3f40f7d-e57f-401b-9af8-f564d91fca9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:24.544120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] The token cache is being invalidate because project 4e5de8d4e7f24d7a862e84b8afc72088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:24.544342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:24.544987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3f40f7d-e57f-401b-9af8-f564d91fca9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:24.553717 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1556/3117] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:24 2022] DELETE /identity/v3/projects/4e5de8d4e7f24d7a862e84b8afc72088 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:24.558974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:24.559486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:24.561745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:24.627097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:24.632009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:24.809047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:24.876541 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1562/3118] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:24.878750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:24.879403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:24.880006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.302512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:25.302512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:25.302512 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1557/3119] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:25.312351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:25.312351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691bc9e-bdb3-4b62-8a16-be470b72b705 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:25.312351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:25.312351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.315354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.315354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.315354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:01:25.315354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:25.315354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:25.315354 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1563/3120] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:01:25.316773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:25.316773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22949d-b1bf-49e9-ab7f-b93459edafaf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:25.316773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:25.316773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.318017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.318017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.318017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:25.318017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:25.375444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1558/3121] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:01:25 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:25.379447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:25.394432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da7d8-09fe-4b1b-aee1-39496a4664bd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:25.501975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:25.502977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.503493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.504644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.507250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:25.510262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:25.595261 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1564/3122] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:01:25 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:25.596555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:25.612394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0e0fe-a5e8-4b5e-a50e-230b777ad2f5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:25.620727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:25.635255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.635923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.642092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.644602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:25.649042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:25.663754 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1559/3123] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:25.667592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:25.684706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58771-192e-40d3-a451-f822883744be admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:25.693125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d0ebb-f33e-49ee-a5b8-9be53972d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:25.708029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0ebb-f33e-49ee-a5b8-9be53972d7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.710896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0ebb-f33e-49ee-a5b8-9be53972d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.712345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0ebb-f33e-49ee-a5b8-9be53972d7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.714111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d0ebb-f33e-49ee-a5b8-9be53972d7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:25.716321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d0ebb-f33e-49ee-a5b8-9be53972d7c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:25.733171 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1565/3124] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:25.737047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:25.751461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca36f6-8d97-4d8f-9d5f-9e9be678bd8f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:25.757767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:25.759669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.760216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.760710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] PATH_INFO: `/v3/projects/51ab0b6f6a7549a68be0791b209cc1ec/users/9b79042dfe9242f8a4833a969fb1a911/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.793499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ab0b6f6a7549a68be0791b209cc1ec, user_id=9b79042dfe9242f8a4833a969fb1a911, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:25.797290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:25.891720 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1560/3125] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:25 2022] PUT /identity/v3/projects/51ab0b6f6a7549a68be0791b209cc1ec/users/9b79042dfe9242f8a4833a969fb1a911/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:25.896625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc646-cb58-43be-96d8-63fba3eb5b88 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:25.897649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc646-cb58-43be-96d8-63fba3eb5b88 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:25.898133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc646-cb58-43be-96d8-63fba3eb5b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:25.921028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-744bc646-cb58-43be-96d8-63fba3eb5b88 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:25.922659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-744bc646-cb58-43be-96d8-63fba3eb5b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:26.075037 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1566/3126] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:26.114347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:26.116274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:26.122834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:26.243407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057943e-9b79-4de5-9e6c-f571611737b0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:26.263326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:26.263900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:26.264354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:26.267773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:26.272732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:26.272732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:26.272732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:26.301734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:26.303831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:26.304469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:26.306131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:26.340226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1561/3127] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:26.453206 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1567/3128] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:01:29.819262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:29.822440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:30.020253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b1e9-f2cb-47ba-bb17-9761156f29d6 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:30.026007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:30.026672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:30.027026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:30.027613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:30.029806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:30.030819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:30.031324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:30.044261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:30.044665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:30.046472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:30.058970 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1562/3129] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:30.061399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ceee-d27c-41c9-858b-6cb1d9dcce1d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:30.074286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:30.076572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:30.077131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:30.077585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] PATH_INFO: `/v3/users/4dd3d5fbdde2487aa0fab3516d810ca2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:30.082179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd3d5fbdde2487aa0fab3516d810ca2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:30.084506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:30.401415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd3d5fbdde2487aa0fab3516d810ca2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:30.405289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd3d5fbdde2487aa0fab3516d810ca2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:30.564775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd3d5fbdde2487aa0fab3516d810ca2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:30.583875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd3d5fbdde2487aa0fab3516d810ca2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:30.584429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86a11a7-a627-459f-a9c0-1b0563c9ce43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd3d5fbdde2487aa0fab3516d810ca2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:30.616576 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1568/3130] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:30 2022] DELETE /identity/v3/users/4dd3d5fbdde2487aa0fab3516d810ca2 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:31.571800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:31.593804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ab53-7fb9-40e3-8035-b06f7a844005 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:31.785591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:31.786436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:31.786814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:31.787195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] PATH_INFO: `/v3/projects/a8f7c5a28ffb4feb8c097ff9b8e0f6ba` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:31.788455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f7c5a28ffb4feb8c097ff9b8e0f6ba)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:31.794822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:31.995901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:32.019281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f7c5a28ffb4feb8c097ff9b8e0f6ba', 'request_id': 'req-dfb563df-6b07-4a0d-a2f5-60b65936388b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:32.041799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f7c5a28ffb4feb8c097ff9b8e0f6ba', 'request_id': 'req-dfb563df-6b07-4a0d-a2f5-60b65936388b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:32.063768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f7c5a28ffb4feb8c097ff9b8e0f6ba', 'request_id': 'req-dfb563df-6b07-4a0d-a2f5-60b65936388b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:32.194043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] The token cache is being invalidate because project a8f7c5a28ffb4feb8c097ff9b8e0f6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:32.194392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:32.195029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfb563df-6b07-4a0d-a2f5-60b65936388b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:32.204560 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1563/3131] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:31 2022] DELETE /identity/v3/projects/a8f7c5a28ffb4feb8c097ff9b8e0f6ba => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:32.209817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:32.210428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:32.210428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:32.249281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:32.251733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:32.440335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1569/3132] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:32.441554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:32.442045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:32.442484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:32.483174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:32.484646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:32.517904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1564/3133] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:32.522427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:32.538876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae1e39-4337-423b-85f8-e003f9bab917 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:32.554156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:32.563358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:32.563839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:32.564409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:32.565475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:01:32.566868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:32.568707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:32.612470 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1570/3134] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:01:32.613065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:32.624230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a6c67-0702-4967-a172-ce11dbeb1eda None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:32.644898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:32.649235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:32.653921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:32.654413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:32.655312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:32.679343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:32.848006 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1565/3135] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:01:32 2022] POST /identity/v3/projects => generated 401 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:32.852844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:32.865828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad35df4-77d5-44d0-8706-cc54a120f849 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:33.100064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:33.101766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.102441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.102825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.103855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:33.109291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:33.130617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:33.270035 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1571/3136] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:01:32 2022] POST /identity/v3/users => generated 301 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:33.274115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:33.316006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4a579-5a76-4413-aa08-ad3eba9ccfb4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:33.327824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43c27-8667-469d-8520-ef7ae13b5494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:33.328797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43c27-8667-469d-8520-ef7ae13b5494 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.329264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43c27-8667-469d-8520-ef7ae13b5494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.329756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43c27-8667-469d-8520-ef7ae13b5494 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.330658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d43c27-8667-469d-8520-ef7ae13b5494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:33.339381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d43c27-8667-469d-8520-ef7ae13b5494 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:33.417686 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1566/3137] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:33.420048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:33.439214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055b54c-161b-4e6c-9046-ea31e5d6dffd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:33.455118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417669ea-d0da-4b3e-b276-f28c85a74961 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.455922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417669ea-d0da-4b3e-b276-f28c85a74961 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.457022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417669ea-d0da-4b3e-b276-f28c85a74961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.463451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:33.467467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.467824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.468101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.468992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:33.478307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:33.519819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1572/3138] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:33.519954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:33.553026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-417669ea-d0da-4b3e-b276-f28c85a74961 None None] MFA Rules not processed for user `fcc8c171b6924b6db1dae66f78cc39e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:33.553026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-417669ea-d0da-4b3e-b276-f28c85a74961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:33.563968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb92d-88f5-4a1b-a668-925068cd48de admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:33.569481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:33.570895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.571397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.571768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] PATH_INFO: `/v3/projects/c342ce57e97c427d9138546094a987e3/users/32c9ef43a5bd4d8d80b4c105ac499114/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.637921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c342ce57e97c427d9138546094a987e3, user_id=32c9ef43a5bd4d8d80b4c105ac499114, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:33.647641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:33.741310 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1567/3139] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:33.744785 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1573/3140] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:33 2022] PUT /identity/v3/projects/c342ce57e97c427d9138546094a987e3/users/32c9ef43a5bd4d8d80b4c105ac499114/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:01:33.751498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.752464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.753387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.762156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:33.765291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:33.823130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:33.827782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:33.938820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75c829-ed85-47cd-8c52-8b9616a2abe1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:33.955186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:33.955825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:33.956109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:33.974459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:33.982978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:33.996757 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1568/3141] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:34.052122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:34.055261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:34.119520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:34.234976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:34.239267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265b3c-645c-4c51-8478-2efeb6a4b4e2 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:34.273061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62aaca-40e1-4c15-8148-9c2e4e92269a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:34.275295 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1574/3142] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:34.287292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34641c91-0fbc-4f73-9316-e55e94627045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:34.288465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34641c91-0fbc-4f73-9316-e55e94627045 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:34.288465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34641c91-0fbc-4f73-9316-e55e94627045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:34.288725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34641c91-0fbc-4f73-9316-e55e94627045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:34.320762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34641c91-0fbc-4f73-9316-e55e94627045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:34.324404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34641c91-0fbc-4f73-9316-e55e94627045 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:34.346852 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1569/3143] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:38.563645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:38.563645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:38.563645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:38.646603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:38.654713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:38.859845 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1575/3144] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:40.543568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da504-e4d3-474e-b299-378421dbdfed None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:40.548721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da504-e4d3-474e-b299-378421dbdfed None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:40.551746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da504-e4d3-474e-b299-378421dbdfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:40.594428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ea0da504-e4d3-474e-b299-378421dbdfed None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:40.596078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea0da504-e4d3-474e-b299-378421dbdfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:40.627324 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1570/3145] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:41.502386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:41.502386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:41.502386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:41.502386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05463052-7475-485b-8c18-90d3f10c1254 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:41.509756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:41.509756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:41.509756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:41.509756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:41.511644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:41.596297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:41.598692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae8a4e-f68f-439f-af22-7e24ac3b9d69 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:41.614208 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1576/3146] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:41.768296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:41.769214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:41.769702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:41.832076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] MFA Rules not processed for user `f789eab7f7554fc1839bdaced7a2d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:41.838538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:42.032143 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1571/3147] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:42.033673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:42.034229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:42.034656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:42.075094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] MFA Rules not processed for user `f789eab7f7554fc1839bdaced7a2d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:42.077176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:42.092891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1577/3148] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:01:42.383415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:42.385025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:42.419665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5fe31-a3f1-42c5-ae68-811c4d947044 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:42.436945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad476-75ac-4e8d-9550-07a2b14f11ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:42.437675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad476-75ac-4e8d-9550-07a2b14f11ef service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:42.438075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad476-75ac-4e8d-9550-07a2b14f11ef service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:42.438442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad476-75ac-4e8d-9550-07a2b14f11ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:42.464110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad476-75ac-4e8d-9550-07a2b14f11ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:42.470584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad476-75ac-4e8d-9550-07a2b14f11ef service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:42.495674 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1572/3149] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:43.843859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:43.856872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a898c5-99c1-40dc-b8d7-09cf91479118 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:43.878396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:43.879248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:43.879697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:43.880116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:43.886832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:43.910778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:43.912395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:43.928019 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1578/3150] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:48.604788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32c6b-1733-4f70-ae7f-a76ea661f2fd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:48.605327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32c6b-1733-4f70-ae7f-a76ea661f2fd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:48.605327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32c6b-1733-4f70-ae7f-a76ea661f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:48.718250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c1d32c6b-1733-4f70-ae7f-a76ea661f2fd None None] MFA Rules not processed for user `9b79042dfe9242f8a4833a969fb1a911`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:48.731969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c1d32c6b-1733-4f70-ae7f-a76ea661f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:48.911140 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1573/3151] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:50.065453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:50.120293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca0f7-177a-4549-8f44-ddd0f8ec009b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:50.129328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:50.130472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:50.131012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:50.131690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:50.143151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:50.146695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:50.195380 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1579/3152] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:50.981588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89ab0-891d-4df0-bc54-7f0072a59764 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:50.982168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89ab0-891d-4df0-bc54-7f0072a59764 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:50.982884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89ab0-891d-4df0-bc54-7f0072a59764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:51.043461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:51.059471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a6c89ab0-891d-4df0-bc54-7f0072a59764 None None] MFA Rules not processed for user `32c9ef43a5bd4d8d80b4c105ac499114`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:51.063402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6c89ab0-891d-4df0-bc54-7f0072a59764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:51.212255 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1574/3153] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:51.526004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:51.559876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600bb18-870a-4081-9b74-1e1ae3452a84 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:51.591018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:51.591805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:51.592579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:51.593339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:51.618444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:51.624101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:51.650092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1580/3154] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:53.301069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:53.305371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:53.305371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:53.371805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] MFA Rules not processed for user `9b79042dfe9242f8a4833a969fb1a911`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:53.381897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:53.414957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1575/3155] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:01.638720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=72 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:03.344401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=29 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:04.914896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:04.930614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d16d-e406-41d0-82a4-d1235d470721 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:04.938112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:04.939068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:04.939599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:04.940116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] PATH_INFO: `/v3/users/32c9ef43a5bd4d8d80b4c105ac499114` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:04.941582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c9ef43a5bd4d8d80b4c105ac499114)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:04.944160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:05.317043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c9ef43a5bd4d8d80b4c105ac499114'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:05.319207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c9ef43a5bd4d8d80b4c105ac499114'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:05.439692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c9ef43a5bd4d8d80b4c105ac499114'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:05.462198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c9ef43a5bd4d8d80b4c105ac499114'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:05.464217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-00128b23-93c4-4858-ac64-83cb910e598d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c9ef43a5bd4d8d80b4c105ac499114'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:05.518042 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1581/3156] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:04 2022] DELETE /identity/v3/users/32c9ef43a5bd4d8d80b4c105ac499114 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:06.347444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:06.366506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce7721-d803-4266-aff9-2a668fe9654b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:06.621057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:06.622129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:06.622244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:06.623687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] PATH_INFO: `/v3/projects/c342ce57e97c427d9138546094a987e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:06.631209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c342ce57e97c427d9138546094a987e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:06.631209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:06.878262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c342ce57e97c427d9138546094a987e3', 'request_id': 'req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:06.911854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c342ce57e97c427d9138546094a987e3', 'request_id': 'req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:06.926984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c342ce57e97c427d9138546094a987e3', 'request_id': 'req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:07.115447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] The token cache is being invalidate because project c342ce57e97c427d9138546094a987e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:07.115725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:07.116416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0484a6e6-62a5-41ca-8fcc-49d1ddab4c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:07.121683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1576/3157] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:06 2022] DELETE /identity/v3/projects/c342ce57e97c427d9138546094a987e3 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:02:07.123152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.123757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.123757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.145314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:07.147141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:07.258311 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1582/3158] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:07.263685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.264095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.264490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.313149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:07.326980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:07.336389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1577/3159] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:07.341705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:07.353231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f909964-173f-4e3e-940c-f8d27a06c035 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:07.359577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:07.360403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.360832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.361268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.362140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:07.362606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:07.364372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:07.383708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1583/3160] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:07.390373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:07.407089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75a87-23ec-4475-ab14-48e79fc9077f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:07.422054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:07.423022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.424127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.424600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.426291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:07.430568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:07.600354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1578/3161] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:07 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:07.605063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:07.616717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84507aa8-dbf3-47d8-9a94-4380f783d6bb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:07.800935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:07.801821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.801821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.802067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.802733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:07.812091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:07.825820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:07.941768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:07.955885 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1584/3162] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:07 2022] POST /identity/v3/users => generated 290 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:07.968273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fef1-f5a9-4c80-b14a-3c95e203d0f1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:07.992761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:07.993569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.998690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.998690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.998690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:08.000602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:08.035081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1579/3163] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:08.042270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:08.063163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab3589-663b-4fc1-80e0-6cd563d481f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:08.078552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c67724-dea2-48a7-a576-eb1eaeb8a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:08.079353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67724-dea2-48a7-a576-eb1eaeb8a2ae admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:08.079653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67724-dea2-48a7-a576-eb1eaeb8a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:08.079933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67724-dea2-48a7-a576-eb1eaeb8a2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:08.080607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c67724-dea2-48a7-a576-eb1eaeb8a2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:08.082269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c67724-dea2-48a7-a576-eb1eaeb8a2ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:08.116374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1585/3164] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:08.121014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:08.157122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f0b7-6f52-430a-886d-13f19a5e9c60 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:08.170644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:08.171424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:08.171621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:08.171922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] PATH_INFO: `/v3/projects/4c1ab10d9ba04d169f243d87e9320c64/users/4809f10d1a1b48f98912160941aa2724/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:08.211082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1ab10d9ba04d169f243d87e9320c64, user_id=4809f10d1a1b48f98912160941aa2724, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:08.214717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:08.344230 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1580/3165] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:08 2022] PUT /identity/v3/projects/4c1ab10d9ba04d169f243d87e9320c64/users/4809f10d1a1b48f98912160941aa2724/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:08.364347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef23b3-8085-48c6-9212-a0a2665b5ebe None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:08.364347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef23b3-8085-48c6-9212-a0a2665b5ebe None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:08.364347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef23b3-8085-48c6-9212-a0a2665b5ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:08.432055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-efef23b3-8085-48c6-9212-a0a2665b5ebe None None] MFA Rules not processed for user `4809f10d1a1b48f98912160941aa2724`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:08.433802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efef23b3-8085-48c6-9212-a0a2665b5ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:08.586402 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1586/3166] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:08.930068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:08.932719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:09.003816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:09.116989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2d66-b63a-4862-b842-f9fb1f9f6829 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:09.149017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:09.150528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:09.151429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:09.151900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:09.171543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:09.178385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:09.209001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1581/3167] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:02:10.261683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:10.262128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:10.262393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:10.287982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] MFA Rules not processed for user `1672b0b7c93c4959a3e803902333f823`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:10.289293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:10.427170 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1587/3168] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:13.026086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:13.048057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:13.051236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:13.152041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d16ed-66db-403b-8efa-45c707699e2d service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:13.154044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0997797-ff95-40dd-80ff-5ea6ce3c33ce None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:13.158124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:13.159006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:13.159565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:13.160009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] PATH_INFO: `/v3/users/4809f10d1a1b48f98912160941aa2724` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:13.161503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4809f10d1a1b48f98912160941aa2724)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:13.164091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:13.166167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:13.167898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:13.168697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:13.169045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] PATH_INFO: `/v3/users/122174705b7e43ac8f85a8b0160cd693` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:13.170805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122174705b7e43ac8f85a8b0160cd693)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:13.174118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:13.200862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:13.524195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122174705b7e43ac8f85a8b0160cd693'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.525239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122174705b7e43ac8f85a8b0160cd693'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.526434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4809f10d1a1b48f98912160941aa2724'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.541291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4809f10d1a1b48f98912160941aa2724'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.549164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4809f10d1a1b48f98912160941aa2724'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.550002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4809f10d1a1b48f98912160941aa2724'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.550958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eae03000-aea6-4b89-b581-22a12d5c0913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4809f10d1a1b48f98912160941aa2724'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.742955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122174705b7e43ac8f85a8b0160cd693'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.768728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122174705b7e43ac8f85a8b0160cd693'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.768728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-28adc260-be54-41f8-b714-5000c28c4a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122174705b7e43ac8f85a8b0160cd693'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:13.824775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1588/3169] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:13 2022] DELETE /identity/v3/users/122174705b7e43ac8f85a8b0160cd693 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:13.827164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:13.828709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:13.829810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:13.858544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1582/3170] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:13 2022] DELETE /identity/v3/users/4809f10d1a1b48f98912160941aa2724 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:13.863660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:13.864041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:13.864423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:13.881709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] MFA Rules not processed for user `f789eab7f7554fc1839bdaced7a2d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:13.883306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:13.891776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:13.893113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:13.924700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:13.982475 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1583/3171] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:13.997586 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1589/3172] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:13.999231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:14.000846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:14.082547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976986e-b52f-4cad-8caf-60cc58f66330 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:14.088893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:14.089534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:14.089971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:14.090183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:14.109572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:14.109572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:14.122112 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1584/3173] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:15.074152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:15.075938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:15.093399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02bb14-c1c3-43b7-ba13-0799ef1e2493 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:15.100168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:15.106371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.106371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.106371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] PATH_INFO: `/v3/projects/722e7cf4482747a98836d2a4a1761042` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.106371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] RBAC: Authorizing `identity:delete_project(project_id=722e7cf4482747a98836d2a4a1761042)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:15.106371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:15.248803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:15.253183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:15.279352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffce5f5-ec2c-4878-8fe6-551985e80ba5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:15.286450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:15.287518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.287827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.288123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] PATH_INFO: `/v3/projects/4c1ab10d9ba04d169f243d87e9320c64` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.289454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1ab10d9ba04d169f243d87e9320c64)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:15.292270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:15.332451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722e7cf4482747a98836d2a4a1761042', 'request_id': 'req-733a95e4-10e9-41a6-9e4a-a9febd0a575a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.359093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722e7cf4482747a98836d2a4a1761042', 'request_id': 'req-733a95e4-10e9-41a6-9e4a-a9febd0a575a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.367462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722e7cf4482747a98836d2a4a1761042', 'request_id': 'req-733a95e4-10e9-41a6-9e4a-a9febd0a575a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.509882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] The token cache is being invalidate because project 722e7cf4482747a98836d2a4a1761042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:15.510187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.513540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.515651 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1590/3174] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:15 2022] DELETE /identity/v3/projects/722e7cf4482747a98836d2a4a1761042 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:15.519728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:15.522466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:15.549288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1ab10d9ba04d169f243d87e9320c64', 'request_id': 'req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.557772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1ab10d9ba04d169f243d87e9320c64', 'request_id': 'req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.570529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1ab10d9ba04d169f243d87e9320c64', 'request_id': 'req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.637485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a95e4-10e9-41a6-9e4a-a9febd0a575a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:15.712535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:15.713936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.714232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.714499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] PATH_INFO: `/v3/users/1e9d23f811c74800ba53ae611844a8d0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.716374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9d23f811c74800ba53ae611844a8d0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:15.718433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:15.792879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] The token cache is being invalidate because project 4c1ab10d9ba04d169f243d87e9320c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:15.793713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.795048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39bbb1b6-962d-4317-94c2-aa9506fdbc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:15.797763 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1585/3175] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:15 2022] DELETE /identity/v3/projects/4c1ab10d9ba04d169f243d87e9320c64 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:15.821989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2eaba-f6c4-4dca-b098-8cb34343354a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.822544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2eaba-f6c4-4dca-b098-8cb34343354a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.825007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2eaba-f6c4-4dca-b098-8cb34343354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.857664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8bc2eaba-f6c4-4dca-b098-8cb34343354a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:15.858948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8bc2eaba-f6c4-4dca-b098-8cb34343354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:15.868158 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1586/3176] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:15.878218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2501-5608-4cfa-b371-fad77375425e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.878653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2501-5608-4cfa-b371-fad77375425e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.879228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2501-5608-4cfa-b371-fad77375425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.908088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-161f2501-5608-4cfa-b371-fad77375425e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:15.911520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-161f2501-5608-4cfa-b371-fad77375425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:15.920749 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1587/3177] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:15.925468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f2501-5608-4cfa-b371-fad77375425e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:15.935371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f2501-5608-4cfa-b371-fad77375425e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:15.941462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:15.942814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.943283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.943562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.944233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:15.944544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:15.946191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:15.966344 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1588/3178] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:02:15.967609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:15.979077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896180-4d49-40a0-9a02-543b672fcf15 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:15.984621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:15.985260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:15.985625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:15.985816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:15.986543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:15.988746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:16.190991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9d23f811c74800ba53ae611844a8d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:16.193037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9d23f811c74800ba53ae611844a8d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:16.220903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1589/3179] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:15 2022] POST /identity/v3/projects => generated 391 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:16.225553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:16.307035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76261ee4-07b9-4f2e-bd07-536c068163c1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:16.312265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:16.313053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:16.313361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:16.313626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:16.314343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:16.316411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:16.356105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9d23f811c74800ba53ae611844a8d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:16.364326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9d23f811c74800ba53ae611844a8d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:16.365710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9d23f811c74800ba53ae611844a8d0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:16.389458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1591/3180] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:15 2022] DELETE /identity/v3/users/1e9d23f811c74800ba53ae611844a8d0 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:16.447582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1590/3181] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:16 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:16.452798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:16.456608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:16.592969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a852f-6e86-4df1-9aa0-e9e154cf9fa5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:16.609228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:16.610465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:16.610951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:16.611387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:16.612130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:16.613803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:16.641284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1592/3182] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:16.648006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:16.681828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a34c7b-70aa-404e-a037-e4ef41a20c1b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:16.688330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f5e5-c97c-42dc-9400-885cbcff3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:16.689318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f5e5-c97c-42dc-9400-885cbcff3be9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:16.689886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f5e5-c97c-42dc-9400-885cbcff3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:16.690555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f5e5-c97c-42dc-9400-885cbcff3be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:16.691482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f5e5-c97c-42dc-9400-885cbcff3be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:16.693496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f5e5-c97c-42dc-9400-885cbcff3be9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:16.716100 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1591/3183] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:16.716371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:16.733677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23297fd-aa60-453e-8972-d43e07539bc1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:16.748926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:16.750318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:16.750778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:16.751176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] PATH_INFO: `/v3/projects/1a4dc740cfd04b688b43856392603453/users/4b712e714ad64bd4a4452540de7c45bc/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:16.791499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4dc740cfd04b688b43856392603453, user_id=4b712e714ad64bd4a4452540de7c45bc, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:16.797431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:16.804747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:16.938828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1593/3184] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:16 2022] PUT /identity/v3/projects/1a4dc740cfd04b688b43856392603453/users/4b712e714ad64bd4a4452540de7c45bc/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:16.940587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:16.940948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:16.941252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:16.982748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:16.986728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:17.001799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:17.006613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:17.112510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7aa65-79e7-49d7-93a7-9e65f936bf4b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:17.117473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:17.119893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:17.119893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:17.119893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:17.141120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:17.166456 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1592/3185] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:02:17.167675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:17.182873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:17.206203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec238d-0757-47ab-81dc-a6b148ca3216 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:17.215332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:17.216022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:17.217389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:17.217692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] PATH_INFO: `/v3/projects/84c7175ddb9b4afb90a388c22813b629` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:17.219066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c7175ddb9b4afb90a388c22813b629)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:17.221016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:17.236413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:17.238465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:17.256950 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1594/3186] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:17.257730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:17.270875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdd731-5a9a-4e6c-8b22-7d535b8e1381 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:17.277338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c54f90-4a0d-424b-847c-3c165ae2d44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:17.278256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c54f90-4a0d-424b-847c-3c165ae2d44e service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:17.278544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c54f90-4a0d-424b-847c-3c165ae2d44e service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:17.283638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c54f90-4a0d-424b-847c-3c165ae2d44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:17.291982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c54f90-4a0d-424b-847c-3c165ae2d44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:17.294540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c54f90-4a0d-424b-847c-3c165ae2d44e service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:17.312498 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1595/3187] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:17.553578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c7175ddb9b4afb90a388c22813b629', 'request_id': 'req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:17.563779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c7175ddb9b4afb90a388c22813b629', 'request_id': 'req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:17.571536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c7175ddb9b4afb90a388c22813b629', 'request_id': 'req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:17.578341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:17.769300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] The token cache is being invalidate because project 84c7175ddb9b4afb90a388c22813b629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:17.774531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:17.776109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da4b93d6-91c1-458e-9bc6-87d0f62adbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:17.781092 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1593/3188] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:17 2022] DELETE /identity/v3/projects/84c7175ddb9b4afb90a388c22813b629 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:17.786592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:17.787232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:17.787820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:17.832698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:17.834719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:17.972297 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1596/3189] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:17.974245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:17.974567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:17.974895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:18.001517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:18.002898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:18.012857 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1594/3190] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:18.018177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:18.048942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d174dc-dc7f-4dcb-a025-32d169ba8f1c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:18.063114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:18.063929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:18.064332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:18.064686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:18.067556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:18.068303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:18.072894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:18.094928 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1597/3191] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:18.100143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:18.112623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1744d30-8976-4678-bd33-b165fad56f43 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:18.118522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:18.119553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:18.120024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:18.124682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:18.124682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:18.124682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:18.327995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1595/3192] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:18 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:18.329229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:18.364943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ef403-ffcc-4e37-81ed-7a85ec157496 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:18.514622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:18.515176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:18.515459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:18.515739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:18.516399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:18.519322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:18.742285 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1598/3193] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:18 2022] POST /identity/v3/users => generated 294 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:18.747056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:18.776609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0837d8-197a-4863-abb6-4ffb2ee77054 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:18.804861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:18.818818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:18.820929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:18.823011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:18.823942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:18.826303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:18.856910 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1596/3194] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:18.861607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:18.877187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484996e-8241-41b6-ae36-dc280f1fe416 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:18.888511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c34d80-9df9-492d-a49a-6eebb589b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:18.889151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c34d80-9df9-492d-a49a-6eebb589b5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:18.891402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c34d80-9df9-492d-a49a-6eebb589b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:18.891850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c34d80-9df9-492d-a49a-6eebb589b5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:18.894016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c34d80-9df9-492d-a49a-6eebb589b5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:18.898192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c34d80-9df9-492d-a49a-6eebb589b5a5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:18.945003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1599/3195] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:02:18.951887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:18.982685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f254b3-f703-4fce-b3b1-061a8de342d1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:18.997698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:18.999250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:18.999964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:19.000693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] PATH_INFO: `/v3/projects/39cfea9773a844c8b856e858790c5903/users/61a502a637bf4994996fb7de57e59244/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:19.026487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cfea9773a844c8b856e858790c5903, user_id=61a502a637bf4994996fb7de57e59244, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:19.030151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:19.273909 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1597/3196] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:18 2022] PUT /identity/v3/projects/39cfea9773a844c8b856e858790c5903/users/61a502a637bf4994996fb7de57e59244/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:19.361911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:19.362759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:19.363274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:19.422026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] MFA Rules not processed for user `61a502a637bf4994996fb7de57e59244`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:19.422026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:19.514528 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1600/3197] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:19.515172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:19.659708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ecdb0-4bdb-48e1-b1ad-80ec03dee511 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:19.675864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:19.677398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:19.677887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:19.678304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:19.682233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:19.682233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:19.897667 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1598/3198] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:19 2022] POST /identity/v3/projects => generated 387 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:19.902966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:19.933427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e249-3387-4187-9ce4-f4f6eaa31fcb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:20.112051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:20.112687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:20.115256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:20.115256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:20.115256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:20.116042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:20.287148 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1601/3199] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:19 2022] POST /identity/v3/users => generated 300 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:20.289284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:20.328016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe076f9-639e-4430-ac50-4ca4bb4da343 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:20.346063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:20.348055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:20.348669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:20.349152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:20.350454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:20.353312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:20.398684 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1599/3200] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:20.413924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:20.426833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9fc5f-f4b6-42c6-84b5-b1746d674864 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:20.432958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:20.434027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:20.434534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:20.435007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] PATH_INFO: `/v3/projects/68062b3b897d43efba8ec952d0a04125/users/69590e935f8b49e19cf52999a64e276b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:20.460038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68062b3b897d43efba8ec952d0a04125, user_id=69590e935f8b49e19cf52999a64e276b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:20.463782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:20.701102 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1602/3201] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:20 2022] PUT /identity/v3/projects/68062b3b897d43efba8ec952d0a04125/users/69590e935f8b49e19cf52999a64e276b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:20.705685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:20.723472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b103e0-15a4-4b96-a1e4-6a20d9e23432 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:20.892475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef97058-fb85-4eaa-93bc-f05322697bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:20.903462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97058-fb85-4eaa-93bc-f05322697bfc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:20.903462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97058-fb85-4eaa-93bc-f05322697bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:20.903462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97058-fb85-4eaa-93bc-f05322697bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:20.903462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef97058-fb85-4eaa-93bc-f05322697bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:20.903462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef97058-fb85-4eaa-93bc-f05322697bfc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:20.927461 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1600/3202] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:20.932088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:20.945905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0293e65-1434-4e4a-8c47-32112030a7b5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:20.962212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:20.962971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:20.963207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:20.964088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] PATH_INFO: `/v3/projects/68062b3b897d43efba8ec952d0a04125/users/69590e935f8b49e19cf52999a64e276b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:20.968838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68062b3b897d43efba8ec952d0a04125, user_id=69590e935f8b49e19cf52999a64e276b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:20.971618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:21.000556 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1603/3203] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:20 2022] PUT /identity/v3/projects/68062b3b897d43efba8ec952d0a04125/users/69590e935f8b49e19cf52999a64e276b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:21.012700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:21.013244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:21.013708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:21.080876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] MFA Rules not processed for user `69590e935f8b49e19cf52999a64e276b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:21.083651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:21.246824 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1601/3204] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:21.447804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:21.741637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:21.744194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:21.875399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827289-193a-40a2-b7ba-d43c64c87232 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:21.889797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:21.890585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:21.892569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:21.892949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:21.916560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:21.921273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:21.959510 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1604/3205] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:22.012609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:22.942705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:22.942705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:23.118653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e98b4e-c698-42de-b5f5-715ec08ed711 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:23.125021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:23.125720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:23.126321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:23.126733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] PATH_INFO: `/v3/users/c57647deea08499999217def99872956` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:23.128180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57647deea08499999217def99872956)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:23.130160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:23.382779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57647deea08499999217def99872956'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:23.426004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57647deea08499999217def99872956'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:23.436531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57647deea08499999217def99872956'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:23.437294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57647deea08499999217def99872956'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:23.438809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-25df8fb7-5ae8-471a-8ee6-be1916ee002b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57647deea08499999217def99872956'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:23.523568 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1602/3206] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:22 2022] DELETE /identity/v3/users/c57647deea08499999217def99872956 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:24.007300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:24.035492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53dbf7-cc75-4d15-9989-959f249467d4 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:24.198260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:24.199040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:24.199251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:24.199534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] PATH_INFO: `/v3/projects/b17b22bb35cc4f958d5d71f17e8af7fd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:24.200887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17b22bb35cc4f958d5d71f17e8af7fd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:24.203442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:24.370901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:24.402557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17b22bb35cc4f958d5d71f17e8af7fd', 'request_id': 'req-164ec50c-af12-4f31-a72f-73ce6e43ef48'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:24.409661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17b22bb35cc4f958d5d71f17e8af7fd', 'request_id': 'req-164ec50c-af12-4f31-a72f-73ce6e43ef48'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:24.423701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17b22bb35cc4f958d5d71f17e8af7fd', 'request_id': 'req-164ec50c-af12-4f31-a72f-73ce6e43ef48'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:24.570103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] The token cache is being invalidate because project b17b22bb35cc4f958d5d71f17e8af7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:24.570523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:24.571244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-164ec50c-af12-4f31-a72f-73ce6e43ef48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:24.573445 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1605/3207] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:24 2022] DELETE /identity/v3/projects/b17b22bb35cc4f958d5d71f17e8af7fd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:24.581200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:24.581745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:24.581830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:24.644944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:24.646218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:24.799761 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1603/3208] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:24.809351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:24.809775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:24.810657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:24.841001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:24.850305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:24.862393 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1606/3209] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:24.866581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:24.883261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc995-c376-4f71-9786-40a4a8df9fa7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:24.890435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:24.891065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:24.891351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:24.891652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:24.892306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:24.892591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:24.895100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:24.909936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1604/3210] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:24.915923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:24.925929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3183f5-c9ac-4773-a25f-8538e9b3db65 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:24.931732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:24.932410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:24.932766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:24.933068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:24.933759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:24.935877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:25.038327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:25.096449 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1607/3211] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:24 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:25.100630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:25.118653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629082-ecff-4516-88c6-7078fa4920fd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:25.227819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:25.228860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:25.229541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:25.230126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:25.231508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:25.234354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:25.322685 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1605/3212] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:25 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:25.326169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:25.342474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726b236-3621-44fb-9bf5-24d170483792 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:25.348859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:25.349879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:25.350371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:25.351077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:25.352058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:25.354624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:25.371729 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1608/3213] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:25.375673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:25.394488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f54e-6c03-4094-8102-1b955a21c53f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:25.401897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaf3d2-9ded-4489-85b0-0beab684a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:25.402814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaf3d2-9ded-4489-85b0-0beab684a402 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:25.403682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaf3d2-9ded-4489-85b0-0beab684a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:25.404528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaf3d2-9ded-4489-85b0-0beab684a402 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:25.405621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaf3d2-9ded-4489-85b0-0beab684a402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:25.408997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaf3d2-9ded-4489-85b0-0beab684a402 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:25.442182 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1606/3214] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:25.446744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:25.461540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a5a1-657d-4392-bd5b-cd5417d44d27 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:25.471553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:25.472791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:25.473457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:25.477586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] PATH_INFO: `/v3/projects/dd7de14bdd13467184df8d1609bab6c3/users/73ab826d87cb4376bbebf3d02ec5e115/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:25.503381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7de14bdd13467184df8d1609bab6c3, user_id=73ab826d87cb4376bbebf3d02ec5e115, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:25.506900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:25.624878 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1609/3215] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:25 2022] PUT /identity/v3/projects/dd7de14bdd13467184df8d1609bab6c3/users/73ab826d87cb4376bbebf3d02ec5e115/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:25.626482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:25.626952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:25.627534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:25.674345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:25.677752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:25.773720 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1607/3216] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:25.808544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:25.810480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:25.924368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be9d8-f292-428d-9071-5dc3a0d2a73a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:25.939143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e0af2-8602-48b3-ad91-14f16e0670fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:25.940640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e0af2-8602-48b3-ad91-14f16e0670fd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:25.941539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e0af2-8602-48b3-ad91-14f16e0670fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:25.942150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e0af2-8602-48b3-ad91-14f16e0670fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:25.963546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e0af2-8602-48b3-ad91-14f16e0670fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:25.967080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e0af2-8602-48b3-ad91-14f16e0670fd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:25.996711 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1610/3217] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:26.192518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:26.194463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:26.217539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04c267-1d49-4315-8b81-b53c314eeee0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:26.229702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:26.240745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:26.241453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:26.245731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] PATH_INFO: `/v3/users/61a502a637bf4994996fb7de57e59244` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:26.250740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a502a637bf4994996fb7de57e59244)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:26.257424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:26.258128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:26.512710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a502a637bf4994996fb7de57e59244'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:26.542919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a502a637bf4994996fb7de57e59244'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:26.559808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a502a637bf4994996fb7de57e59244'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:26.560614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a502a637bf4994996fb7de57e59244'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:26.561300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a502a637bf4994996fb7de57e59244'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:26.664923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1608/3218] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:26 2022] DELETE /identity/v3/users/61a502a637bf4994996fb7de57e59244 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:26.666691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1c18-937c-456f-8315-39b5a74f5137 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:26.670412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1c18-937c-456f-8315-39b5a74f5137 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:26.670412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1c18-937c-456f-8315-39b5a74f5137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:26.713797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5b4b1c18-937c-456f-8315-39b5a74f5137 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:26.716525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5b4b1c18-937c-456f-8315-39b5a74f5137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:26.823456 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1611/3219] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:26.881262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:26.884138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:26.906474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:27.063780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040961b-c56a-4ca2-93bb-7374d9f72094 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:27.081618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:27.082297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:27.082825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:27.083376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:27.120987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:27.122656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:27.176521 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1609/3220] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:28.482635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:28.482635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:28.483317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:28.547566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:28.556207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:28.713467 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1612/3221] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:02:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:02:28.996191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:29.134797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:29.137069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:29.293063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19922e-1feb-4dd6-b8a1-c077a2f55e5b service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:29.299222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:29.301038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:29.308034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:29.308966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:29.309910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:29.312641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:29.327117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5fab-1ecd-4856-808f-8062d115dbbf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:29.335425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:29.341346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:29.343081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:29.343732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:29.344009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:29.344284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] PATH_INFO: `/v3/projects/39cfea9773a844c8b856e858790c5903` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:29.345741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39cfea9773a844c8b856e858790c5903)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:29.347680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:29.385503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1610/3222] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:02:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:02:29.637931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cfea9773a844c8b856e858790c5903', 'request_id': 'req-750bcc05-0a65-41c6-80bc-06ab3300c46a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:29.658204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cfea9773a844c8b856e858790c5903', 'request_id': 'req-750bcc05-0a65-41c6-80bc-06ab3300c46a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:29.688352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cfea9773a844c8b856e858790c5903', 'request_id': 'req-750bcc05-0a65-41c6-80bc-06ab3300c46a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:29.770690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] The token cache is being invalidate because project 39cfea9773a844c8b856e858790c5903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:29.771338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:29.773729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:29.778167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1613/3223] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:29 2022] DELETE /identity/v3/projects/39cfea9773a844c8b856e858790c5903 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:29.785929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:29.817475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9cbd4-bc0b-46f5-b2d6-5c6efc2e75e0 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:30.078605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:30.079314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:30.079596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:30.080167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] PATH_INFO: `/v3/users/69590e935f8b49e19cf52999a64e276b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:30.084022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69590e935f8b49e19cf52999a64e276b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:30.086007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:30.420456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69590e935f8b49e19cf52999a64e276b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:30.459036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69590e935f8b49e19cf52999a64e276b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:30.479445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69590e935f8b49e19cf52999a64e276b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:30.482176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69590e935f8b49e19cf52999a64e276b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:30.483608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a70a939-503d-46e9-bb6c-f8d56b57eb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69590e935f8b49e19cf52999a64e276b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:30.641024 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1611/3224] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:29 2022] DELETE /identity/v3/users/69590e935f8b49e19cf52999a64e276b => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:31.278698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:32.462064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:33.023478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:33.025575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:33.060430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bcc05-0a65-41c6-80bc-06ab3300c46a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:33.281577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:33.282686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:33.298003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:33.298003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] PATH_INFO: `/v3/projects/68062b3b897d43efba8ec952d0a04125` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:33.298003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68062b3b897d43efba8ec952d0a04125)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:33.301033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:33.507546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68062b3b897d43efba8ec952d0a04125', 'request_id': 'req-03c85cd8-19ec-45a1-a166-b9a1547a05b6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:33.536197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68062b3b897d43efba8ec952d0a04125', 'request_id': 'req-03c85cd8-19ec-45a1-a166-b9a1547a05b6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:33.556586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68062b3b897d43efba8ec952d0a04125', 'request_id': 'req-03c85cd8-19ec-45a1-a166-b9a1547a05b6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:33.587996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:33.689819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] The token cache is being invalidate because project 68062b3b897d43efba8ec952d0a04125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:33.690455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:33.692744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-03c85cd8-19ec-45a1-a166-b9a1547a05b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:33.706727 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1614/3225] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:33 2022] DELETE /identity/v3/projects/68062b3b897d43efba8ec952d0a04125 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:33.707365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:33.707683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:33.708030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:33.755298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:33.762281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:34.053019 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1612/3226] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:34.061609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:34.062166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:34.062603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:34.139134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:34.140407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:34.179390 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1615/3227] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:02:34.183031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:34.202374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97fab-478b-4a99-b2b2-ae5d120371f3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:34.247445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:34.253467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:34.254821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:34.256337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:34.261637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:34.262323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:34.264091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:34.291336 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1613/3228] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:02:34.295956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:34.307911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f558-c0a5-44cb-8f68-34d04f072881 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:34.325434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:34.326048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:34.326337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:34.326610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:34.327482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:34.339031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:34.382017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:34.480063 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1616/3229] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:34 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:34.484613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:34.499521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9c4d-e00c-44d7-b948-dbdcd07bb891 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:34.710168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:34.716216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:34.716216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:34.721979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:34.722770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:34.724792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:34.859679 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1614/3230] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:34 2022] POST /identity/v3/users => generated 288 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:34.860724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:34.908351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f74a84-12ef-4b20-8c0a-af3cba947e2f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:34.959154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:34.965135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:34.984446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:34.988168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:34.994348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:35.001113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:35.017568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:35.053788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1617/3231] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:02:35.059480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:35.074076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998fbf-8fa3-4d08-9d70-73bab6665386 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:35.094299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30d0c-ffa7-47dc-a36b-ef59435d0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:35.095317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30d0c-ffa7-47dc-a36b-ef59435d0c86 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:35.095813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30d0c-ffa7-47dc-a36b-ef59435d0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:35.096297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30d0c-ffa7-47dc-a36b-ef59435d0c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:35.097166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30d0c-ffa7-47dc-a36b-ef59435d0c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:35.102663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30d0c-ffa7-47dc-a36b-ef59435d0c86 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:35.132878 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1615/3232] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:35.137401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:35.168520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd67a-4650-4a98-b57b-b2fbb04b2e99 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:35.207452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:35.210080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:35.216568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:35.216568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] PATH_INFO: `/v3/projects/10b2e9c96bb74de892dfd86e6a57642e/users/c84b7cf69e0f423eafacb265d78ae39d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:35.268826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b2e9c96bb74de892dfd86e6a57642e, user_id=c84b7cf69e0f423eafacb265d78ae39d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:35.282770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:35.375240 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1618/3233] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:35 2022] PUT /identity/v3/projects/10b2e9c96bb74de892dfd86e6a57642e/users/c84b7cf69e0f423eafacb265d78ae39d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:35.387113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:35.387400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:35.388196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:35.484528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] MFA Rules not processed for user `c84b7cf69e0f423eafacb265d78ae39d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:35.485700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:35.584850 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1616/3234] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:35.591158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:35.778313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b7f95-6f4e-40df-a7d5-2d9d4fbf9988 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:35.792827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cf4da-a5f2-4041-8a09-62a10dab7767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:35.795589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cf4da-a5f2-4041-8a09-62a10dab7767 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:35.796128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cf4da-a5f2-4041-8a09-62a10dab7767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:35.796756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cf4da-a5f2-4041-8a09-62a10dab7767 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:35.797645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cf4da-a5f2-4041-8a09-62a10dab7767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:35.802853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cf4da-a5f2-4041-8a09-62a10dab7767 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:35.959915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1619/3235] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:35 2022] POST /identity/v3/projects => generated 373 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:35.963669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:35.985946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa3a47-8f3e-4778-9817-45ba3623c4d1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:36.272947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:36.274436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:36.274876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:36.275319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:36.276713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:36.279105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:36.307576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b5c4-0a8f-4f1d-8595-ea392809eb68 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:36.308303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b5c4-0a8f-4f1d-8595-ea392809eb68 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:36.308787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b5c4-0a8f-4f1d-8595-ea392809eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:36.348868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0813b5c4-0a8f-4f1d-8595-ea392809eb68 None None] MFA Rules not processed for user `4b712e714ad64bd4a4452540de7c45bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:36.350535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0813b5c4-0a8f-4f1d-8595-ea392809eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:36.387297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:36.425884 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1617/3236] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:35 2022] POST /identity/v3/users => generated 293 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:36.427068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:36.463353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f5fa8-c840-4a26-946c-d4ab3e60960a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:36.481900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:36.486535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:36.487264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:36.489845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:36.492722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:36.504982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:36.537975 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1618/3237] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:36.540816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:36.543027 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1620/3238] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:36.555966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:36.556261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:36.556710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:36.582428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7735bbc-61ce-4676-a238-4b4b7aa15e02 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:36.603308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:36.604232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:36.604601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:36.605098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] PATH_INFO: `/v3/projects/5804cfa36eba4f7b8ac6f76fc4862088/users/05e554307fe7410c8bc730bff2f3a04c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:36.615299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] MFA Rules not processed for user `4b712e714ad64bd4a4452540de7c45bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:36.622901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:36.645206 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1621/3239] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:02:36.665690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5804cfa36eba4f7b8ac6f76fc4862088, user_id=05e554307fe7410c8bc730bff2f3a04c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:36.669242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:36.774181 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1619/3240] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:36 2022] PUT /identity/v3/projects/5804cfa36eba4f7b8ac6f76fc4862088/users/05e554307fe7410c8bc730bff2f3a04c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:36.782140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:36.819197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49bd08-1866-4c80-930a-ba1852d59d62 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:36.978241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4f5d7-ea9c-4eca-a858-8b3572776e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:36.979802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f5d7-ea9c-4eca-a858-8b3572776e08 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:36.983233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f5d7-ea9c-4eca-a858-8b3572776e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:36.983528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f5d7-ea9c-4eca-a858-8b3572776e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:36.985105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4f5d7-ea9c-4eca-a858-8b3572776e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:36.990509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4f5d7-ea9c-4eca-a858-8b3572776e08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:37.021559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1622/3241] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:37.022146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:37.037375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:37.044133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835d505-b927-43bc-9cfa-be2e9788aab0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:37.062436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:37.063127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:37.063411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:37.063686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] PATH_INFO: `/v3/projects/5804cfa36eba4f7b8ac6f76fc4862088/users/05e554307fe7410c8bc730bff2f3a04c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:37.069171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5804cfa36eba4f7b8ac6f76fc4862088, user_id=05e554307fe7410c8bc730bff2f3a04c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:37.083368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:37.120843 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1620/3242] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:37 2022] PUT /identity/v3/projects/5804cfa36eba4f7b8ac6f76fc4862088/users/05e554307fe7410c8bc730bff2f3a04c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:02:37.121941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:37.122828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:37.123118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:37.197013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] MFA Rules not processed for user `05e554307fe7410c8bc730bff2f3a04c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:37.199321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:37.462756 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1623/3243] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:02:37.469080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:37.491184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cbb2c-42b2-4163-85ff-75be1afd7175 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:37.502550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:37.503256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:37.503555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:37.503846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:37.504487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:37.504803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:37.508653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:37.545198 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1621/3244] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:37.546581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:37.574896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a019e1-e094-4825-acc5-16bbc2ea3ef6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:37.598443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:37.599826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:37.600584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:37.603023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:37.605662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:37.611961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:37.885656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:37.886444 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1624/3245] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:37 2022] POST /identity/v3/projects => generated 371 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:37.902513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff2fde-33eb-4c97-8887-0775515b9521 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:38.055348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:38.057683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:38.058513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:38.059312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:38.061196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:38.069036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:38.074365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:38.123180 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1622/3246] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:38.916435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:38.919492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:39.023207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:39.181129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a64e-a2eb-4ae2-ae8b-36cedf5813ed tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:39.200974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077e11e-407e-47f6-ad0f-b10da2814229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:39.202015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077e11e-407e-47f6-ad0f-b10da2814229 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:39.202510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077e11e-407e-47f6-ad0f-b10da2814229 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:39.203024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077e11e-407e-47f6-ad0f-b10da2814229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:39.413434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077e11e-407e-47f6-ad0f-b10da2814229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:39.423389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077e11e-407e-47f6-ad0f-b10da2814229 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:39.459547 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1625/3247] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:42.735566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:42.823135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b958f97-860c-4c78-a6b5-5525d2b02f12 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:42.841792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:42.846280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:42.855455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:42.857223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:42.888650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:42.891119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:42.918033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1623/3248] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:42.948991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555579-d5c8-40c1-a017-eceb12c467ab None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:42.949751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555579-d5c8-40c1-a017-eceb12c467ab None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:42.949751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555579-d5c8-40c1-a017-eceb12c467ab None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:42.952374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1626/3249] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:02:42.971758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:02:43.032596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:43.100771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83dfc-977a-435d-80ef-d801940c7a9e service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:43.153221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:43.154119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:43.154407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:43.154791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:43.176180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8d7fb1159c943a8a6cf50bff94efcb5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:43.193037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:43.224953 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1624/3250] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:02:42 2022] GET /identity/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5 => generated 371 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:44.000605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555579-d5c8-40c1-a017-eceb12c467ab None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:44.003358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-89555579-d5c8-40c1-a017-eceb12c467ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:44.236202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555579-d5c8-40c1-a017-eceb12c467ab None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:44.240647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:44.241743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:44.242238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:44.243169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:44.252300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:44.300430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:44.303038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9abe1-1d4e-4e6e-acd9-76a4824a0b21 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:44.320993 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1627/3251] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:45.577016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:45.579162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:45.612365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06041ef-07d3-4790-b634-e342acd7fda7 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:45.624932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:45.627753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:45.628317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:45.628734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:45.639304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:45.677913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:45.685248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:45.727902 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1625/3252] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:46.092187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434690-e924-449a-b85f-3e4e1e1fe5ec None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:46.092739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434690-e924-449a-b85f-3e4e1e1fe5ec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:46.092739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434690-e924-449a-b85f-3e4e1e1fe5ec None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:46.094837 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1628/3253] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 20:02:46.109610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:02:46.130444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:46.164451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2cb7-0c77-4bb0-9b0b-1655dec095cc service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:46.183335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:46.184248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:46.187105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:46.187581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:46.189769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8d7fb1159c943a8a6cf50bff94efcb5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:46.192671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:46.197803 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1626/3254] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:02:46 2022] GET /identity/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:47.054140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ea75-8452-4a23-ae5f-051e19654bd1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:47.056582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ea75-8452-4a23-ae5f-051e19654bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:47.057420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ea75-8452-4a23-ae5f-051e19654bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:47.159951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d297ea75-8452-4a23-ae5f-051e19654bd1 None None] MFA Rules not processed for user `73ab826d87cb4376bbebf3d02ec5e115`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:47.168683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d297ea75-8452-4a23-ae5f-051e19654bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:47.486506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:47.592684 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1629/3255] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:49.446696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:49.491148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94532-ac86-4036-bacd-3b7c153cfaf8 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:49.531524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:49.541245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:49.541939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:49.542713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:49.577577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:49.579457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:49.628504 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1627/3256] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:52.722389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a7d79-fb83-4fe9-9f6b-f9feaa6065f1 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:52.722896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a7d79-fb83-4fe9-9f6b-f9feaa6065f1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:52.722972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a7d79-fb83-4fe9-9f6b-f9feaa6065f1 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:52.724340 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1630/3257] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:02:52.740666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:02:52.754982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:52.784748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2cb3e-831d-44f3-8979-816fd6643035 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:52.797088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d859500-0842-40dc-9947-98b1a3657074 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:52.800309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d859500-0842-40dc-9947-98b1a3657074 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:52.800609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d859500-0842-40dc-9947-98b1a3657074 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:52.800894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d859500-0842-40dc-9947-98b1a3657074 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:52.806449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d859500-0842-40dc-9947-98b1a3657074 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8d7fb1159c943a8a6cf50bff94efcb5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:52.810978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d859500-0842-40dc-9947-98b1a3657074 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:52.830856 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1628/3258] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:02:52 2022] GET /identity/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:52.861107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a7d79-fb83-4fe9-9f6b-f9feaa6065f1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:52.886916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a7d79-fb83-4fe9-9f6b-f9feaa6065f1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:52.897142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:52.898600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:52.900654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:52.901119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:52.903517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8d7fb1159c943a8a6cf50bff94efcb5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:52.908562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:53.180066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d7fb1159c943a8a6cf50bff94efcb5', 'request_id': 'req-02883896-2913-415f-a189-83455bb00c39'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.219149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d7fb1159c943a8a6cf50bff94efcb5', 'request_id': 'req-02883896-2913-415f-a189-83455bb00c39'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.239841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d7fb1159c943a8a6cf50bff94efcb5', 'request_id': 'req-02883896-2913-415f-a189-83455bb00c39'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.361131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] The token cache is being invalidate because project f8d7fb1159c943a8a6cf50bff94efcb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:53.361715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.369137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.379833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1631/3259] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:52 2022] DELETE /identity/v3/projects/f8d7fb1159c943a8a6cf50bff94efcb5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:55.861617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc807048-0131-4867-95f5-cc3295f596d3 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.866200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc807048-0131-4867-95f5-cc3295f596d3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.867460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc807048-0131-4867-95f5-cc3295f596d3 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.870011 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1629/3260] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:02:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:02:55.875567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:02:55.877622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:56.020501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:56.027466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:56.264312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02883896-2913-415f-a189-83455bb00c39 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:56.271460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:56.273049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:56.273837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:56.274559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/10b2e9c96bb74de892dfd86e6a57642e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:56.278231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=10b2e9c96bb74de892dfd86e6a57642e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:56.287590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:56.287590 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1632/3261] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:02:55 2022] GET /identity/v3/projects/10b2e9c96bb74de892dfd86e6a57642e => generated 375 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:56.313325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc807048-0131-4867-95f5-cc3295f596d3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:56.338312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc807048-0131-4867-95f5-cc3295f596d3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:56.360096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:56.360096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:56.360096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:56.360361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:56.360361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:56.360361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:56.361200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:56.376929 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1630/3262] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:02:56.381154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:56.398639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f125-8961-4c56-a694-a13e56cba93b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:56.425332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015f2d-729a-405e-9ea6-49662dc7a822 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:56.425332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015f2d-729a-405e-9ea6-49662dc7a822 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:56.425332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015f2d-729a-405e-9ea6-49662dc7a822 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:56.425845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015f2d-729a-405e-9ea6-49662dc7a822 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:56.425845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015f2d-729a-405e-9ea6-49662dc7a822 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:56.425845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015f2d-729a-405e-9ea6-49662dc7a822 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:56.435463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:56.565913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1633/3263] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:56 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:56.570286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:56.600360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2e47-f18c-4511-a2be-b26f4fb9666b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:56.703404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:56.722788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:56.723483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:56.723853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:56.724308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:56.724994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:56.725396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:56.727640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:56.766401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1631/3264] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:59.291460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92fbc7-ea49-46df-9c5c-bfba40cf2377 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:59.296718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92fbc7-ea49-46df-9c5c-bfba40cf2377 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:59.297345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92fbc7-ea49-46df-9c5c-bfba40cf2377 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:59.302351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1634/3265] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:02:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:02:59.312613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:02:59.451673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:59.463402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5c4b-74ad-4561-a6c1-809616133a6d tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:59.470117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8c24-b5fc-4ec0-8574-0680cdb17ef0 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:59.471052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8c24-b5fc-4ec0-8574-0680cdb17ef0 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:59.471560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8c24-b5fc-4ec0-8574-0680cdb17ef0 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:59.472040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8c24-b5fc-4ec0-8574-0680cdb17ef0 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/64fdf721724646959005e8b9a59e299b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:59.473603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d8c24-b5fc-4ec0-8574-0680cdb17ef0 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=64fdf721724646959005e8b9a59e299b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:59.476953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d8c24-b5fc-4ec0-8574-0680cdb17ef0 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:59.479226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1632/3266] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:02:59 2022] GET /identity/v3/projects/64fdf721724646959005e8b9a59e299b => generated 371 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:00.443151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92fbc7-ea49-46df-9c5c-bfba40cf2377 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:00.450955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8e92fbc7-ea49-46df-9c5c-bfba40cf2377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:00.489176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacc3c-8ec2-4b16-95c8-1c99121ed867 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:00.490302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacc3c-8ec2-4b16-95c8-1c99121ed867 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:00.490791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacc3c-8ec2-4b16-95c8-1c99121ed867 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:00.493198 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1633/3267] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:03:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:03:00.498638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacc3c-8ec2-4b16-95c8-1c99121ed867 None None] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:03:00.515855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacc3c-8ec2-4b16-95c8-1c99121ed867 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:00.527490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacc3c-8ec2-4b16-95c8-1c99121ed867 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:00.535922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:00.544975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:00.545966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:00.546705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/64fdf721724646959005e8b9a59e299b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:00.549233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=64fdf721724646959005e8b9a59e299b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:00.558362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:00.575793 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1634/3268] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:03:00 2022] GET /identity/v3/projects/64fdf721724646959005e8b9a59e299b => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:00.662254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:00.683618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367774-980d-419c-be14-f88547fb2e92 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:00.694088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:00.694926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:00.695341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:00.697501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:00.699883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:03:00.700564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:00.707997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:00.749001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92fbc7-ea49-46df-9c5c-bfba40cf2377 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:00.749247 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1635/3269] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:00.753452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:00.768640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:00.769622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:00.770133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:00.770610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:00.776621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:00.791421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518ed0-3359-4419-85ad-fa7de6b9f77e tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:00.801264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:00.804362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:00.812523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ab297-31d1-4f31-aede-bf598cbf4042 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:00.813314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab297-31d1-4f31-aede-bf598cbf4042 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:00.813726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab297-31d1-4f31-aede-bf598cbf4042 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:00.814117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab297-31d1-4f31-aede-bf598cbf4042 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:00.814890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab297-31d1-4f31-aede-bf598cbf4042 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:00.822197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab297-31d1-4f31-aede-bf598cbf4042 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:00.825451 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1635/3270] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:00.983963 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1636/3271] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:03:00 2022] POST /identity/v3/users => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:03:00.990329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:01.024552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651e2a3-3eba-43ac-8197-c5b6c45e22a3 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:01.029233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:01.030460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:01.031273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:01.034731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:01.036010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:03:01.036367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:01.038446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c6762-8f4d-4820-be3d-9878d6aaa72f tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:01.072690 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1636/3272] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:02.013961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61b77c-baf8-47a0-a007-6f6e7215aba2 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:02.015828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61b77c-baf8-47a0-a007-6f6e7215aba2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:02.016762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61b77c-baf8-47a0-a007-6f6e7215aba2 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:02.033425 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1637/3273] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:03:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:03:02.041189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60977-b343-4c21-82fa-26c4d45c6754 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:02.043011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60977-b343-4c21-82fa-26c4d45c6754 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:02.043310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60977-b343-4c21-82fa-26c4d45c6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:02.067453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61b77c-baf8-47a0-a007-6f6e7215aba2 None None] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:03:02.083707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-88e60977-b343-4c21-82fa-26c4d45c6754 None None] MFA Rules not processed for user `8dcc80a057c04b39b55bafd45fc95e20`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:02.086205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-88e60977-b343-4c21-82fa-26c4d45c6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:02.100378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61b77c-baf8-47a0-a007-6f6e7215aba2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:02.109777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61b77c-baf8-47a0-a007-6f6e7215aba2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:02.115463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767890b-11d0-42d2-8c1b-ecfa51b0550a tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:02.117343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767890b-11d0-42d2-8c1b-ecfa51b0550a tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:02.117796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767890b-11d0-42d2-8c1b-ecfa51b0550a tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:02.118259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767890b-11d0-42d2-8c1b-ecfa51b0550a tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/64fdf721724646959005e8b9a59e299b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:02.120646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767890b-11d0-42d2-8c1b-ecfa51b0550a tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=64fdf721724646959005e8b9a59e299b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:02.123417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767890b-11d0-42d2-8c1b-ecfa51b0550a tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:02.136820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1638/3274] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:03:02 2022] GET /identity/v3/projects/64fdf721724646959005e8b9a59e299b => generated 371 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:02.177424 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1637/3275] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:02.188283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:02.188820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:02.189259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:02.225502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] MFA Rules not processed for user `8dcc80a057c04b39b55bafd45fc95e20`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:02.227457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:02.239944 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1639/3276] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:03:05.296727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0050-66cb-42b3-a15f-fd761a4e96e5 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:05.297244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0050-66cb-42b3-a15f-fd761a4e96e5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:05.297333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0050-66cb-42b3-a15f-fd761a4e96e5 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:05.298888 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1638/3277] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:03:05.310341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:03:05.326667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:05.349403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6e9d3-3456-4cc4-b7cd-e5f563fe38ce None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:05.364155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:05.365324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:05.365991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:05.366511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/64fdf721724646959005e8b9a59e299b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:05.368040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=64fdf721724646959005e8b9a59e299b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:05.370407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:05.372186 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1640/3278] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:03:05 2022] GET /identity/v3/projects/64fdf721724646959005e8b9a59e299b => generated 371 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:05.420013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0050-66cb-42b3-a15f-fd761a4e96e5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:05.436925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0050-66cb-42b3-a15f-fd761a4e96e5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:05.442379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:05.443213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:05.443494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:05.443767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/users/20372799dffa405cad6b088c4512349d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:05.465376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:delete_user(user_id=20372799dffa405cad6b088c4512349d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:05.468404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:05.633249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20372799dffa405cad6b088c4512349d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:05.633249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20372799dffa405cad6b088c4512349d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:05.733692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20372799dffa405cad6b088c4512349d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:05.744454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20372799dffa405cad6b088c4512349d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:05.745328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20372799dffa405cad6b088c4512349d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:05.752789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:05.792662 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1639/3279] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:03:05 2022] DELETE /identity/v3/users/20372799dffa405cad6b088c4512349d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:05.796834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:05.798846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:05.815189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39867-c442-4300-b267-bfdb5ca4ddaf tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:05.960244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:05.960908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:05.961307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:05.961571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/64fdf721724646959005e8b9a59e299b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:05.963160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64fdf721724646959005e8b9a59e299b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:05.965601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:05.985808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:06.117878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fdf721724646959005e8b9a59e299b', 'request_id': 'req-95a520f3-cba4-4d35-ad48-8effa942e37b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:06.129514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fdf721724646959005e8b9a59e299b', 'request_id': 'req-95a520f3-cba4-4d35-ad48-8effa942e37b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:06.141360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fdf721724646959005e8b9a59e299b', 'request_id': 'req-95a520f3-cba4-4d35-ad48-8effa942e37b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:06.222438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] The token cache is being invalidate because project 64fdf721724646959005e8b9a59e299b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:03:06.222782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:06.225980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:06.227970 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1641/3280] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:03:05 2022] DELETE /identity/v3/projects/64fdf721724646959005e8b9a59e299b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:06.635243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:06.637114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:06.748676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146e0f9-482c-4779-95c7-2b3760da8210 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:06.873394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:06.874617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:06.885075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:06.885728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:06.895116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:06.919069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:06.921293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdfd89-f74d-421b-94f9-9b1dfccb3cfe service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:06.935077 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1640/3281] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:07.434314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:07.436329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:07.549587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a520f3-cba4-4d35-ad48-8effa942e37b tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:07.564800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:07.565897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:07.566380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:07.566714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:07.570270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:07.584868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:07.589243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:07.595458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:07.595634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:07.595634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:07.595803 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1641/3282] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:03:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:03:07.602491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:03:07.609923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:07.625983 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1642/3283] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:07.682956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:07.685457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:07.780557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:07.782159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:07.789160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bda88-6384-41e1-b888-f934f2f68eba None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:07.794175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0f8d5-4264-4840-b46d-c3cc704edcde tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:07.794831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f8d5-4264-4840-b46d-c3cc704edcde tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:07.795101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f8d5-4264-4840-b46d-c3cc704edcde tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:07.795371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f8d5-4264-4840-b46d-c3cc704edcde tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/10b2e9c96bb74de892dfd86e6a57642e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:07.796529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0f8d5-4264-4840-b46d-c3cc704edcde tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=10b2e9c96bb74de892dfd86e6a57642e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:07.798848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0f8d5-4264-4840-b46d-c3cc704edcde tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:07.800509 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1642/3284] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:03:07 2022] GET /identity/v3/projects/10b2e9c96bb74de892dfd86e6a57642e => generated 375 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:07.866630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58404f-4d43-4669-9df3-b2667209dcf3 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:07.872028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:07.872982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:07.873317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:07.873661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:07.875708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:07.888237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:07.889877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:07.901486 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1643/3285] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:03:08.813315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff50ba8-5992-4482-b218-a727f5e70f20 None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:08.813893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff50ba8-5992-4482-b218-a727f5e70f20 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:08.813893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff50ba8-5992-4482-b218-a727f5e70f20 None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:08.815451 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1643/3286] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:03:08.822314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] Authenticating service token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:03:08.838417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:08.854430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5617-e5f9-4168-b43c-68ff4605245f service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:08.860223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a853d0-ef7a-4d4c-9a23-afafe12220ac tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:08.861351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a853d0-ef7a-4d4c-9a23-afafe12220ac tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:08.861780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a853d0-ef7a-4d4c-9a23-afafe12220ac tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:08.862219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a853d0-ef7a-4d4c-9a23-afafe12220ac tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/10b2e9c96bb74de892dfd86e6a57642e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:08.864103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a853d0-ef7a-4d4c-9a23-afafe12220ac tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=10b2e9c96bb74de892dfd86e6a57642e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:08.874766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a853d0-ef7a-4d4c-9a23-afafe12220ac tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:08.874766 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1644/3287] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:03:08 2022] GET /identity/v3/projects/10b2e9c96bb74de892dfd86e6a57642e => generated 375 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:11.683595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:11.684108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:11.684206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:11.694086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:11.709641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] MFA Rules not processed for user `9b79042dfe9242f8a4833a969fb1a911`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:11.711428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:11.835683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1644/3288] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:11.980444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c3939-7554-475f-b005-093c37eeb326 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:11.980799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c3939-7554-475f-b005-093c37eeb326 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:11.981063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c3939-7554-475f-b005-093c37eeb326 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:11.983212 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1645/3289] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:03:11.990214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:03:12.009190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:12.023092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddfa10-cc69-4cb9-994b-c587b60f7000 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:12.028117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e554307fe7410c8bc730bff2f3a04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5804cfa36eba4f7b8ac6f76fc4862088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:12.028900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:12.029289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:12.029661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] PATH_INFO: `/v3/projects/10b2e9c96bb74de892dfd86e6a57642e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:12.031153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorizing `identity:get_project(project_id=10b2e9c96bb74de892dfd86e6a57642e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:12.033378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:12.035699 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1645/3290] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:03:11 2022] GET /identity/v3/projects/10b2e9c96bb74de892dfd86e6a57642e => generated 375 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:12.594540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c3939-7554-475f-b005-093c37eeb326 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:12.614695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c3939-7554-475f-b005-093c37eeb326 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:12.623641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:12.624828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:12.627105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:12.627105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:12.630014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:12.650209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:12.652902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0e575-46ca-49dd-974a-a3f43ce5e8f1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:12.665725 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1646/3291] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:14.499178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:14.501033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:14.665353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c5dd-de32-4d82-a430-8d3f76c99869 tempest-QuotasAdminTestJSON-521353539 tempest-QuotasAdminTestJSON-521353539-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:14.671000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:14.671733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:14.672226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:14.672518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] PATH_INFO: `/v3/users/c84b7cf69e0f423eafacb265d78ae39d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:14.673716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84b7cf69e0f423eafacb265d78ae39d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:14.675934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:14.927325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84b7cf69e0f423eafacb265d78ae39d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:14.929083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84b7cf69e0f423eafacb265d78ae39d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:15.048863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84b7cf69e0f423eafacb265d78ae39d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:15.066035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84b7cf69e0f423eafacb265d78ae39d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:15.071831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84b7cf69e0f423eafacb265d78ae39d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:15.123765 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1646/3292] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:03:14 2022] DELETE /identity/v3/users/c84b7cf69e0f423eafacb265d78ae39d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:15.125824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:15.126312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:15.126392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:15.168707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:15.170187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:15.176812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:15.294434 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1647/3293] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:15.325561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:15.327113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:15.373255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:15.452704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efc6e-b3a4-4c93-b3da-afd8a1f77450 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:15.474725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:15.475480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:15.475827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:15.476169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:15.489347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:15.491106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:15.511454 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1647/3294] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:16.556344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:16.557832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:16.598322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8874d58-61bd-4c2e-9d27-a9f19478a77f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:16.612593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11612-2091-4478-becf-405767da249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:16.613527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11612-2091-4478-becf-405767da249d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:16.614021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11612-2091-4478-becf-405767da249d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:16.614477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11612-2091-4478-becf-405767da249d admin admin] PATH_INFO: `/v3/projects/10b2e9c96bb74de892dfd86e6a57642e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:16.617599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e11612-2091-4478-becf-405767da249d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b2e9c96bb74de892dfd86e6a57642e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:16.619670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e11612-2091-4478-becf-405767da249d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:16.907335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-49e11612-2091-4478-becf-405767da249d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b2e9c96bb74de892dfd86e6a57642e', 'request_id': 'req-49e11612-2091-4478-becf-405767da249d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:16.921673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-49e11612-2091-4478-becf-405767da249d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b2e9c96bb74de892dfd86e6a57642e', 'request_id': 'req-49e11612-2091-4478-becf-405767da249d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:16.942522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-49e11612-2091-4478-becf-405767da249d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b2e9c96bb74de892dfd86e6a57642e', 'request_id': 'req-49e11612-2091-4478-becf-405767da249d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.057137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-49e11612-2091-4478-becf-405767da249d admin admin] The token cache is being invalidate because project 10b2e9c96bb74de892dfd86e6a57642e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:03:17.057637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-49e11612-2091-4478-becf-405767da249d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.064859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-49e11612-2091-4478-becf-405767da249d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.064859 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1648/3295] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:03:16 2022] DELETE /identity/v3/projects/10b2e9c96bb74de892dfd86e6a57642e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:17.066635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:17.080543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dbb72-fcfb-45fd-8591-1bdb66c81bd2 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:17.263789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:17.266168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:17.267840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:17.271371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] PATH_INFO: `/v3/users/05e554307fe7410c8bc730bff2f3a04c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:17.271371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e554307fe7410c8bc730bff2f3a04c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:17.276056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:17.628699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e554307fe7410c8bc730bff2f3a04c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.630244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e554307fe7410c8bc730bff2f3a04c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.773265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e554307fe7410c8bc730bff2f3a04c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.842601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e554307fe7410c8bc730bff2f3a04c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.843571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bc510efb-367d-4015-991a-19bca170faaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e554307fe7410c8bc730bff2f3a04c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:17.908779 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1648/3296] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:03:17 2022] DELETE /identity/v3/users/05e554307fe7410c8bc730bff2f3a04c => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:19.065527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11612-2091-4478-becf-405767da249d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:19.071376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49e11612-2091-4478-becf-405767da249d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:19.091655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11612-2091-4478-becf-405767da249d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:19.230856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:19.233066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:19.233066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:19.233066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] PATH_INFO: `/v3/projects/5804cfa36eba4f7b8ac6f76fc4862088` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:19.235220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5804cfa36eba4f7b8ac6f76fc4862088)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:19.237322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:19.383619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:19.407182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5804cfa36eba4f7b8ac6f76fc4862088', 'request_id': 'req-e8b35076-eafd-426a-aa95-c147d5836c87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:19.426935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5804cfa36eba4f7b8ac6f76fc4862088', 'request_id': 'req-e8b35076-eafd-426a-aa95-c147d5836c87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:19.461239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5804cfa36eba4f7b8ac6f76fc4862088', 'request_id': 'req-e8b35076-eafd-426a-aa95-c147d5836c87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:19.597560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] The token cache is being invalidate because project 5804cfa36eba4f7b8ac6f76fc4862088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:03:19.597969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:19.598760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8b35076-eafd-426a-aa95-c147d5836c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:19.610084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1649/3297] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:03:19 2022] DELETE /identity/v3/projects/5804cfa36eba4f7b8ac6f76fc4862088 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:19.611828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:19.612302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:19.612392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:19.644547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:19.648116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:19.717680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:19.760903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1649/3298] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:03:19.770741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:19.771404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:19.771516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:19.794840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:19.796424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:19.810578 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1650/3299] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:19.811354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:19.827204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912477-f0dc-4a32-acb0-378ed3f6cc48 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:19.840210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:19.840210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:19.840210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:19.840210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:19.840656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:03:19.840656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:19.841544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:19.865191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:19.872823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1650/3300] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:03:19.877120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede7930-4104-45bf-8e73-e7a66a42d14c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:19.882938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:19.883561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:19.883888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:19.884171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:19.884863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:19.887396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:20.052531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:20.053451 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1651/3301] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:03:19 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:03:20.064457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47433b1-d3c0-4ac4-846b-c5ee0cd89d41 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:20.199409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:20.200185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:20.200563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:20.200932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:20.201670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:20.203719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:20.334436 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1651/3302] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:03:20 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:03:20.338735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:20.394196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6ddb5-d20c-4d55-9336-ade64f10c52c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:20.394196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:20.394196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:20.394196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:20.394717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:20.394717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:20.394717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:20.425083 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1652/3303] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:03:20.429945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:20.440764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d4815-c505-4970-801d-3ffda761307e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:20.458136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1a1e5-f3c3-4889-a125-01f2ea9ae6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:20.459207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a1e5-f3c3-4889-a125-01f2ea9ae6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:20.459638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a1e5-f3c3-4889-a125-01f2ea9ae6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:20.460297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a1e5-f3c3-4889-a125-01f2ea9ae6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:20.461146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a1e5-f3c3-4889-a125-01f2ea9ae6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:20.463031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a1e5-f3c3-4889-a125-01f2ea9ae6f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:20.484924 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1652/3304] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:03:20.489376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:20.508119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d7947-8d6f-48c0-994b-2844cda191a1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:20.520756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:20.523374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:20.523374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:20.523374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] PATH_INFO: `/v3/projects/5785436cda5f45ca9852b0b284b8137a/users/eed4805ccbd34375809fd12330bcfca6/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:20.560208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5785436cda5f45ca9852b0b284b8137a, user_id=eed4805ccbd34375809fd12330bcfca6, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:20.564205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:20.757169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:20.758055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:20.758478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:20.762315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1653/3305] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:03:20 2022] PUT /identity/v3/projects/5785436cda5f45ca9852b0b284b8137a/users/eed4805ccbd34375809fd12330bcfca6/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:03:20.814353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] MFA Rules not processed for user `eed4805ccbd34375809fd12330bcfca6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:20.815676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:21.040001 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1653/3306] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:21.044560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:21.172495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc315-3f6b-46d9-a0fe-3e605387926f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:21.178749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:21.179744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:21.180121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:21.180517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:21.181260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:21.183382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:21.346794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1654/3307] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:03:21 2022] POST /identity/v3/projects => generated 373 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:03:21.354811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:21.371926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a258e1-eed6-4a6f-b6e2-5d7a89ba57eb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:21.478511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:21.479394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:21.479812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:21.480362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:21.481166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:21.483620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:21.620532 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1654/3308] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:03:21 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:03:21.620760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:21.638747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d53ce9-d7d5-4fae-a0d8-607f9cc51322 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:21.651560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:21.652543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:21.683021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:21.687008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:21.691079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:21.698602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:21.734843 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1655/3309] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:03:21.739699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:21.755274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621cf3b-c71c-4bd1-b484-35f65653898d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:21.763294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:21.764813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:21.765319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:21.765744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] PATH_INFO: `/v3/projects/f3ff7a0c01d44d66913f71941db638b0/users/22077261042643ea8a6d1c42c07c28db/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:21.788764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ff7a0c01d44d66913f71941db638b0, user_id=22077261042643ea8a6d1c42c07c28db, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:21.792741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:21.883087 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1655/3310] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:03:21 2022] PUT /identity/v3/projects/f3ff7a0c01d44d66913f71941db638b0/users/22077261042643ea8a6d1c42c07c28db/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:21.887229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:21.909942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f782d7-d755-46d4-9d70-f4434bc6a432 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:22.014869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e693d2c-9769-4565-a874-5ef40070eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:22.016207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e693d2c-9769-4565-a874-5ef40070eca8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:22.016640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e693d2c-9769-4565-a874-5ef40070eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:22.017416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e693d2c-9769-4565-a874-5ef40070eca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:22.018259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e693d2c-9769-4565-a874-5ef40070eca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:22.020019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e693d2c-9769-4565-a874-5ef40070eca8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:22.040167 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1656/3311] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:03:22.045359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:22.060728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ac4c7-f2b5-4fe8-8bc2-3d15d98d85fa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:22.070892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1241e5-a7cf-4612-bc12-1264eb45c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:22.072075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1241e5-a7cf-4612-bc12-1264eb45c32e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:22.072501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1241e5-a7cf-4612-bc12-1264eb45c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:22.074206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1241e5-a7cf-4612-bc12-1264eb45c32e admin admin] PATH_INFO: `/v3/projects/f3ff7a0c01d44d66913f71941db638b0/users/22077261042643ea8a6d1c42c07c28db/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:22.078432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1241e5-a7cf-4612-bc12-1264eb45c32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ff7a0c01d44d66913f71941db638b0, user_id=22077261042643ea8a6d1c42c07c28db, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:22.081830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1241e5-a7cf-4612-bc12-1264eb45c32e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:22.100308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1656/3312] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:03:22 2022] PUT /identity/v3/projects/f3ff7a0c01d44d66913f71941db638b0/users/22077261042643ea8a6d1c42c07c28db/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:22.111289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:22.112243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:22.113014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:22.171504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] MFA Rules not processed for user `22077261042643ea8a6d1c42c07c28db`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:22.173276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:22.286845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1657/3313] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:22.289168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:22.289452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:22.289730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:22.314061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] MFA Rules not processed for user `eed4805ccbd34375809fd12330bcfca6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:22.315505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:22.362018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:22.404057 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1657/3314] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:22.816479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:22.820740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:22.961410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:23.000568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb488a35-2a5e-4b24-8e45-da551b23f27e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:23.018148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:23.019268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:23.019706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:23.020131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:23.023825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:23.045784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:23.048087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3dcf3-8841-4fb9-a5c2-ad175eb023bc service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:23.075608 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1658/3315] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:03:23.574145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:23.591614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf7516-32ad-4f33-894c-2c5dd554ad6e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:23.598744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc980b-bfca-43a7-9d5d-9ca048ec740a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:23.600211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc980b-bfca-43a7-9d5d-9ca048ec740a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:23.601043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc980b-bfca-43a7-9d5d-9ca048ec740a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:23.602390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc980b-bfca-43a7-9d5d-9ca048ec740a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:23.623048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc980b-bfca-43a7-9d5d-9ca048ec740a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:23.624903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc980b-bfca-43a7-9d5d-9ca048ec740a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:23.656784 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1658/3316] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:25.063890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:25.064423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:25.064423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:25.169338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:25.171114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:25.188464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:25.218179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:25.226754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:25.228321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:25.297755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] MFA Rules not processed for user `eed4805ccbd34375809fd12330bcfca6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:25.299359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:25.330285 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1659/3317] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:25.385190 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1659/3318] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:03:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:25.401176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:25.405204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:25.651186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:25.677797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6081db3-efa3-4b3c-bef7-d25d45fcd1a7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:25.692598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:25.693345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:25.693772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:25.694029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:25.712091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:25.714253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:25.726956 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1660/3319] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:03:32.616201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:32.618335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:32.889773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41d03-b49e-4f01-9ea8-5fa12c3d7ef9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:32.909678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:32.919750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:32.920672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:32.921523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] PATH_INFO: `/v3/users/4b712e714ad64bd4a4452540de7c45bc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:32.924212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b712e714ad64bd4a4452540de7c45bc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:32.930978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:33.382979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b712e714ad64bd4a4452540de7c45bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:33.423122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b712e714ad64bd4a4452540de7c45bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:33.446900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b712e714ad64bd4a4452540de7c45bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:33.447708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b712e714ad64bd4a4452540de7c45bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:33.450964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b712e714ad64bd4a4452540de7c45bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:33.604400 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1660/3320] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:03:32 2022] DELETE /identity/v3/users/4b712e714ad64bd4a4452540de7c45bc => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:35.088296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:35.110955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb8fde-5eca-4199-a791-2666ee61184d service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:35.332295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:35.333072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:35.334067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:35.334534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:35.348887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:35.373508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:35.387570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:35.440704 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1661/3321] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:03:36.487168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:36.489102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:36.558512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:36.698735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a46065-fab2-465b-85ac-9e2e1effcf38 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:36.718305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:36.721153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:36.721726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:36.729130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] PATH_INFO: `/v3/projects/1a4dc740cfd04b688b43856392603453` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:36.732717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4dc740cfd04b688b43856392603453)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:36.739584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:36.741255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:36.745591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:37.046880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4dc740cfd04b688b43856392603453', 'request_id': 'req-05faf6ae-e547-4acc-a2e2-c5ec4c320016'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:37.061055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4dc740cfd04b688b43856392603453', 'request_id': 'req-05faf6ae-e547-4acc-a2e2-c5ec4c320016'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:37.074651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4dc740cfd04b688b43856392603453', 'request_id': 'req-05faf6ae-e547-4acc-a2e2-c5ec4c320016'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:37.092690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd002a45-2077-4678-9e07-ed7bd506ab69 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:37.173046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] The token cache is being invalidate because project 1a4dc740cfd04b688b43856392603453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:03:37.173241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:37.174084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05faf6ae-e547-4acc-a2e2-c5ec4c320016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:37.183091 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1661/3322] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:03:36 2022] DELETE /identity/v3/projects/1a4dc740cfd04b688b43856392603453 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:03:37.190895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ff0f-7755-4ffe-b145-e7e4bd896f38 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:37.192252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ff0f-7755-4ffe-b145-e7e4bd896f38 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:37.195083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ff0f-7755-4ffe-b145-e7e4bd896f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:37.337416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5087ff0f-7755-4ffe-b145-e7e4bd896f38 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:37.345896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5087ff0f-7755-4ffe-b145-e7e4bd896f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:37.351181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:37.360773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:37.360773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:37.360773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:37.368163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:37.515473 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1662/3323] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:03:37.517116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:37.517529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:37.518568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:37.543039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:37.544445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:37.565400 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1663/3324] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:37.567095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:37.567791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:37.589000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca66da-fb6c-491c-bb4c-0be4a713d94d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:37.604695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:37.609416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:37.610339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:37.610744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:37.611575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:03:37.611999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:37.616393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:37.675926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:37.677438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1664/3325] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:37.678749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:37.680546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:37.715614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d048-a37e-4c54-af69-19c8c4f0c112 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:37.740666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:37.744882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:37.750349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:37.750854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:37.751688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:37.753784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:37.757895 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1662/3326] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1019 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:38.037118 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1665/3327] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:03:37 2022] POST /identity/v3/projects => generated 377 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:03:38.039391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:38.055097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e504d-d0aa-4036-867f-880bcebfb876 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:38.259266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:38.260735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:38.261026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:38.261301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:38.262002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:38.265266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:38.399483 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1663/3328] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:03:38 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:03:38.400700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:38.428822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0ebe1-d6f0-4382-bf4b-2b0884119980 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:38.448905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:38.449843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:38.450331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:38.450810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:38.451669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:38.453494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:38.477448 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1666/3329] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:03:38.478425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:38.494491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c86f9-bd41-4eee-849c-2403fbb1613b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:38.512981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a8ba-5265-429b-b0a4-acfa60ab539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:38.514366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a8ba-5265-429b-b0a4-acfa60ab539a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:38.514921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a8ba-5265-429b-b0a4-acfa60ab539a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:38.515390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a8ba-5265-429b-b0a4-acfa60ab539a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:38.516643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a8ba-5265-429b-b0a4-acfa60ab539a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:38.518748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a8ba-5265-429b-b0a4-acfa60ab539a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:38.538356 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1664/3330] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:03:38.539747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:38.571386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f7dc-a066-473a-aa22-3ca1f95d6ea9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:38.578232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec2148-a11d-4cde-a2c3-9bf05048a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:38.579941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2148-a11d-4cde-a2c3-9bf05048a0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:38.580917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2148-a11d-4cde-a2c3-9bf05048a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:38.581509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2148-a11d-4cde-a2c3-9bf05048a0cc admin admin] PATH_INFO: `/v3/projects/fcffdfe8227f41608cfcfbb1a585ffaf/users/1b5e57712e7f4972ad20e5e29cc84ac7/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:38.593354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:38.605082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec2148-a11d-4cde-a2c3-9bf05048a0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcffdfe8227f41608cfcfbb1a585ffaf, user_id=1b5e57712e7f4972ad20e5e29cc84ac7, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:38.608564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec2148-a11d-4cde-a2c3-9bf05048a0cc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:38.749596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1667/3331] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:03:38 2022] PUT /identity/v3/projects/fcffdfe8227f41608cfcfbb1a585ffaf/users/1b5e57712e7f4972ad20e5e29cc84ac7/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:38.760507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:38.761042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:38.761042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:38.815846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] MFA Rules not processed for user `1b5e57712e7f4972ad20e5e29cc84ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:38.817180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:38.970442 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1665/3332] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:38.984728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:38.985328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:38.985771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:39.021738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] MFA Rules not processed for user `1b5e57712e7f4972ad20e5e29cc84ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:39.024081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:39.038001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1668/3333] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:40.235143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:40.241433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:40.410762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:40.553528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcdbdf-baf1-4e16-a88c-1bb4766fd385 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:40.568951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:40.576276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:40.576996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:40.577485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:40.593737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:40.599742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:40.647402 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1666/3334] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:49.011908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=8,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:51.116313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=14 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:52.632301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:52.634610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:52.904871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225acce6-a264-44ac-a4f7-e9a235987881 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:52.910835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:52.913068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:52.913404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:52.913725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] PATH_INFO: `/v3/users/f789eab7f7554fc1839bdaced7a2d64f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:52.919475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f789eab7f7554fc1839bdaced7a2d64f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:52.923649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:53.281685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f789eab7f7554fc1839bdaced7a2d64f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:53.301209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f789eab7f7554fc1839bdaced7a2d64f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:53.310183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f789eab7f7554fc1839bdaced7a2d64f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:53.310942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f789eab7f7554fc1839bdaced7a2d64f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:53.312218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dcbf972a-6fd6-4a10-94e3-ba3d72d0f41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f789eab7f7554fc1839bdaced7a2d64f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:53.438444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1669/3335] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:03:52 2022] DELETE /identity/v3/users/f789eab7f7554fc1839bdaced7a2d64f => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:03:54.191043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:54.213608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad46f8-9323-47e7-a93f-d27641519286 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:54.341998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:54.342680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:54.342971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:54.343251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] PATH_INFO: `/v3/projects/2cfe92f7e31c4c4eb8886f256f57df8e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:54.344809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfe92f7e31c4c4eb8886f256f57df8e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:54.357589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:54.590028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfe92f7e31c4c4eb8886f256f57df8e', 'request_id': 'req-91be764f-d551-4d7f-b8d8-3efeb2793b22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:54.608067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfe92f7e31c4c4eb8886f256f57df8e', 'request_id': 'req-91be764f-d551-4d7f-b8d8-3efeb2793b22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:54.617889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfe92f7e31c4c4eb8886f256f57df8e', 'request_id': 'req-91be764f-d551-4d7f-b8d8-3efeb2793b22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:54.771228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] The token cache is being invalidate because project 2cfe92f7e31c4c4eb8886f256f57df8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:03:54.771551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:54.774825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-91be764f-d551-4d7f-b8d8-3efeb2793b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:54.776810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1667/3336] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:03:54 2022] DELETE /identity/v3/projects/2cfe92f7e31c4c4eb8886f256f57df8e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:54.784397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:54.785434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:54.787013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:54.815560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:54.816875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:54.956548 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1670/3337] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:54.964763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:54.965144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:54.965367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:54.998173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:54.999788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:55.036694 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1668/3338] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:55.041925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:55.057736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925d5e6-84fa-4f84-8a5d-0f43b152daa9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:55.070043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:55.070937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.071416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.071884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.072995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:03:55.073505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:55.079741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8d1f-7ce0-4e0e-9160-14a90ec96e0c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:55.125972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1671/3339] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:03:55.128636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:55.150172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd537fc2-6a26-4be3-8ff9-30a092867c6f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:55.182763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:55.183409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.183703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.183975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.184649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:55.186761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:55.217031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.217318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.217609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.276281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:55.288661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:55.292431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:55.375521 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1669/3340] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:03:55 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:03:55.383737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:55.449065 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1672/3341] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:03:55.515258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:55.521492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:55.638545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039edef4-3116-4d93-978f-3061b7bbe19b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:55.659779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:55.661414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.671469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.672690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.672857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:55.675068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:55.690303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:55.774913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6127-c814-4665-9431-99c5153a0f86 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:55.823388 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1670/3342] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:03:55 2022] POST /identity/v3/users => generated 286 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:03:55.829347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:55.847537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ab080-38b1-4478-a09f-5ee209718709 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:55.857326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:55.857326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.857326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.857326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.857808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:55.857808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:55.892074 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1671/3343] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:03:55.901236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14dd4-735d-4488-a3b1-23ab3c0e7a80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:55.904466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14dd4-735d-4488-a3b1-23ab3c0e7a80 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.904829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14dd4-735d-4488-a3b1-23ab3c0e7a80 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.909553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14dd4-735d-4488-a3b1-23ab3c0e7a80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.914699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:55.952597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717e356-0bdd-4b36-960f-74a90089f58f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:55.973676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:55.975447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:55.976206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:55.977653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:55.978723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:55.983133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:56.033993 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1672/3344] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:03:56.039009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:56.105036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3db6-7a22-473d-a856-09951ca2a8d3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:56.123779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14dd4-735d-4488-a3b1-23ab3c0e7a80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:56.129390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14dd4-735d-4488-a3b1-23ab3c0e7a80 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:56.135344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:56.137049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:56.142281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:56.142901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] PATH_INFO: `/v3/projects/bf61c4060dfc402785f0e97364afd0e3/users/530deff4b6bf4573b2d081108eca5dd1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:56.160780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:56.166385 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1673/3345] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:03:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:03:56.179066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf61c4060dfc402785f0e97364afd0e3, user_id=530deff4b6bf4573b2d081108eca5dd1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:56.183571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:56.293676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1673/3346] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:03:56 2022] PUT /identity/v3/projects/bf61c4060dfc402785f0e97364afd0e3/users/530deff4b6bf4573b2d081108eca5dd1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:56.300256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:56.300716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:56.301139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:56.331824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:56.333836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:56.480737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:56.485018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:56.556897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1674/3347] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:56.582452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:56.583969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:56.641034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29e16-304b-456f-b273-70dfce0e459b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:56.653517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:56.655762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:56.656534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:56.657389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] PATH_INFO: `/v3/users/1b5e57712e7f4972ad20e5e29cc84ac7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:56.660170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5e57712e7f4972ad20e5e29cc84ac7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:56.668989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:56.703275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aeec2-c89d-4191-bdaf-3dcb93410272 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:56.713929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d15d-8e3e-4ecc-9670-918a43fca47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:56.722339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d15d-8e3e-4ecc-9670-918a43fca47c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:56.725500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d15d-8e3e-4ecc-9670-918a43fca47c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:56.726406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d15d-8e3e-4ecc-9670-918a43fca47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:56.754167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d15d-8e3e-4ecc-9670-918a43fca47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:56.771222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d15d-8e3e-4ecc-9670-918a43fca47c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:56.803998 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1675/3348] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:03:56.945671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5e57712e7f4972ad20e5e29cc84ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:56.946748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5e57712e7f4972ad20e5e29cc84ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:57.036595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5e57712e7f4972ad20e5e29cc84ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:57.052541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5e57712e7f4972ad20e5e29cc84ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:57.053659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5e57712e7f4972ad20e5e29cc84ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:57.117099 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1674/3349] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:03:56 2022] DELETE /identity/v3/users/1b5e57712e7f4972ad20e5e29cc84ac7 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:03:57.121778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8770d-e858-4446-b3e7-d6ee9cc19f70 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:57.125429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8770d-e858-4446-b3e7-d6ee9cc19f70 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:57.125429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8770d-e858-4446-b3e7-d6ee9cc19f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:57.158261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cae8770d-e858-4446-b3e7-d6ee9cc19f70 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:57.158261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cae8770d-e858-4446-b3e7-d6ee9cc19f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:57.392256 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1676/3350] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:03:57.530439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:57.532153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:57.587104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:57.655434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdd106-08b9-4fe6-8c83-2113e1d3fd4d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:57.668278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:57.668962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:57.669249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:57.669524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:57.684547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:57.685504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:57.712628 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1675/3351] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:57.943116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03765f-ef3f-4adc-959e-8a626d475d14 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:57.949899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03765f-ef3f-4adc-959e-8a626d475d14 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:57.950268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03765f-ef3f-4adc-959e-8a626d475d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:58.037115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0d03765f-ef3f-4adc-959e-8a626d475d14 None None] MFA Rules not processed for user `eed4805ccbd34375809fd12330bcfca6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:58.041925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d03765f-ef3f-4adc-959e-8a626d475d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:58.113968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:58.209373 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1677/3352] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:59.572796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:59.578189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:59.600307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b128d-27ec-4e22-baf7-64bec49bf4f9 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:59.616377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:59.620840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:59.620840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:59.620840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] PATH_INFO: `/v3/projects/fcffdfe8227f41608cfcfbb1a585ffaf` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:59.621304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcffdfe8227f41608cfcfbb1a585ffaf)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:59.624215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:59.917002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcffdfe8227f41608cfcfbb1a585ffaf', 'request_id': 'req-ea23e108-a346-493d-a189-72f888df5f1a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:59.932573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcffdfe8227f41608cfcfbb1a585ffaf', 'request_id': 'req-ea23e108-a346-493d-a189-72f888df5f1a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:03:59.946774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcffdfe8227f41608cfcfbb1a585ffaf', 'request_id': 'req-ea23e108-a346-493d-a189-72f888df5f1a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:00.040562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] The token cache is being invalidate because project fcffdfe8227f41608cfcfbb1a585ffaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:00.041124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:00.054152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea23e108-a346-493d-a189-72f888df5f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:00.057396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1676/3353] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:03:59 2022] DELETE /identity/v3/projects/fcffdfe8227f41608cfcfbb1a585ffaf => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:00.064121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:00.064762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:00.064762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:00.107374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:00.110957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:00.268013 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1678/3354] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:00.269908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:00.270208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:00.270697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:00.316146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:00.318332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:00.355463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:00.359245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1677/3355] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:00.383559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153853-5ebf-4d7f-a643-375cf4993ac7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:00.418414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:00.420660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:00.423888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:00.424557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:00.427602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:00.429119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:00.434877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:00.464526 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1679/3356] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:00.469565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:00.496658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7ff82-3968-4bd9-b849-3e2727dea18d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:00.508170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:00.509344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:00.510153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:00.510717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:00.511564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:00.524447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:00.724013 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1678/3357] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:00 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:00.725216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:00.787974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f0c28-4e23-4080-81cb-6ba05c81f880 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:00.950311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:00.950961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:00.951282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:00.951556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:00.952199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:00.954762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:01.094543 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1680/3358] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:00 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:04:01.098563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:01.121841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d8036-46af-4dae-a100-1332a34e92c9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:01.130594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685064-8028-4959-b16d-c333f797150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:01.132460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685064-8028-4959-b16d-c333f797150e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:01.133044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685064-8028-4959-b16d-c333f797150e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:01.133902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685064-8028-4959-b16d-c333f797150e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:01.135128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685064-8028-4959-b16d-c333f797150e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:01.139548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685064-8028-4959-b16d-c333f797150e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:01.171131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:01.192642 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1679/3359] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:01.206938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2995e45-f909-4812-9bba-9cdd77e5c936 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:01.217347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceed96-aaec-4116-aac3-30684ce9bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:01.225220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceed96-aaec-4116-aac3-30684ce9bd0f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:01.225220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceed96-aaec-4116-aac3-30684ce9bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:01.225577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceed96-aaec-4116-aac3-30684ce9bd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:01.228205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceed96-aaec-4116-aac3-30684ce9bd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:01.230446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceed96-aaec-4116-aac3-30684ce9bd0f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:01.248984 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1681/3360] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:01.259639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685064-8028-4959-b16d-c333f797150e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:01.274543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685064-8028-4959-b16d-c333f797150e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:01.291533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:01.292841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:01.293714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:01.294347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] PATH_INFO: `/v3/projects/52acaef1cb324f4984b245e8378121b9/users/cc1a9bccd86b4a3b881314fe5a1505ec/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:01.358236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52acaef1cb324f4984b245e8378121b9, user_id=cc1a9bccd86b4a3b881314fe5a1505ec, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:01.362796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:01.480749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:01.481024 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1680/3361] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:01 2022] PUT /identity/v3/projects/52acaef1cb324f4984b245e8378121b9/users/cc1a9bccd86b4a3b881314fe5a1505ec/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:01.481463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:01.481919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:01.521210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:01.523017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:01.617163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:01.644192 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1682/3362] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:01.677068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:01.679278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:01.802991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:01.819517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc2384-d078-4326-8f07-a222a84e2d06 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:01.824512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:01.824512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:01.824801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:01.825022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:01.855054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:01.859752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:01.883851 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1681/3363] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:02.932366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:02.934328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:02.953078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54b268-cd6d-4285-8cd3-a49fc59e56eb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:02.970355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:02.971017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:02.971299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:02.971574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] PATH_INFO: `/v3/users/73ab826d87cb4376bbebf3d02ec5e115` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:02.972778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ab826d87cb4376bbebf3d02ec5e115)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:02.976480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:03.287542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ab826d87cb4376bbebf3d02ec5e115'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:03.320888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ab826d87cb4376bbebf3d02ec5e115'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:03.337702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ab826d87cb4376bbebf3d02ec5e115'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:03.338932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ab826d87cb4376bbebf3d02ec5e115'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:03.340012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2f841897-c361-400c-b703-a5b7dfa07dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ab826d87cb4376bbebf3d02ec5e115'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:03.454970 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1683/3364] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:02 2022] DELETE /identity/v3/users/73ab826d87cb4376bbebf3d02ec5e115 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:05.185672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:05.200888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae768d-9ac0-42bb-b2ee-09bfd9f6b0d9 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:05.327183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:05.327891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:05.328177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:05.328455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] PATH_INFO: `/v3/projects/dd7de14bdd13467184df8d1609bab6c3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:05.329743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7de14bdd13467184df8d1609bab6c3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:05.331768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:05.511366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7de14bdd13467184df8d1609bab6c3', 'request_id': 'req-4ff48f4b-de44-4012-94dd-34694d323444'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:05.549370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7de14bdd13467184df8d1609bab6c3', 'request_id': 'req-4ff48f4b-de44-4012-94dd-34694d323444'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:05.559322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7de14bdd13467184df8d1609bab6c3', 'request_id': 'req-4ff48f4b-de44-4012-94dd-34694d323444'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:05.684575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] The token cache is being invalidate because project dd7de14bdd13467184df8d1609bab6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:05.684917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:05.686321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4ff48f4b-de44-4012-94dd-34694d323444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:05.689080 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1682/3365] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:05 2022] DELETE /identity/v3/projects/dd7de14bdd13467184df8d1609bab6c3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:05.707082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:05.708102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:05.708229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:05.735054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:05.736726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:05.827706 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1684/3366] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:05.836902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:05.837195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:05.837520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:05.862266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:05.864585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:05.874146 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1683/3367] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:05.879115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:05.890417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5367c-3a13-4327-a6bd-7aabd01ddf81 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:05.896909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:05.897624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:05.897992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:05.898335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:05.899060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:05.907664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:05.907664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:05.921139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:05.922197 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1685/3368] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:05.933952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bbb65-7ec5-4dee-ba7a-479e0c4faa82 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:05.941101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:05.943139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:05.943834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:05.944268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:05.945101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:05.947693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:06.047097 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1684/3369] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:05 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:06.047834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:06.063200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5d94e-3702-41d0-8a73-8a163f6bcb07 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:06.123284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:06.140178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:06.141015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:06.141294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:06.141569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:06.142246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:06.144620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:06.297601 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1686/3370] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:06 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:06.301970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:06.320361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a9fd-ad27-4530-9dfd-6ae314b285ba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:06.325813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:06.326636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:06.327058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:06.327463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:06.328529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:06.330614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:06.345559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1685/3371] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:06.349487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:06.378970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298bac1-4ca9-45c0-9098-a5f4180bc2ec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:06.401926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaa625-463f-4068-af16-fa3ee6d60859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:06.405474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa625-463f-4068-af16-fa3ee6d60859 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:06.406012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa625-463f-4068-af16-fa3ee6d60859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:06.406241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa625-463f-4068-af16-fa3ee6d60859 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:06.407832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaa625-463f-4068-af16-fa3ee6d60859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:06.409952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaa625-463f-4068-af16-fa3ee6d60859 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:06.479106 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1687/3372] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:06.481683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:06.501129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b0c7-ed1e-47b7-a1c9-ffa05dea2823 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:06.516824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055e37e-004f-4a86-8d82-003d5e2e8080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:06.520915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055e37e-004f-4a86-8d82-003d5e2e8080 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:06.520915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055e37e-004f-4a86-8d82-003d5e2e8080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:06.520915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055e37e-004f-4a86-8d82-003d5e2e8080 admin admin] PATH_INFO: `/v3/projects/abae1ddd473a4be4b70d8981e5288bfd/users/77e7ba141fd64a3f8a623ec6f3177424/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:06.561541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055e37e-004f-4a86-8d82-003d5e2e8080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abae1ddd473a4be4b70d8981e5288bfd, user_id=77e7ba141fd64a3f8a623ec6f3177424, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:06.564809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055e37e-004f-4a86-8d82-003d5e2e8080 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:06.712998 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1686/3373] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:06 2022] PUT /identity/v3/projects/abae1ddd473a4be4b70d8981e5288bfd/users/77e7ba141fd64a3f8a623ec6f3177424/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:06.717361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:06.717361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:06.717361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:06.799048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] MFA Rules not processed for user `77e7ba141fd64a3f8a623ec6f3177424`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:06.803087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:06.965343 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1688/3374] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:06.979117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f27b-119e-4645-a204-d934e4821fea None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:06.979117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f27b-119e-4645-a204-d934e4821fea None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:06.979412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f27b-119e-4645-a204-d934e4821fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:07.014339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2fb0f27b-119e-4645-a204-d934e4821fea None None] MFA Rules not processed for user `77e7ba141fd64a3f8a623ec6f3177424`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:07.018582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fb0f27b-119e-4645-a204-d934e4821fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:07.039721 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1687/3375] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:07.407363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:07.412327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:07.589282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc264-fb32-4c99-b683-efb1b23248ab None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:07.600576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecdb9d-610f-470e-8133-694033c7e9d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:07.601226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecdb9d-610f-470e-8133-694033c7e9d8 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:07.601625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecdb9d-610f-470e-8133-694033c7e9d8 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:07.602035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecdb9d-610f-470e-8133-694033c7e9d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:07.626459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecdb9d-610f-470e-8133-694033c7e9d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:07.626459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecdb9d-610f-470e-8133-694033c7e9d8 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:07.645430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1689/3376] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:07.666844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97ab0-fe68-4a1b-927f-24776384efd2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:07.667776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97ab0-fe68-4a1b-927f-24776384efd2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:07.668251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97ab0-fe68-4a1b-927f-24776384efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:07.710390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6dc97ab0-fe68-4a1b-927f-24776384efd2 None None] MFA Rules not processed for user `77e7ba141fd64a3f8a623ec6f3177424`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:07.711647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6dc97ab0-fe68-4a1b-927f-24776384efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:07.726179 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1688/3377] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:08.131068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e412-a577-4130-b5e1-6aad3529268e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:08.135555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e412-a577-4130-b5e1-6aad3529268e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:08.135555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e412-a577-4130-b5e1-6aad3529268e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:08.152782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fbf7e412-a577-4130-b5e1-6aad3529268e None None] MFA Rules not processed for user `77e7ba141fd64a3f8a623ec6f3177424`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:08.154300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fbf7e412-a577-4130-b5e1-6aad3529268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:08.173508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1690/3378] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:08.219886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:08.223896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:08.223896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:08.234235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:08.258450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] MFA Rules not processed for user `77e7ba141fd64a3f8a623ec6f3177424`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:08.262978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:08.287291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1689/3379] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:08.329198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457c29-cd24-4276-bcd0-98774fc5fe89 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:08.329478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457c29-cd24-4276-bcd0-98774fc5fe89 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:08.329982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457c29-cd24-4276-bcd0-98774fc5fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:08.366661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cc457c29-cd24-4276-bcd0-98774fc5fe89 None None] MFA Rules not processed for user `77e7ba141fd64a3f8a623ec6f3177424`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:08.368194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc457c29-cd24-4276-bcd0-98774fc5fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:08.383732 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1691/3380] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:08.441169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:08.624507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c248a-ccd3-4bd8-aa80-f79bfe12d40c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:08.643025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:08.643723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:08.644002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:08.644452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] PATH_INFO: `/v3/users/77e7ba141fd64a3f8a623ec6f3177424` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:08.646560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e7ba141fd64a3f8a623ec6f3177424)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:08.648761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:08.895164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e7ba141fd64a3f8a623ec6f3177424'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:08.896720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e7ba141fd64a3f8a623ec6f3177424'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:08.977010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e7ba141fd64a3f8a623ec6f3177424'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:08.998677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e7ba141fd64a3f8a623ec6f3177424'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:08.999747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e7ba141fd64a3f8a623ec6f3177424'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:09.048106 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1690/3381] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:08 2022] DELETE /identity/v3/users/77e7ba141fd64a3f8a623ec6f3177424 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:09.053164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf8b30-622a-4090-b749-4ed80f4cfec9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:09.053749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf8b30-622a-4090-b749-4ed80f4cfec9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:09.054260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf8b30-622a-4090-b749-4ed80f4cfec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:09.104054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-27cf8b30-622a-4090-b749-4ed80f4cfec9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:09.104054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-27cf8b30-622a-4090-b749-4ed80f4cfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:09.168740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:09.231195 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1692/3382] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:09.316066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:09.317584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:09.492683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7990ad-8ebd-4f27-afb8-7b74b3b24c7a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:09.508668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:09.509568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:09.510035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:09.511143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:09.526659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:09.528639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:09.547843 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1691/3383] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:10.593729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:10.594380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:10.594781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:10.644081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] MFA Rules not processed for user `530deff4b6bf4573b2d081108eca5dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:10.646201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:10.772261 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1693/3384] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:11.080158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:11.081878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:11.117160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6fef9-d774-4bf1-8184-e6794a05f6c2 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:11.127588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:11.128714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:11.129251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:11.129771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] PATH_INFO: `/v3/projects/abae1ddd473a4be4b70d8981e5288bfd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:11.131339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=abae1ddd473a4be4b70d8981e5288bfd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:11.143442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:11.170248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:11.303844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abae1ddd473a4be4b70d8981e5288bfd', 'request_id': 'req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:11.320267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abae1ddd473a4be4b70d8981e5288bfd', 'request_id': 'req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:11.334751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abae1ddd473a4be4b70d8981e5288bfd', 'request_id': 'req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:11.345496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:11.347322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:11.456445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8f69-5c5a-4eb3-b5fb-427ae1fa20be None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:11.474302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] The token cache is being invalidate because project abae1ddd473a4be4b70d8981e5288bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:11.474723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:11.475455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5d84bf1a-9e3f-47ab-9ce0-278a941897dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:11.482457 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1692/3385] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:11 2022] DELETE /identity/v3/projects/abae1ddd473a4be4b70d8981e5288bfd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:11.522316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc30c7-456d-47ec-9d09-2df7ce24537d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:11.522316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc30c7-456d-47ec-9d09-2df7ce24537d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:11.522316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc30c7-456d-47ec-9d09-2df7ce24537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:11.530956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:11.551626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:11.552826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:11.553118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:11.553687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:11.556379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:11.562321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6adc30c7-456d-47ec-9d09-2df7ce24537d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:11.563565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6adc30c7-456d-47ec-9d09-2df7ce24537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:11.665820 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1693/3386] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:11.674939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:11.676124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:11.678166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:11.681381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:11.684647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:11.700485 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1694/3387] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:11.718492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:11.719869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:11.734692 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1694/3388] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:11.740427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:11.760091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ee6ed-18aa-4ef4-b90e-dfefbf61bdc6 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:11.767603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:11.768524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:11.768955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:11.770702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:11.771579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:11.772090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:11.782123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:11.794740 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1695/3389] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:11.795859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:11.808339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120dfc6-2cdb-4390-b359-932acd930c30 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:11.816871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:11.817833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:11.818556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:11.818991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:11.819922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:11.824985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:11.922098 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1695/3390] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:11 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:04:11.929379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:11.956219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6088d9-16cd-4081-8ecd-19503c89dbff admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:12.087367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:12.088004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.088308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.088644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.089336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:12.091462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:12.125284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:12.127655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:12.148355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c281d8-e5e8-4ba9-ae65-ab651102b453 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:12.167140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:12.168250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.168747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.169155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] PATH_INFO: `/v3/users/214b5ab49764481c98a048528f3d2f9b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.172148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214b5ab49764481c98a048528f3d2f9b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:12.173420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:12.263560 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1696/3391] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:11 2022] POST /identity/v3/users => generated 297 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:12.264562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:12.278980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf947-4bc1-4837-8c9f-f2b269283a39 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:12.285813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:12.286471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.288056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.288056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.288228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:12.290914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:12.324518 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1697/3392] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:12.328614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:12.349307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046dcbe-43ac-46fc-9a5a-dd3676f96de8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:12.359045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:12.359962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.360519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.361961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.364293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:12.369753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:12.387346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214b5ab49764481c98a048528f3d2f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:12.388212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214b5ab49764481c98a048528f3d2f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:12.392746 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1698/3393] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:12.393707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:12.409500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f12a7-8e15-40a8-aa39-090ba00caa38 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:12.425564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:12.431372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.431372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.431372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] PATH_INFO: `/v3/projects/e6fa4bad47cf497eb6a3daa9e369767d/users/be98774a590b47cbaa5cd2516a4cc399/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.460260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fa4bad47cf497eb6a3daa9e369767d, user_id=be98774a590b47cbaa5cd2516a4cc399, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:12.465569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:12.479877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214b5ab49764481c98a048528f3d2f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:12.490756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214b5ab49764481c98a048528f3d2f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:12.491516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51ad7976-f0c4-4ffb-8754-8bb85bed5b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214b5ab49764481c98a048528f3d2f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:12.502914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:12.536307 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1696/3394] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:12 2022] DELETE /identity/v3/users/214b5ab49764481c98a048528f3d2f9b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:12.553028 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1699/3395] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:12 2022] PUT /identity/v3/projects/e6fa4bad47cf497eb6a3daa9e369767d/users/be98774a590b47cbaa5cd2516a4cc399/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:12.558353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.558849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.559276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.596125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:12.598816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:12.755047 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1697/3396] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:12.767373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:12.772686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:12.829021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:12.885133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66b339-fc00-4f71-8f19-d007744a00a2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:12.889800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:12.891224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:12.891520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:12.891949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:12.907154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:12.909062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:12.924813 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1700/3397] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:13.675515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:13.678621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:13.707163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8487-540f-4953-8252-bd334cf9fa9f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:13.726557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:13.727076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:13.727455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:13.727736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] PATH_INFO: `/v3/projects/d2f2cf16e3964ce2b5b0491468a3b159` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:13.731704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f2cf16e3964ce2b5b0491468a3b159)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:13.739594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:14.014291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f2cf16e3964ce2b5b0491468a3b159', 'request_id': 'req-8125510c-a47d-4854-8b0d-0dbdf989bd9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.023304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f2cf16e3964ce2b5b0491468a3b159', 'request_id': 'req-8125510c-a47d-4854-8b0d-0dbdf989bd9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.049221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f2cf16e3964ce2b5b0491468a3b159', 'request_id': 'req-8125510c-a47d-4854-8b0d-0dbdf989bd9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.137399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] The token cache is being invalidate because project d2f2cf16e3964ce2b5b0491468a3b159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:14.137812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.139076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.145123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1698/3398] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:13 2022] DELETE /identity/v3/projects/d2f2cf16e3964ce2b5b0491468a3b159 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:14.149383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:14.161445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa09c5-394e-4d08-a51c-e95438035256 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:14.349311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:14.350729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:14.351190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:14.351474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] PATH_INFO: `/v3/users/92fc473ae07540adbc11f9e31e663b55` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:14.356608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92fc473ae07540adbc11f9e31e663b55)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:14.364069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:14.674850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92fc473ae07540adbc11f9e31e663b55'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.718551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92fc473ae07540adbc11f9e31e663b55'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.737401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92fc473ae07540adbc11f9e31e663b55'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.739988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92fc473ae07540adbc11f9e31e663b55'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.740114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1426e254-0914-4a00-8f47-4228092b4d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92fc473ae07540adbc11f9e31e663b55'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:14.865944 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1701/3399] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:14 2022] DELETE /identity/v3/users/92fc473ae07540adbc11f9e31e663b55 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:15.898781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:15.900800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:15.929117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125510c-a47d-4854-8b0d-0dbdf989bd9b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:16.162211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:16.162762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:16.163041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:16.163489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] PATH_INFO: `/v3/projects/a8c97f23d4ce41cc8388998c408c366f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:16.171600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c97f23d4ce41cc8388998c408c366f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:16.173652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:16.200062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:16.404562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c97f23d4ce41cc8388998c408c366f', 'request_id': 'req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:16.445298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c97f23d4ce41cc8388998c408c366f', 'request_id': 'req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:16.473190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c97f23d4ce41cc8388998c408c366f', 'request_id': 'req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:16.587836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] The token cache is being invalidate because project a8c97f23d4ce41cc8388998c408c366f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:16.588447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:16.591082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-008dbea8-5382-4cb9-ba03-9d78f1dea2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:16.593308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1699/3400] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:15 2022] DELETE /identity/v3/projects/a8c97f23d4ce41cc8388998c408c366f => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:16.599584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:16.601900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:16.602105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:16.668789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:16.670469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:16.745642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:16.784114 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1702/3401] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:16.792543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:16.792825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:16.793092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:16.836417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:16.839223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:16.857244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1700/3402] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:16.873908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:16.896801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05d01-dcb8-4ed3-a505-ecd1c54c2064 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:16.914852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:16.916517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:16.935744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:16.944027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:16.944027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:16.944027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:16.944027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:16.982647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:17.002387 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1703/3403] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:17.060443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca616a5-664a-4436-947e-b56f71573d6d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:17.087886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:17.089246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:17.089740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:17.090198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:17.091235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:17.093578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:17.220395 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1701/3404] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:16 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:17.231176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:17.251115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b13f0-4e04-478e-ab2d-6ba84eb2cc4f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:17.441979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:17.441979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:17.441979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:17.441979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:17.444612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:17.451685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:17.628081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1704/3405] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:17 2022] POST /identity/v3/users => generated 287 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:17.631822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:17.640621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d23d-f99b-43dd-8058-593b0af23d03 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:17.660531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:17.661184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:17.668646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:17.668646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:17.668646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:17.668646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:17.702708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1702/3406] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:17.706580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:17.721523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c9a2-b458-4052-88ef-3a9e0f8fb778 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:17.737874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630f2a-58ab-4812-a59e-921d89d37e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:17.739435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630f2a-58ab-4812-a59e-921d89d37e7c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:17.739901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630f2a-58ab-4812-a59e-921d89d37e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:17.740372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630f2a-58ab-4812-a59e-921d89d37e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:17.741393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6630f2a-58ab-4812-a59e-921d89d37e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:17.743680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6630f2a-58ab-4812-a59e-921d89d37e7c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:17.759623 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1705/3407] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:17.764736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:17.777709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243bec-5c68-45e9-acd9-2d78c34fb583 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:17.784088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:17.789170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:17.789170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:17.789170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] PATH_INFO: `/v3/projects/7996b61ca579418b9a690269e4ef9554/users/a79d4f7fcf5a497d80ae244da048f83a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:17.810235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7996b61ca579418b9a690269e4ef9554, user_id=a79d4f7fcf5a497d80ae244da048f83a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:17.815479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:17.900734 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1703/3408] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:17 2022] PUT /identity/v3/projects/7996b61ca579418b9a690269e4ef9554/users/a79d4f7fcf5a497d80ae244da048f83a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:17.912071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:17.912375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:17.912664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:17.957234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] MFA Rules not processed for user `a79d4f7fcf5a497d80ae244da048f83a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:17.958823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:18.088751 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1706/3409] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:18.115317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:18.259346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69c5f-e6a7-4a01-a72b-a85832bcdb1a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:18.268670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0218a1d-8f70-417d-8304-a8642d7be5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:18.269977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218a1d-8f70-417d-8304-a8642d7be5df admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:18.270265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218a1d-8f70-417d-8304-a8642d7be5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:18.270767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218a1d-8f70-417d-8304-a8642d7be5df admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:18.291681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0218a1d-8f70-417d-8304-a8642d7be5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:18.294778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0218a1d-8f70-417d-8304-a8642d7be5df admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:18.478088 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1704/3410] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:18 2022] POST /identity/v3/projects => generated 375 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:18.482271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:18.499809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7eec-16d7-452d-873b-c6efc5cd8770 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:18.590225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:18.616175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:18.617433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:18.618045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:18.618542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:18.619718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:18.623138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:18.710344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc3a15-a5ad-4b76-9391-5c110795c213 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:18.710344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc3a15-a5ad-4b76-9391-5c110795c213 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:18.710344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc3a15-a5ad-4b76-9391-5c110795c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:18.745151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fbcc3a15-a5ad-4b76-9391-5c110795c213 None None] MFA Rules not processed for user `cc1a9bccd86b4a3b881314fe5a1505ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:18.746726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fbcc3a15-a5ad-4b76-9391-5c110795c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:18.759326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:18.772629 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1707/3411] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:18 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:18.776587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:18.795388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d38c-fdf0-4103-b750-5e7b9b3f1e2a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:18.810209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:18.812127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:18.812127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:18.812127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:18.812848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:18.814937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:18.848649 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1708/3412] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:18.851893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:18.867432 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1705/3413] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:18.871515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:18.873140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:18.873448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:18.883009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f74164-502e-4c36-aa12-a5f3c95f948d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:18.898145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:18.898984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:18.899375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:18.899734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] PATH_INFO: `/v3/projects/99b2c649562341168ace7bb5286939e6/users/cbe1d6cd96054fbeb6bbf73ad0ad0eb2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:18.930223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b2c649562341168ace7bb5286939e6, user_id=cbe1d6cd96054fbeb6bbf73ad0ad0eb2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:18.933650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:18.939116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] MFA Rules not processed for user `cc1a9bccd86b4a3b881314fe5a1505ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:18.943572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:18.963485 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1706/3414] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:19.027569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1709/3415] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:18 2022] PUT /identity/v3/projects/99b2c649562341168ace7bb5286939e6/users/cbe1d6cd96054fbeb6bbf73ad0ad0eb2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:19.030440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:19.058975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf6120-a622-4095-b3a2-76bd1fc34bd1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:19.185978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed2eba-bc55-428c-9800-5bffc7459c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:19.187252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2eba-bc55-428c-9800-5bffc7459c8b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:19.187252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2eba-bc55-428c-9800-5bffc7459c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:19.187733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2eba-bc55-428c-9800-5bffc7459c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:19.188612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed2eba-bc55-428c-9800-5bffc7459c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:19.190587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed2eba-bc55-428c-9800-5bffc7459c8b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:19.206003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1707/3416] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:19.210218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:19.223615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372162-3391-4fa4-bb8b-8a789886add2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:19.229618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:19.241907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:19.241907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:19.241907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] PATH_INFO: `/v3/projects/99b2c649562341168ace7bb5286939e6/users/cbe1d6cd96054fbeb6bbf73ad0ad0eb2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:19.241907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b2c649562341168ace7bb5286939e6, user_id=cbe1d6cd96054fbeb6bbf73ad0ad0eb2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:19.241907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:19.254482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1710/3417] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:19 2022] PUT /identity/v3/projects/99b2c649562341168ace7bb5286939e6/users/cbe1d6cd96054fbeb6bbf73ad0ad0eb2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:04:19.271345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae4a33-ad54-4071-a4f2-da73256573f1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:19.271686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae4a33-ad54-4071-a4f2-da73256573f1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:19.271970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae4a33-ad54-4071-a4f2-da73256573f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:19.292760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:19.295329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:19.327936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-19ae4a33-ad54-4071-a4f2-da73256573f1 None None] MFA Rules not processed for user `cbe1d6cd96054fbeb6bbf73ad0ad0eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:19.330303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19ae4a33-ad54-4071-a4f2-da73256573f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:19.485531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc77454-6792-4caa-8c40-04588b32aeec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:19.492799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:19.493766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:19.494089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:19.494361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:19.502452 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1708/3418] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:19.516105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:19.516531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:19.522287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:19.566617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] MFA Rules not processed for user `a79d4f7fcf5a497d80ae244da048f83a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:19.571564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:19.621283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:19.623194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:19.634027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:19.657196 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1711/3419] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:19.696928 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1709/3420] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:20.106457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:20.109649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:20.155913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:20.199293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085944-fc56-4387-b82f-b432ad7058ec service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:20.203962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:20.204674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:20.205083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:20.205431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:20.208355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:20.220127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:20.221881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:20.232345 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1712/3421] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:21.802473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:21.827156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac2873-5fdc-4bee-b7f3-74bef3d64bb8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:21.845294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834587-7ae1-4515-9b9b-791325b7b61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:21.846144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834587-7ae1-4515-9b9b-791325b7b61c service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:21.848178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834587-7ae1-4515-9b9b-791325b7b61c service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:21.848455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834587-7ae1-4515-9b9b-791325b7b61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:21.867832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834587-7ae1-4515-9b9b-791325b7b61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:21.871744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834587-7ae1-4515-9b9b-791325b7b61c service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:21.885834 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1710/3422] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:22.596925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:22.638449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a32f1-4945-459c-841c-14d8f264056b service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:22.653313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:22.657741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:22.657741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:22.657741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:22.659095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:22.818342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:22.819800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bbc5d-3da1-4748-8923-1e8861d52fa2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:22.837045 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1713/3423] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:24.646525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:24.649259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:24.649770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:24.748271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] MFA Rules not processed for user `be98774a590b47cbaa5cd2516a4cc399`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:24.749530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:24.881604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:24.882478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:24.882827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:24.886073 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1711/3424] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:24.932067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] MFA Rules not processed for user `be98774a590b47cbaa5cd2516a4cc399`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:24.933710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:24.949893 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1714/3425] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:25.639546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:25.642925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:25.723028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e64ec-2cfb-453b-a4e8-789a7e01abf5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:25.729630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:25.730503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:25.731082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:25.731608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:25.758707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:25.762577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:25.784154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1712/3426] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:26.882830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:26.884984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:26.902715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b6cdf-fe43-4ba4-80e0-de6da13207aa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:26.907361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:26.908276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:26.908729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:26.912061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:26.912061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:26.925906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:26.927721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:26.941738 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1715/3427] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:32.516510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:32.532952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b0c5-364e-4a02-8773-d9428931ee9d service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:32.540808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:32.541827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:32.542235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:32.542755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:32.545531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:32.622169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:32.624303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:32.651530 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1713/3428] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:35.207665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:35.210810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:35.326878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7afbd-8fc3-44f8-b2d2-d6b205d8beee service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:35.344616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:35.344616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:35.344616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:35.344616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] PATH_INFO: `/v3/users/530deff4b6bf4573b2d081108eca5dd1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:35.345214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=530deff4b6bf4573b2d081108eca5dd1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:35.345214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:35.596744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:35.607625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530deff4b6bf4573b2d081108eca5dd1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:35.629867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530deff4b6bf4573b2d081108eca5dd1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:35.640787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530deff4b6bf4573b2d081108eca5dd1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:35.641655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530deff4b6bf4573b2d081108eca5dd1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:35.642522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9996a99d-2c6b-4b35-9868-2b3395ff5a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530deff4b6bf4573b2d081108eca5dd1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:35.740073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1716/3429] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:35 2022] DELETE /identity/v3/users/530deff4b6bf4573b2d081108eca5dd1 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:36.155799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:36.191225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17534-2a1c-4c22-9dd8-64b3862514f7 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:36.226560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:36.264007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:36.264981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:36.272201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:36.272958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] PATH_INFO: `/v3/projects/bf61c4060dfc402785f0e97364afd0e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:36.275011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf61c4060dfc402785f0e97364afd0e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:36.277336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:36.431057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf61c4060dfc402785f0e97364afd0e3', 'request_id': 'req-ad173202-9804-471d-9a01-051827e1c054'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:36.439764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf61c4060dfc402785f0e97364afd0e3', 'request_id': 'req-ad173202-9804-471d-9a01-051827e1c054'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:36.447370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf61c4060dfc402785f0e97364afd0e3', 'request_id': 'req-ad173202-9804-471d-9a01-051827e1c054'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:36.568072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] The token cache is being invalidate because project bf61c4060dfc402785f0e97364afd0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:36.568364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:36.569722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad173202-9804-471d-9a01-051827e1c054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:36.571806 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1714/3430] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:36 2022] DELETE /identity/v3/projects/bf61c4060dfc402785f0e97364afd0e3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:36.577215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:36.577755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:36.577755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:36.618374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:36.620464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:36.725372 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1717/3431] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:36.734260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:36.734545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:36.734965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:36.778521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:36.791632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:36.812755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1715/3432] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:36.818231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:36.832494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08480d-dd10-465f-bf79-d7976f26a875 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:36.851702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:36.852688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:36.852688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:36.853152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:36.854097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:36.854404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:36.856658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:36.880137 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1718/3433] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:36.884936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:36.902925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8dcf4-e78f-4b95-9eff-f45f95f5bd6e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:36.912604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:36.913809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:36.915034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:36.915809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:36.916911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:36.919301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:37.034513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:37.044682 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1716/3434] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:36 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:37.054266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e35a-e225-45ba-97e7-65e7feb5d2e8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:37.262957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:37.264762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:37.265065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:37.265345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:37.270860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:37.273567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:37.426739 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1719/3435] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:37 2022] POST /identity/v3/users => generated 281 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:04:37.437592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:37.483681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d1eb1-1ba9-4f90-976c-45a8b242e276 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:37.506260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:37.507643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:37.508013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:37.508476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:37.509320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:37.511314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:37.559458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1717/3436] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:37.562943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:37.582390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b205629-2105-4dec-8b98-d802224c2621 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:37.588562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ec4a7-17e5-4d26-ae03-17e54d26e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:37.589194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ec4a7-17e5-4d26-ae03-17e54d26e8fa admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:37.589474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ec4a7-17e5-4d26-ae03-17e54d26e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:37.589987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ec4a7-17e5-4d26-ae03-17e54d26e8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:37.590860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ec4a7-17e5-4d26-ae03-17e54d26e8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:37.593018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ec4a7-17e5-4d26-ae03-17e54d26e8fa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:37.620974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1720/3437] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:37.621107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:37.633353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7645-6985-4f98-af1a-82544eaf42c2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:37.639956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:37.640893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:37.641378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:37.641895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] PATH_INFO: `/v3/projects/a02b1926d1e94af6b3cabff0e45417e7/users/2cf701bbebd8419ebcf740fe7eed6d31/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:37.684920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02b1926d1e94af6b3cabff0e45417e7, user_id=2cf701bbebd8419ebcf740fe7eed6d31, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:37.688513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:37.786141 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1718/3438] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:37 2022] PUT /identity/v3/projects/a02b1926d1e94af6b3cabff0e45417e7/users/2cf701bbebd8419ebcf740fe7eed6d31/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:37.800518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:37.800798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:37.801354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:37.873222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] MFA Rules not processed for user `2cf701bbebd8419ebcf740fe7eed6d31`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:37.875049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:37.894177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:37.984702 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1721/3439] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:38.024551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:38.026569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:38.092874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:38.116644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f388a2-e074-429d-813a-544fc41d4a5f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:38.122920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c84b54-6c15-40fa-b91a-949ec2ff3a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:38.123842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c84b54-6c15-40fa-b91a-949ec2ff3a49 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:38.124345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c84b54-6c15-40fa-b91a-949ec2ff3a49 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:38.124786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c84b54-6c15-40fa-b91a-949ec2ff3a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:38.133839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c84b54-6c15-40fa-b91a-949ec2ff3a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:38.135544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c84b54-6c15-40fa-b91a-949ec2ff3a49 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:38.151326 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1719/3440] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:38.198606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:38.302469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af38f-aaa9-4e05-b065-7d751850e0f9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:38.310131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:38.311328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:38.311821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:38.312302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] PATH_INFO: `/v3/users/2cf701bbebd8419ebcf740fe7eed6d31` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:38.313741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf701bbebd8419ebcf740fe7eed6d31)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:38.316672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:38.594457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf701bbebd8419ebcf740fe7eed6d31'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:38.629029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf701bbebd8419ebcf740fe7eed6d31'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:38.646507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf701bbebd8419ebcf740fe7eed6d31'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:38.648937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf701bbebd8419ebcf740fe7eed6d31'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:38.650047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf701bbebd8419ebcf740fe7eed6d31'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:38.732664 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1722/3441] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:38 2022] DELETE /identity/v3/users/2cf701bbebd8419ebcf740fe7eed6d31 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:38.737659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:38.738850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:38.739204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:38.780227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:38.781645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:38.878976 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1720/3442] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:38.931454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:38.932884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:39.093673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:39.140655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddebb8f-eab6-47b5-aad3-27685535a29a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:39.145436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e513681-f182-47bd-95e2-9032aa6723ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:39.147633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513681-f182-47bd-95e2-9032aa6723ba service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:39.147929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513681-f182-47bd-95e2-9032aa6723ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:39.148660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513681-f182-47bd-95e2-9032aa6723ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:39.164001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513681-f182-47bd-95e2-9032aa6723ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:39.168838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513681-f182-47bd-95e2-9032aa6723ba service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:39.196777 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1723/3443] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:40.196361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:40.198484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:40.231864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba412-3edf-44b2-887a-bb55619e6789 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:40.262347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:40.263002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:40.263284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:40.263559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] PATH_INFO: `/v3/projects/a02b1926d1e94af6b3cabff0e45417e7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:40.264778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02b1926d1e94af6b3cabff0e45417e7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:40.267999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:40.500500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02b1926d1e94af6b3cabff0e45417e7', 'request_id': 'req-a76afdde-6b54-416a-b8b6-bdc3d28c2167'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:40.511272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02b1926d1e94af6b3cabff0e45417e7', 'request_id': 'req-a76afdde-6b54-416a-b8b6-bdc3d28c2167'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:40.562463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02b1926d1e94af6b3cabff0e45417e7', 'request_id': 'req-a76afdde-6b54-416a-b8b6-bdc3d28c2167'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:40.700892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] The token cache is being invalidate because project a02b1926d1e94af6b3cabff0e45417e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:40.701372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:40.706363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a76afdde-6b54-416a-b8b6-bdc3d28c2167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:40.708483 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1721/3444] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:40 2022] DELETE /identity/v3/projects/a02b1926d1e94af6b3cabff0e45417e7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:40.713346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:40.713986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:40.714071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:40.787703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:40.788992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:41.006200 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1724/3445] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:41.015811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:41.015955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:41.016141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:41.099446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:41.105254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:41.168708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1722/3446] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:41.171188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:41.187440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298910b-bd34-49b3-aba4-8173fd280de4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:41.204051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:41.204794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:41.205076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:41.205348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:41.206209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:41.207136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:41.210726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:41.261503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1725/3447] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:41.275452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:41.285433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cbdc8-d2f3-45d9-a244-f331f8c6ebdf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:41.298804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:41.303260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:41.303553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:41.304794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:41.307580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:41.321066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:41.531207 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1723/3448] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:41 2022] POST /identity/v3/projects => generated 379 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:41.536749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:41.559822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0626a3-87ba-4894-89b2-5d40d6ee2368 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:41.775498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:41.776243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:41.776715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:41.776996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:41.777724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:41.779864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:41.921489 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1726/3449] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:41 2022] POST /identity/v3/users => generated 290 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:41.927072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:41.944496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d67be1-cdca-4e0a-ab75-9adfe82143f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:41.955029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:41.957378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:41.958097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:41.958680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:41.959738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:41.962258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:41.983260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1724/3450] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:04:41.990235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:42.056829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d9d7-89f0-424c-a7c6-c71e0615e891 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:42.068833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c19071-58e8-4854-b51d-5283ca1fb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:42.070662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19071-58e8-4854-b51d-5283ca1fb099 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:42.071691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19071-58e8-4854-b51d-5283ca1fb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:42.072413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19071-58e8-4854-b51d-5283ca1fb099 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:42.073907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19071-58e8-4854-b51d-5283ca1fb099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:42.077380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19071-58e8-4854-b51d-5283ca1fb099 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:42.112673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:42.112995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1727/3451] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:04:42.130107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b0f12-1a7f-47bf-9606-0eb0f2808f4d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:42.145419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:42.146417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:42.146861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:42.147324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] PATH_INFO: `/v3/projects/1e780e72454849a9adf5c45a7783c014/users/05e2ae4eec754ac5bbeeeed56018614b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:42.223792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e780e72454849a9adf5c45a7783c014, user_id=05e2ae4eec754ac5bbeeeed56018614b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:42.228090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:42.354561 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1725/3452] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:42 2022] PUT /identity/v3/projects/1e780e72454849a9adf5c45a7783c014/users/05e2ae4eec754ac5bbeeeed56018614b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:42.368910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:42.369271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:42.369460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:42.407719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:42.416099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:42.510650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:42.571403 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1728/3453] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:42.599122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:42.601200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:42.608994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:42.816980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f709fe-dbbc-421a-a6c6-c87242eece31 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:42.828526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:42.829364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:42.830146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:42.831702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:42.871327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:42.875495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:42.890563 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1726/3454] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:04:44.686427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:44.691776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:44.713386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1f4d-fbdf-48f8-90bc-59401fca0a4e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:44.724289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:44.726429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:44.726923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:44.727412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] PATH_INFO: `/v3/users/9b79042dfe9242f8a4833a969fb1a911` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:44.728947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b79042dfe9242f8a4833a969fb1a911)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:44.731944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:45.008066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b79042dfe9242f8a4833a969fb1a911'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:45.039293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b79042dfe9242f8a4833a969fb1a911'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:45.051355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b79042dfe9242f8a4833a969fb1a911'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:45.052751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b79042dfe9242f8a4833a969fb1a911'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:45.053580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cf043165-e5b3-43f2-8121-da1fb79fd40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b79042dfe9242f8a4833a969fb1a911'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:45.168418 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1729/3455] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:04:44 2022] DELETE /identity/v3/users/9b79042dfe9242f8a4833a969fb1a911 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:45.657648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:45.688713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292bf9f-234f-42cf-9c93-9d61ed5b1cd5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:45.868308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:45.869717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:45.871228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:45.871985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] PATH_INFO: `/v3/projects/51ab0b6f6a7549a68be0791b209cc1ec` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:45.873742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ab0b6f6a7549a68be0791b209cc1ec)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:45.876514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:46.018728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ab0b6f6a7549a68be0791b209cc1ec', 'request_id': 'req-9b746765-83de-410e-9cb4-c4813760fe5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:46.030850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ab0b6f6a7549a68be0791b209cc1ec', 'request_id': 'req-9b746765-83de-410e-9cb4-c4813760fe5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:46.040786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ab0b6f6a7549a68be0791b209cc1ec', 'request_id': 'req-9b746765-83de-410e-9cb4-c4813760fe5a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:46.153081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] The token cache is being invalidate because project 51ab0b6f6a7549a68be0791b209cc1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:04:46.153503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:46.155201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9b746765-83de-410e-9cb4-c4813760fe5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:04:46.159156 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1727/3456] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:04:45 2022] DELETE /identity/v3/projects/51ab0b6f6a7549a68be0791b209cc1ec => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:46.164186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55473790-6632-4136-8007-04ce02b54600 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:46.165003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55473790-6632-4136-8007-04ce02b54600 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:46.165003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55473790-6632-4136-8007-04ce02b54600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:46.215190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-55473790-6632-4136-8007-04ce02b54600 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:46.217398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-55473790-6632-4136-8007-04ce02b54600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:46.390055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1730/3457] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:46.398109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:46.401130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:46.401130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:46.482251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:46.482251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:46.500538 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1728/3458] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:46.505559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55473790-6632-4136-8007-04ce02b54600 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:46.516705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55473790-6632-4136-8007-04ce02b54600 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:46.522850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:46.523477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:46.523755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:46.524065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:46.525092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:04:46.525406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:46.527341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:46.560440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:46.566960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1731/3459] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:04:46.571846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9053-3f00-42d4-9542-4b67132c6484 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:46.578644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:46.580278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:46.580278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:46.580278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:46.581593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:46.584052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:46.701444 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1729/3460] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:04:46 2022] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:04:46.706076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:46.720147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5b450-540c-425d-b4d6-69c96e209af9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:46.779151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:46.829140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:46.832906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:46.833673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:46.834055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:46.834906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:46.838304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:46.984341 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1732/3461] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:04:46 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:04:46.996840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:47.001400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df708d5-599f-45d5-9683-206ac27ff56a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:47.006409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:47.007038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:47.007332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:47.007599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:47.008328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:47.010017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:47.011614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:47.021884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1730/3462] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:47.026415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:47.039227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d618-dce5-49de-8cb2-ec06620604ad admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:47.045818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519bb1-9ce1-41f8-9f21-8910ef452b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:47.046498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519bb1-9ce1-41f8-9f21-8910ef452b60 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:47.046780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519bb1-9ce1-41f8-9f21-8910ef452b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:47.047062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519bb1-9ce1-41f8-9f21-8910ef452b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:47.047827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38519bb1-9ce1-41f8-9f21-8910ef452b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:47.051584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38519bb1-9ce1-41f8-9f21-8910ef452b60 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:47.064519 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1733/3463] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:04:47.069106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:47.088470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80249af8-9293-42a4-985d-a936234874f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:47.104962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:47.105345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:47.105769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:47.106298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] PATH_INFO: `/v3/projects/98d29650cbad408a8f78ba33f2cacd24/users/a2fe22fc4d064b0aa3e9147e2558fc90/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:47.148485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d29650cbad408a8f78ba33f2cacd24, user_id=a2fe22fc4d064b0aa3e9147e2558fc90, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:47.151426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:47.280090 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1731/3464] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:04:47 2022] PUT /identity/v3/projects/98d29650cbad408a8f78ba33f2cacd24/users/a2fe22fc4d064b0aa3e9147e2558fc90/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:04:47.286224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:47.286846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:47.286846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:47.318450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:47.319442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:47.443888 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1734/3465] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:04:47.454403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:47.458238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:47.605895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51f46-f780-4a4d-9841-e7a5478db068 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:47.610846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b182f5-cce6-48ff-938e-cfa5fb30e0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:47.612691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b182f5-cce6-48ff-938e-cfa5fb30e0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:47.612981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b182f5-cce6-48ff-938e-cfa5fb30e0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:47.613264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b182f5-cce6-48ff-938e-cfa5fb30e0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:47.630808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b182f5-cce6-48ff-938e-cfa5fb30e0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:47.632304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b182f5-cce6-48ff-938e-cfa5fb30e0d1 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:47.663648 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1732/3466] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:51.302576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:51.320866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0d33-577c-406a-b207-ec1fdff41388 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:51.328578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:51.332173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:51.332985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:51.335220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:51.344859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:51.391698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:51.396906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f46f4-6e2e-4e67-b0b6-07833df2912f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:51.431517 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1735/3467] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:56.081460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:56.082747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:56.083869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:56.149234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:56.150894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:56.265996 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1733/3468] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:56.273571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:56.274172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:56.274559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:56.304090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:56.306025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:56.326612 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1736/3469] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:56.335457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:56.337350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:56.511207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:56.521740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944690a-92c7-4558-aeff-4c8f9bb3c4ca None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:56.538897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a258d-fec7-4023-bbaa-1179dc0d1ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:56.539680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a258d-fec7-4023-bbaa-1179dc0d1ade service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:56.539968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a258d-fec7-4023-bbaa-1179dc0d1ade service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:56.544778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a258d-fec7-4023-bbaa-1179dc0d1ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:56.556460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a258d-fec7-4023-bbaa-1179dc0d1ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:56.558510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a258d-fec7-4023-bbaa-1179dc0d1ade service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:56.579093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1734/3470] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:00.847031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:00.849596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:00.882452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60d6d-8f04-4896-bc3b-58bef921077a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:00.905580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:00.906977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:00.907401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:00.907932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] PATH_INFO: `/v3/users/1672b0b7c93c4959a3e803902333f823` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:00.912604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1672b0b7c93c4959a3e803902333f823)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:00.915134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:00.963559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:00.964496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:00.964496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:01.029928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] MFA Rules not processed for user `a2fe22fc4d064b0aa3e9147e2558fc90`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:01.031854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:01.209839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1672b0b7c93c4959a3e803902333f823'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:01.232848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1672b0b7c93c4959a3e803902333f823'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:01.257159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1672b0b7c93c4959a3e803902333f823'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:01.261494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1672b0b7c93c4959a3e803902333f823'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:01.262637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1672b0b7c93c4959a3e803902333f823'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:01.292471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1735/3471] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:01.307983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:01.309717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:01.340808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffa437-a353-4b07-a5f7-be582aad4d11 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:01.355108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35bc8-e755-4374-8979-fec3b6de2111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:01.363786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35bc8-e755-4374-8979-fec3b6de2111 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:01.370201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35bc8-e755-4374-8979-fec3b6de2111 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:01.379732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35bc8-e755-4374-8979-fec3b6de2111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:01.383820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1737/3472] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:00 2022] DELETE /identity/v3/users/1672b0b7c93c4959a3e803902333f823 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:01.400693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35bc8-e755-4374-8979-fec3b6de2111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:01.403797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35bc8-e755-4374-8979-fec3b6de2111 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:01.452166 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1736/3473] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:02.073052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:02.079081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:02.192732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:02.472651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09c02-2288-475c-b7fe-9ec923bf6842 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:02.479682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:02.480366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:02.480712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:02.481219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] PATH_INFO: `/v3/projects/bdde347dfb5b40d5b3f7d1da61f062c2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:02.483316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdde347dfb5b40d5b3f7d1da61f062c2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:02.485928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:02.750475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdde347dfb5b40d5b3f7d1da61f062c2', 'request_id': 'req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:02.777063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdde347dfb5b40d5b3f7d1da61f062c2', 'request_id': 'req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:02.786732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdde347dfb5b40d5b3f7d1da61f062c2', 'request_id': 'req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:02.903010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] The token cache is being invalidate because project bdde347dfb5b40d5b3f7d1da61f062c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:02.903372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:02.907598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0b75c8e-7258-44d9-ae96-5c6d2fa3e347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:02.925124 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1738/3474] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:02 2022] DELETE /identity/v3/projects/bdde347dfb5b40d5b3f7d1da61f062c2 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:02.925259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:02.925259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:02.925259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:02.982783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:02.984662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:03.172097 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1737/3475] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:03.186437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:03.187002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:03.187418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:03.260211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:03.269256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:03.293037 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1739/3476] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:03.307771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:03.338003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de51f-2128-43a5-a961-9a62504ecc8d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:03.355170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:03.360024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:03.363770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:03.363770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:03.365673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:05:03.366036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:03.371699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:03.405207 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1738/3477] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:03.427298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:03.438312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f653097-bc8e-4b36-ac0b-2fb8053251b8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:03.444395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:03.445036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:03.445346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:03.445626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:03.446399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:03.449097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:03.540023 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1740/3478] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:03 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:03.544070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:03.558194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34845-dd84-4745-9a60-5d0fb18aa592 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:03.651691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:03.668887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:03.669545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:03.669835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:03.670142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:03.671193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:03.673346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:03.760325 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1739/3479] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:03 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:03.766977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:03.782295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51265-b271-4b53-8f1c-898afe079661 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:03.792628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:03.793694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:03.794413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:03.794898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:03.796360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:03.797914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:03.846287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1741/3480] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:03.847047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:03.886307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37303aee-833c-4256-8ab8-ec83fd073d2a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:03.901466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd69d1-8abb-4c83-8577-9626109bacdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:03.902513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd69d1-8abb-4c83-8577-9626109bacdd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:03.902984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd69d1-8abb-4c83-8577-9626109bacdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:03.903308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd69d1-8abb-4c83-8577-9626109bacdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:03.906692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd69d1-8abb-4c83-8577-9626109bacdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:03.911667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd69d1-8abb-4c83-8577-9626109bacdd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:03.969275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:03.969931 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1740/3481] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:05:04.001107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7081-c7da-47a9-9752-b1f281a741f4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:04.016340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:04.017124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:04.017546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:04.025974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] PATH_INFO: `/v3/projects/c29d03ba50174cc9bd079849fbaf30cc/users/eb7e6f91545547d48c78f343fb2628c2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:04.087676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29d03ba50174cc9bd079849fbaf30cc, user_id=eb7e6f91545547d48c78f343fb2628c2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:04.102577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:04.223984 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1742/3482] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:03 2022] PUT /identity/v3/projects/c29d03ba50174cc9bd079849fbaf30cc/users/eb7e6f91545547d48c78f343fb2628c2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:04.239061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:04.239603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:04.240501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:04.308816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] MFA Rules not processed for user `eb7e6f91545547d48c78f343fb2628c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:04.311169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:04.528252 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1741/3483] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:04.684481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:04.686959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:04.763033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:04.853266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d188da-2f5b-427c-81ea-69ea4a86818c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:04.861472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:04.862295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:04.862769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:04.863764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:04.876097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:04.879133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:04.896971 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1743/3484] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:04.927066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:04.958191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2c86-4404-4687-85a6-71a2cce73be0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:04.968054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:04.968909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:04.969927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:04.970849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:04.973838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:05.086814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:05.088900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730784-159a-48ca-b8f0-da4aa38bbb8f service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:05.105392 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1742/3485] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:06.335886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:06.450925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074792-b235-4664-b443-12ff623f6c1f service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:06.461119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:06.461949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:06.462241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:06.462643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] PATH_INFO: `/v3/users/eb7e6f91545547d48c78f343fb2628c2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:06.464589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7e6f91545547d48c78f343fb2628c2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:06.467348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:06.785173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7e6f91545547d48c78f343fb2628c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:06.811246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7e6f91545547d48c78f343fb2628c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:06.824684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7e6f91545547d48c78f343fb2628c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:06.825481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7e6f91545547d48c78f343fb2628c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:06.826974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7e6f91545547d48c78f343fb2628c2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:06.944696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1744/3486] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:06 2022] DELETE /identity/v3/users/eb7e6f91545547d48c78f343fb2628c2 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:06.950762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:06.951302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:06.952486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:06.987781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:06.990800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:07.160423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:07.194952 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1743/3487] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:07.270203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:07.271913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:07.436361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:07.470476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af4aa5-70a3-47ca-954f-f47e442e2dcd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:07.472447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853883c-18a5-415d-bbb9-8253afb1c480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:07.472447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853883c-18a5-415d-bbb9-8253afb1c480 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:07.472447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853883c-18a5-415d-bbb9-8253afb1c480 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:07.472447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853883c-18a5-415d-bbb9-8253afb1c480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:07.494228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853883c-18a5-415d-bbb9-8253afb1c480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:07.494228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853883c-18a5-415d-bbb9-8253afb1c480 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:07.521288 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1745/3488] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:08.472394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:08.474035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:08.499176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a28a1-de73-4141-8ced-9abe7921e02e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:08.507461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:08.509049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:08.509607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:08.510092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] PATH_INFO: `/v3/projects/c29d03ba50174cc9bd079849fbaf30cc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:08.512541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29d03ba50174cc9bd079849fbaf30cc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:08.515246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:08.676196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29d03ba50174cc9bd079849fbaf30cc', 'request_id': 'req-802a483b-7f3d-4098-a144-5a627dd63592'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:08.685902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29d03ba50174cc9bd079849fbaf30cc', 'request_id': 'req-802a483b-7f3d-4098-a144-5a627dd63592'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:08.695229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29d03ba50174cc9bd079849fbaf30cc', 'request_id': 'req-802a483b-7f3d-4098-a144-5a627dd63592'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:08.766620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] The token cache is being invalidate because project c29d03ba50174cc9bd079849fbaf30cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:08.766944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:08.768624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-802a483b-7f3d-4098-a144-5a627dd63592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:08.777534 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1744/3489] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:08 2022] DELETE /identity/v3/projects/c29d03ba50174cc9bd079849fbaf30cc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:08.779128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:08.779766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:08.779766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:08.831371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:08.835304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:09.029317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:09.030343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:09.030741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:09.041709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1746/3490] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:09.073361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:09.074970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:09.087480 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1745/3491] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:09.091058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:09.103650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64099216-3e2a-4ad3-a1ed-c6786553b9ee None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:09.137746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:09.140132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:09.140613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:09.141044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:09.141917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:05:09.142996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:09.145707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:09.186087 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1747/3492] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:09.195219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:09.229410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4927-9bac-4257-b1c9-1356030f6f01 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:09.239310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:09.240250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:09.240689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:09.241114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:09.242140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:09.244321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:09.445899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1746/3493] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:09 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:09.450146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:09.468551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b021-cb5f-4b0f-9f5f-742d65c9df76 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:09.641549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:09.643084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:09.650669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:09.650669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:09.650669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:09.650669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:09.777056 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1748/3494] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:09 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:09.781549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:09.797567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb067fa2-4556-4795-be4b-339b8206a45d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:09.804717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:09.806540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:09.807232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:09.807734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:09.814963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:09.817933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:09.870014 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1747/3495] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:09.875172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:09.905678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732293bd-3d1a-4533-9e5f-343b58188959 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:09.919759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923fd9e-78b6-4441-b2d7-64f9724f5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:09.921742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923fd9e-78b6-4441-b2d7-64f9724f5ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:09.922533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923fd9e-78b6-4441-b2d7-64f9724f5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:09.926460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923fd9e-78b6-4441-b2d7-64f9724f5ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:09.929705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923fd9e-78b6-4441-b2d7-64f9724f5ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:09.951528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923fd9e-78b6-4441-b2d7-64f9724f5ea9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:09.975130 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1749/3496] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:09.981093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:09.997091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a506c3-d209-4f30-a997-6e32957d067e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:10.022798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:10.023858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:10.024372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:10.024848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] PATH_INFO: `/v3/projects/062ea47d8aad43b08a7d49ebf16c6f11/users/af5151a7c1194036b307935cac4c3c99/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:10.062940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=062ea47d8aad43b08a7d49ebf16c6f11, user_id=af5151a7c1194036b307935cac4c3c99, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:10.069642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:10.189440 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1748/3497] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:09 2022] PUT /identity/v3/projects/062ea47d8aad43b08a7d49ebf16c6f11/users/af5151a7c1194036b307935cac4c3c99/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:10.207403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:10.208267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:10.208805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:10.247099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] MFA Rules not processed for user `af5151a7c1194036b307935cac4c3c99`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:10.249445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:10.321466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:10.364073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1750/3498] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:10.369047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:10.499537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4160b-3be7-49c4-8360-2ac4d7ae31fb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:10.523038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:10.523856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:10.524226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:10.524511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:10.525407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:10.527615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:10.648689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:10.661375 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1749/3499] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:10 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:10.662803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:10.677446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07949-6f9e-4f2b-8f0d-b526cf3ab6e9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:10.764809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:10.765233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:10.765437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:10.765715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:10.766443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:10.768367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:10.901218 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1751/3500] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:10 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:10.909583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:10.937718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9ea8-fa08-4a32-9752-f3c7a5ad9599 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:10.979421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:10.980645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:10.982098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:10.982590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:10.983571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:10.986863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.027799 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1750/3501] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:11.032537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.053227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0129-12b5-4179-9b0e-71ff7eca570e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.070029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.071693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.072289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.072728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] PATH_INFO: `/v3/projects/c0beac07d85b443883c72376c2eb8675/users/757fc30392db470dbdd50d2284586b64/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.102541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0beac07d85b443883c72376c2eb8675, user_id=757fc30392db470dbdd50d2284586b64, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.107156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.243378 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1752/3502] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:11 2022] PUT /identity/v3/projects/c0beac07d85b443883c72376c2eb8675/users/757fc30392db470dbdd50d2284586b64/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:11.245225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.257462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d65036-580b-4b5b-a6a9-178670fb191b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.343097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ca3fa-823a-4e69-8ca9-2e88ed3d5efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.344086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ca3fa-823a-4e69-8ca9-2e88ed3d5efc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.344598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ca3fa-823a-4e69-8ca9-2e88ed3d5efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.344885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ca3fa-823a-4e69-8ca9-2e88ed3d5efc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.345604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ca3fa-823a-4e69-8ca9-2e88ed3d5efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.347398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ca3fa-823a-4e69-8ca9-2e88ed3d5efc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.370749 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1751/3503] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:11.375075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.391213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac18f-e3f5-4594-82f4-3e5d87608581 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.401664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.403579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.404305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.404922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] PATH_INFO: `/v3/projects/c0beac07d85b443883c72376c2eb8675/users/757fc30392db470dbdd50d2284586b64/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.410623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0beac07d85b443883c72376c2eb8675, user_id=757fc30392db470dbdd50d2284586b64, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.415627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.448043 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1753/3504] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:11 2022] PUT /identity/v3/projects/c0beac07d85b443883c72376c2eb8675/users/757fc30392db470dbdd50d2284586b64/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:11.460124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.460554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.461087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.518415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] MFA Rules not processed for user `757fc30392db470dbdd50d2284586b64`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:11.520121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:11.642842 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1752/3505] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:11.647484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.682455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022dd3-eca5-4d78-be97-59189a3ec2c7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.689597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.690400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.690694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.691916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.692697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.694149 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:11.694149 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:11.694149 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:11.694925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invalid input for field 'name': '' is too short Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: On instance['name']: Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: On instance['name']: Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: '' Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise error Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application '' Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.710997 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:05:11.716948 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application '' Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:11.718643 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1754/3506] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:11 2022] POST /identity/v3/domains => generated 283 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:05:11.719257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.730736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ee1b-440b-4c86-a76f-41e57bac9ada None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.737258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.737502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.738024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.738314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.738708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.739553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.740468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:11.740601 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:11.740601 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:11.740601 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:11.741481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: On instance['name']: Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: On instance['name']: Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise error Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.749913 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 20:05:11.752248 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:11.753470 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1753/3507] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:11 2022] POST /identity/v3/domains => generated 412 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:05:11.758751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.772924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee40fd9-3838-4fda-aae3-98ba667b4000 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.778769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.779667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.779904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.780738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.781430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.783289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.833489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fe798-e362-4d64-95dc-88fcff53730f tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:11.839483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:11.841080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.841080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.841080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] PATH_INFO: `/v3/users/a2fe22fc4d064b0aa3e9147e2558fc90` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.843339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fe22fc4d064b0aa3e9147e2558fc90)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:11.847780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:11.914192 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1754/3508] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:11 2022] POST /identity/v3/domains => generated 277 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:11.918618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:11.986221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:12.001538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38b8e-e825-4ead-8052-0d9fdc74c512 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.009306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.010529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.010842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.011648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.029334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:12.041827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=30d6aefb2e1941d6bb42e3ed37ad8b26)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.042825 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:12.042825 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:12.042825 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:12.044169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:12.054395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fe22fc4d064b0aa3e9147e2558fc90'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 28 20:05:12.065029 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 20:05:12.066094 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:12.066908 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1755/3509] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:11 2022] DELETE /identity/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26 => generated 120 bytes in 149 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 28 20:05:12.072421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.074333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fe22fc4d064b0aa3e9147e2558fc90'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.084271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881db1-4df3-408f-a110-634311d0b2dd tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.090519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.090735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fe22fc4d064b0aa3e9147e2558fc90'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.091170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.091367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fe22fc4d064b0aa3e9147e2558fc90'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.091481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.091720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.092020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fe22fc4d064b0aa3e9147e2558fc90'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.093067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=30d6aefb2e1941d6bb42e3ed37ad8b26)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.094213 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:12.094213 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:12.094213 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:12.095577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:12.127369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.128854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.182177 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1755/3510] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:11 2022] DELETE /identity/v3/users/a2fe22fc4d064b0aa3e9147e2558fc90 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:12.231726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.233020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.243041 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1756/3511] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:12 2022] PATCH /identity/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26 => generated 278 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:12.247228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.248813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:12.324545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474f19-6feb-4365-a399-69e2b004754a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.331538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.331538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.332183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.332183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.344304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=30d6aefb2e1941d6bb42e3ed37ad8b26)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.345940 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:12.345940 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:12.345940 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:12.346851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:12.375466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.381320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.531320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26', 'request_id': 'req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.540208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26', 'request_id': 'req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.557777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26', 'request_id': 'req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.684149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] The token cache is being invalidate because project 30d6aefb2e1941d6bb42e3ed37ad8b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:12.684421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.684547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.685261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.687619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:12.697449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:12.728957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26', 'request_id': 'req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.731462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26', 'request_id': 'req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.752222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '30d6aefb2e1941d6bb42e3ed37ad8b26', 'request_id': 'req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:12.764536 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1756/3512] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:12 2022] DELETE /identity/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:12.772796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.776032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:12.823872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6dcb6-4452-4094-ada6-271d18af758c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.890527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de849a0-4aa6-4ea5-8713-f34fcb6fd01a tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.896417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.897357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.897736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.898145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/3a9e2c62b61a42cd89e791f73b237695` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.908206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Could not find domain: 3a9e2c62b61a42cd89e791f73b237695.: keystone.exception.DomainNotFound: Could not find domain: 3a9e2c62b61a42cd89e791f73b237695. Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3a9e2c62b61a42cd89e791f73b237695. Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:12.914209 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:12.915710 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:05:12.918044 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3a9e2c62b61a42cd89e791f73b237695. Aug 28 20:05:12.928254 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:12.928254 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1757/3513] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:12 2022] DELETE /identity/v3/domains/3a9e2c62b61a42cd89e791f73b237695 => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 20:05:12.928843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.928843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.928843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.928843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] PATH_INFO: `/v3/projects/98d29650cbad408a8f78ba33f2cacd24` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.929760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d29650cbad408a8f78ba33f2cacd24)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.931241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:12.934606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.958339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402efc7-f861-44dd-b586-6b47abe241d3 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.967027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.967652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.967935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.968213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.968898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.971089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:13.104667 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1758/3514] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:12 2022] POST /identity/v3/domains => generated 252 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:13.109276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:13.144776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:13.150736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d29650cbad408a8f78ba33f2cacd24', 'request_id': 'req-4edabc4f-1cc8-4957-a1e6-73668f9e0743'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.168799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d29650cbad408a8f78ba33f2cacd24', 'request_id': 'req-4edabc4f-1cc8-4957-a1e6-73668f9e0743'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.181508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d29650cbad408a8f78ba33f2cacd24', 'request_id': 'req-4edabc4f-1cc8-4957-a1e6-73668f9e0743'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.254007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9693eb-4f28-4d55-8c1e-dedb262f65de tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:13.288326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] The token cache is being invalidate because project 98d29650cbad408a8f78ba33f2cacd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:13.288803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.292055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4edabc4f-1cc8-4957-a1e6-73668f9e0743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.300245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1757/3515] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:12 2022] DELETE /identity/v3/projects/98d29650cbad408a8f78ba33f2cacd24 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:13.301823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b8f37-5946-4613-87cb-2c93d6ec90c2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.302234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b8f37-5946-4613-87cb-2c93d6ec90c2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.302582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b8f37-5946-4613-87cb-2c93d6ec90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.329839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e35b8f37-5946-4613-87cb-2c93d6ec90c2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:13.331920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e35b8f37-5946-4613-87cb-2c93d6ec90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:13.353557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:13.354624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.355071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.355406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.356323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:13.358661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:13.410036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.sql.core [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-265903525' for key 'project.ixu_project_name_domain_id'") Aug 28 20:05:13.410036 n-d-854121-7 devstack@keystone.service[82299]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 20:05:13.410036 n-d-854121-7 devstack@keystone.service[82299]: [parameters: {'id': '17961b4ed20f4fcc8633038b81990c04', 'name': 'tempest-domain-dup-265903525', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 20:05:13.410036 n-d-854121-7 devstack@keystone.service[82299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-265903525.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-265903525. Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 20:05:13.422774 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-265903525' for key 'project.ixu_project_name_domain_id'") Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 20:05:13.423833 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application yield resource Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise self.value Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application session.commit() Aug 28 20:05:13.425105 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.flush() Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application compat.raise_( Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 20:05:13.426352 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 20:05:13.427379 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 20:05:13.429219 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-265903525' for key 'project.ixu_project_name_domain_id'") Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [parameters: {'id': '17961b4ed20f4fcc8633038b81990c04', 'name': 'tempest-domain-dup-265903525', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.440763 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-265903525. Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:13.442109 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-265903525. Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:13.443339 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1759/3516] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:13 2022] POST /identity/v3/domains => generated 211 bytes in 324 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:05:13.445628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:13.448244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:13.461693 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1758/3517] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:13.469658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.472851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.475388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.477908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f48-a598-4f83-b5e9-8b7f23c4505c tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:13.489151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:13.489151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.489498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.490118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/8faf654d62064fd5bb61da54665c67dd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.500287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:13.502099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:13.509240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8faf654d62064fd5bb61da54665c67dd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:13.510394 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:13.510394 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:13.510394 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:13.511305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:13.515726 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1759/3518] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:13.520768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:13.533777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021acc5e-a4a7-4f69-bf13-27f66ebffdb8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:13.539679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:13.540381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.540834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.541113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.541792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:05:13.542244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:13.542687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8faf654d62064fd5bb61da54665c67dd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.543475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8faf654d62064fd5bb61da54665c67dd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.544207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:13.561911 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1760/3519] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:05:13.570890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:13.573082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:13.589379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0c45-1c6b-4df7-b2f7-a1327c8d8a60 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:13.707131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:13.707131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.707131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.707131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.707708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:13.710653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:13.763476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8faf654d62064fd5bb61da54665c67dd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.764525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8faf654d62064fd5bb61da54665c67dd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:13.772227 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1760/3520] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:13 2022] PATCH /identity/v3/domains/8faf654d62064fd5bb61da54665c67dd => generated 253 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:13.773222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:13.791687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:13.893724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f325-77c0-4108-8147-2abbfdadd5a7 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:13.901943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:13.902976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:13.903490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:13.904536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/8faf654d62064fd5bb61da54665c67dd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:13.919214 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1761/3521] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:13 2022] POST /identity/v3/projects => generated 383 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:13.926964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8faf654d62064fd5bb61da54665c67dd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:13.928614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:13.932774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:13.933471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:13.945591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.000522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8faf654d62064fd5bb61da54665c67dd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.006238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8faf654d62064fd5bb61da54665c67dd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.061516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed1818-5115-4bf4-99c3-46dd460ad0e7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.068398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83f19-f085-4406-806f-d524813428d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.069730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83f19-f085-4406-806f-d524813428d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.069730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83f19-f085-4406-806f-d524813428d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.069730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83f19-f085-4406-806f-d524813428d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.069730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e83f19-f085-4406-806f-d524813428d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.072527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e83f19-f085-4406-806f-d524813428d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.138859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8faf654d62064fd5bb61da54665c67dd', 'request_id': 'req-db711776-f2ab-4e70-a187-dd76574e1c20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.146385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8faf654d62064fd5bb61da54665c67dd', 'request_id': 'req-db711776-f2ab-4e70-a187-dd76574e1c20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.154481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8faf654d62064fd5bb61da54665c67dd', 'request_id': 'req-db711776-f2ab-4e70-a187-dd76574e1c20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.189787 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1762/3522] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:13 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:14.192868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.192868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.193484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.224666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] MFA Rules not processed for user `cc1a9bccd86b4a3b881314fe5a1505ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:14.242243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.278324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] The token cache is being invalidate because project 8faf654d62064fd5bb61da54665c67dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:14.278664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.280640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.295531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8faf654d62064fd5bb61da54665c67dd', 'request_id': 'req-db711776-f2ab-4e70-a187-dd76574e1c20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.296223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8faf654d62064fd5bb61da54665c67dd', 'request_id': 'req-db711776-f2ab-4e70-a187-dd76574e1c20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.301104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8faf654d62064fd5bb61da54665c67dd', 'request_id': 'req-db711776-f2ab-4e70-a187-dd76574e1c20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.308380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1761/3523] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:13 2022] DELETE /identity/v3/domains/8faf654d62064fd5bb61da54665c67dd => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:14.310953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.310953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.321713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1763/3524] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:14.323622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.326184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.434001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711776-f2ab-4e70-a187-dd76574e1c20 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.441876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.443341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.443623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.443913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.445689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.447355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.464935 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1762/3525] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:14.469445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.469718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913246-213b-46ff-9064-9e172ae7fdf3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.479087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757fc30392db470dbdd50d2284586b64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0beac07d85b443883c72376c2eb8675', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.480697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.480697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.481104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] PATH_INFO: `/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.484539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f3bd2-6a4a-456c-84aa-17418a16cc41 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.491910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.493081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.493218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.493390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.494231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.494768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:05:14.496168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.512382 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1763/3526] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Could not find domain: 30d6aefb2e1941d6bb42e3ed37ad8b26.: keystone.exception.DomainNotFound: Could not find domain: 30d6aefb2e1941d6bb42e3ed37ad8b26. Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 30d6aefb2e1941d6bb42e3ed37ad8b26. Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:14.518751 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:14.520954 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:05:14.523003 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 30d6aefb2e1941d6bb42e3ed37ad8b26. Aug 28 20:05:14.524998 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:14.524998 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1764/3527] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:14 2022] PATCH /identity/v3/domains/30d6aefb2e1941d6bb42e3ed37ad8b26 => generated 112 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:05:14.525273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.527114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.530600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.539630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314b87e-fe4f-4710-a529-613d94da7772 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.547868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ce772-588f-468a-b9ca-f75e514acd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.549566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ce772-588f-468a-b9ca-f75e514acd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.549566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ce772-588f-468a-b9ca-f75e514acd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.549990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ce772-588f-468a-b9ca-f75e514acd04 admin admin] PATH_INFO: `/v3/projects/2e3c425de2174a18963458a3dd7d23e5/users/daad1d169d0f420eb03b5a33f2a4e0a1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.554121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd56961-6d41-45fd-9698-fef0d58eb529 tempest-DomainsNegativeTestJSON-730508995 tempest-DomainsNegativeTestJSON-730508995-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.565627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.572136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.572136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.572136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] PATH_INFO: `/v3/users/af5151a7c1194036b307935cac4c3c99` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.572707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5151a7c1194036b307935cac4c3c99)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.574777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.580364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ce772-588f-468a-b9ca-f75e514acd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3c425de2174a18963458a3dd7d23e5, user_id=daad1d169d0f420eb03b5a33f2a4e0a1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.590997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ce772-588f-468a-b9ca-f75e514acd04 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.693733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:14.696886 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1764/3528] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:14 2022] PUT /identity/v3/projects/2e3c425de2174a18963458a3dd7d23e5/users/daad1d169d0f420eb03b5a33f2a4e0a1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:14.702264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.702585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.702998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.728461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:14.730033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.823819 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1765/3529] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:14.837841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.839664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.913143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c482f-0a50-4b1c-bc85-8034e4c737e5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.917211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45efdab-fdd3-4fd8-ac3a-7999b410799d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.917836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45efdab-fdd3-4fd8-ac3a-7999b410799d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.918148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45efdab-fdd3-4fd8-ac3a-7999b410799d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.918425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45efdab-fdd3-4fd8-ac3a-7999b410799d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.931224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45efdab-fdd3-4fd8-ac3a-7999b410799d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.933486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45efdab-fdd3-4fd8-ac3a-7999b410799d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.933930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5151a7c1194036b307935cac4c3c99'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.934624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5151a7c1194036b307935cac4c3c99'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:14.957982 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1766/3530] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:05:15.049402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5151a7c1194036b307935cac4c3c99'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:15.059991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5151a7c1194036b307935cac4c3c99'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:15.060875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5151a7c1194036b307935cac4c3c99'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:15.083299 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1765/3531] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:14 2022] DELETE /identity/v3/users/af5151a7c1194036b307935cac4c3c99 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:15.087852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:15.088251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:15.088532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:15.110855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:15.112092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:15.230084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1767/3532] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:15.255583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:15.258191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:15.337047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:15.446369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417340e-be33-4dd4-b7e1-653996c8472a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:15.446369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15886c61-218c-423d-8072-5581864b960c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:15.446369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15886c61-218c-423d-8072-5581864b960c service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:15.446369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15886c61-218c-423d-8072-5581864b960c service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:15.447211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15886c61-218c-423d-8072-5581864b960c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:15.474546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15886c61-218c-423d-8072-5581864b960c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:15.476586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15886c61-218c-423d-8072-5581864b960c service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:15.505918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1766/3533] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:16.649517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:16.652398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:16.685281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017437e-3d4f-4aa6-bcba-c163566ee889 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:16.695588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:16.697335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:16.698435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:16.699223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] PATH_INFO: `/v3/projects/062ea47d8aad43b08a7d49ebf16c6f11` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:16.702152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] RBAC: Authorizing `identity:delete_project(project_id=062ea47d8aad43b08a7d49ebf16c6f11)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:16.707463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:16.725772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:16.946582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062ea47d8aad43b08a7d49ebf16c6f11', 'request_id': 'req-54bc6dc3-f287-4e7c-988e-189db5d4972c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:16.956626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062ea47d8aad43b08a7d49ebf16c6f11', 'request_id': 'req-54bc6dc3-f287-4e7c-988e-189db5d4972c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:16.970673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062ea47d8aad43b08a7d49ebf16c6f11', 'request_id': 'req-54bc6dc3-f287-4e7c-988e-189db5d4972c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.062311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] The token cache is being invalidate because project 062ea47d8aad43b08a7d49ebf16c6f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:17.062663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.063354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.065420 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1768/3534] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:16 2022] DELETE /identity/v3/projects/062ea47d8aad43b08a7d49ebf16c6f11 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:17.070016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15886c61-218c-423d-8072-5581864b960c service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:17.082204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15886c61-218c-423d-8072-5581864b960c service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:17.192646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:17.194095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:17.194678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:17.195199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] PATH_INFO: `/v3/users/757fc30392db470dbdd50d2284586b64` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:17.197668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757fc30392db470dbdd50d2284586b64)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:17.201421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:17.475526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757fc30392db470dbdd50d2284586b64'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.476321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757fc30392db470dbdd50d2284586b64'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.641687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757fc30392db470dbdd50d2284586b64'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.653670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757fc30392db470dbdd50d2284586b64'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.662241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ee3556f-47b0-4a8c-8dcc-a8c5f3118e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757fc30392db470dbdd50d2284586b64'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:17.697963 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1767/3535] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:17 2022] DELETE /identity/v3/users/757fc30392db470dbdd50d2284586b64 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:18.388822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:18.390719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:18.411094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc6dc3-f287-4e7c-988e-189db5d4972c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:18.551961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:18.553006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:18.553993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:18.554476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] PATH_INFO: `/v3/projects/c0beac07d85b443883c72376c2eb8675` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:18.556970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0beac07d85b443883c72376c2eb8675)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:18.559305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:18.750439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:18.762931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0beac07d85b443883c72376c2eb8675', 'request_id': 'req-4db70475-e218-4761-9444-f32a63688e37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:18.771237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0beac07d85b443883c72376c2eb8675', 'request_id': 'req-4db70475-e218-4761-9444-f32a63688e37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:18.782414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0beac07d85b443883c72376c2eb8675', 'request_id': 'req-4db70475-e218-4761-9444-f32a63688e37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:18.895187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] The token cache is being invalidate because project c0beac07d85b443883c72376c2eb8675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:18.895543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:18.896315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db70475-e218-4761-9444-f32a63688e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:18.901559 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1769/3536] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:18 2022] DELETE /identity/v3/projects/c0beac07d85b443883c72376c2eb8675 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:18.903419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:18.912751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:18.913404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:18.937114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:18.938514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:19.026594 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1768/3537] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:19.036454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.036653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.036909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.083579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:19.085498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:19.098232 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1770/3538] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:19.102599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:19.120104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8865ac5-238c-4ce6-826f-bb362a935f56 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:19.130907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:19.131784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.132458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.132710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.133394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:05:19.133801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:19.135490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:19.149462 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1769/3539] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:19.156030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:19.172721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadda798-823f-45bb-9223-dc6ca74ce285 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:19.182134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:19.183112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.183595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.184051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.184969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:19.187697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:19.342626 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1771/3540] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:19 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:19.344325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:19.363081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52168c81-9270-4447-9126-fa111f45def6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:19.469254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:19.560725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:19.561443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.565381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.565381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.565381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:19.569002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:19.753942 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1770/3541] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:19 2022] POST /identity/v3/users => generated 285 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:19.760787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:19.792193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8297e4-42df-46c3-b2c9-79c7902e6a93 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:19.811096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:19.812042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.812613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.813092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.832598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:19.845701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:19.879609 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1772/3542] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:19.884463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:19.897889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1afb-c32a-4c93-a9fe-6a55bad73046 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:19.916536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448658dc-7e6b-4cc2-b792-45c4abaf8000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:19.917218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448658dc-7e6b-4cc2-b792-45c4abaf8000 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.921291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448658dc-7e6b-4cc2-b792-45c4abaf8000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.921291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448658dc-7e6b-4cc2-b792-45c4abaf8000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.921291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448658dc-7e6b-4cc2-b792-45c4abaf8000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:19.921291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448658dc-7e6b-4cc2-b792-45c4abaf8000 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:19.939167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:19.947714 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1771/3543] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:19.956000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbef355-ac7e-4bf9-91e0-aaeff9799179 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:19.959751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:19.960553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:19.960971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:19.961347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] PATH_INFO: `/v3/projects/5cfe182c67b644c38383f1454c67dd03/users/0d8b438c9ba248688c101a7db17625d8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:19.985992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfe182c67b644c38383f1454c67dd03, user_id=0d8b438c9ba248688c101a7db17625d8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:19.989058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:20.180393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1773/3544] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:19 2022] PUT /identity/v3/projects/5cfe182c67b644c38383f1454c67dd03/users/0d8b438c9ba248688c101a7db17625d8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:20.181684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:20.182027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:20.182307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:20.224550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] MFA Rules not processed for user `0d8b438c9ba248688c101a7db17625d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:20.226275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:20.338193 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1772/3545] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:05:20.338414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:20.420908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b1bd1-c0c3-4afd-b6bb-4b502eab65be admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:20.428965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:20.430145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:20.430442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:20.430736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:20.431672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:20.433924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:20.616399 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1774/3546] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:20 2022] POST /identity/v3/projects => generated 369 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:20.620140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:20.641538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9f2a-71bc-48a1-9752-b4e6a313ac79 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:20.747664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:20.748328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:20.748607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:20.748882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:20.749578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:20.752580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:20.954435 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1773/3547] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:20 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:20.958373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:20.980971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bcd7f-ebb0-4934-9ef3-2072565a0fa3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:20.998371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:20.999015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:20.999302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:20.999591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:21.000263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:21.002057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:21.023644 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1775/3548] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:21.029555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:21.052022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ced0fb-c8ea-4ae4-a0cb-b04eaf34aed8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:21.058964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:21.060659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:21.063112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:21.063112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] PATH_INFO: `/v3/projects/cd859dca861746c5b39eb85a4685e597/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:21.082442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd859dca861746c5b39eb85a4685e597, user_id=6dc57ebe998447859999d22014729e65, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:21.085420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:21.321845 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1774/3549] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:21 2022] PUT /identity/v3/projects/cd859dca861746c5b39eb85a4685e597/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:21.323342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:21.338285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553de74-e020-497b-a661-e14db053fbee admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:21.357216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:21.486735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d31d8-58b4-45c7-8536-f7b944e1f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:21.487393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d31d8-58b4-45c7-8536-f7b944e1f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:21.487674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d31d8-58b4-45c7-8536-f7b944e1f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:21.487948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d31d8-58b4-45c7-8536-f7b944e1f8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:21.488607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d31d8-58b4-45c7-8536-f7b944e1f8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:21.490288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d31d8-58b4-45c7-8536-f7b944e1f8dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:21.525494 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1776/3550] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:21.529460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:21.556216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a537f-1541-4865-ac01-e48c6369b7d8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:21.567958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:21.569521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:21.570303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:21.571019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] PATH_INFO: `/v3/projects/cd859dca861746c5b39eb85a4685e597/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:21.576439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd859dca861746c5b39eb85a4685e597, user_id=6dc57ebe998447859999d22014729e65, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:21.583390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:21.601069 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1775/3551] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:21 2022] PUT /identity/v3/projects/cd859dca861746c5b39eb85a4685e597/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:21.684651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:21.685250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:21.685735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:21.725380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] MFA Rules not processed for user `6dc57ebe998447859999d22014729e65`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:21.727030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:21.861431 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1777/3552] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:21.866073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:21.972198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb3cd-86ed-4bac-b9d0-99b8c2df4d88 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:21.981226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:21.982293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:21.986049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:21.986049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:21.986049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:21.987728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:22.161890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1776/3553] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:21 2022] POST /identity/v3/projects => generated 369 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:22.163931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:22.181633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2a53f-0166-4c5e-9808-6b075c2f90af None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:22.280548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:22.281657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:22.282746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:22.283312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:22.284082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:22.286426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:22.432578 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1778/3554] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:22 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:22.438570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:22.458163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b340a-f059-42af-a943-9ca5bed9caac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:22.471669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:22.473308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:22.473707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:22.474125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:22.476517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:22.479166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:22.499693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:22.509659 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1777/3555] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:05:22.511746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b620-6a66-4f89-b30a-aa1ec561d40f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:22.517726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66bbf-d044-4734-b7dc-f2bac22c1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:22.518676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66bbf-d044-4734-b7dc-f2bac22c1c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:22.519136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66bbf-d044-4734-b7dc-f2bac22c1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:22.519776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66bbf-d044-4734-b7dc-f2bac22c1c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:22.520587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66bbf-d044-4734-b7dc-f2bac22c1c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:22.522541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66bbf-d044-4734-b7dc-f2bac22c1c9d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:22.550776 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1779/3556] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:22.561315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:22.576051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32feeac-e28c-4449-a575-dc3f77b87942 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:22.584398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:22.585387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:22.585745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:22.586139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] PATH_INFO: `/v3/projects/7cc12c8c7ec9426ead3beb11c7cc0e10/users/110f1e5c260548ea907225b15c39644f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:22.610051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc12c8c7ec9426ead3beb11c7cc0e10, user_id=110f1e5c260548ea907225b15c39644f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:22.614332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:22.776433 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1778/3557] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:22 2022] PUT /identity/v3/projects/7cc12c8c7ec9426ead3beb11c7cc0e10/users/110f1e5c260548ea907225b15c39644f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:22.787088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:22.787415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:22.787665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:22.836213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] MFA Rules not processed for user `110f1e5c260548ea907225b15c39644f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:22.845913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:22.968348 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1780/3558] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:22.968568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:23.229741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd0be9-c347-4115-8850-02eeb2666528 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:23.248143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:23.248143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:23.248143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:23.248739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:23.248739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:23.250390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:23.407447 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1779/3559] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:22 2022] POST /identity/v3/domains => generated 276 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:23.412536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:23.432469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c872f-d294-4e45-a9b4-ddc425c77591 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:23.520647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:23.521443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:23.521736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:23.522142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:23.522923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:23.524179 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:23.524179 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:23.524179 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:23.525667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:23.730833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:23.743216 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1781/3560] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:05:23 2022] POST /identity/v3/roles => generated 240 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:23.743500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:23.766775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2e47-6c64-46ab-a497-804825cbdd74 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:23.774801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:23.775963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:23.776491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:23.776911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/0e0fb1c598884d658a43d5c6896b713c/users/110f1e5c260548ea907225b15c39644f/roles/78f58fa021ab4f579ad09d5c0b1dcb0c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:23.816520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0e0fb1c598884d658a43d5c6896b713c, user_id=110f1e5c260548ea907225b15c39644f, role_id=78f58fa021ab4f579ad09d5c0b1dcb0c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:23.816520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:24.044271 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1780/3561] 10.222.0.78 () {60 vars in 1480 bytes} [Sun Aug 28 20:05:23 2022] PUT /identity/v3/domains/0e0fb1c598884d658a43d5c6896b713c/users/110f1e5c260548ea907225b15c39644f/roles/78f58fa021ab4f579ad09d5c0b1dcb0c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:24.049922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:24.064209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093012a-b1c4-47f8-9dc9-dfb1e3114068 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:24.180552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:24.184448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:24.184448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:24.184448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:24.184448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:24.185562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:24.306084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1782/3562] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:24 2022] POST /identity/v3/domains => generated 276 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:24.310785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:24.323715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7e1b-c603-41c7-a247-018db243d038 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:24.432107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:24.432840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:24.433193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:24.433556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:24.434378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:24.435655 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:24.435655 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:24.435655 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:24.436994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:24.624866 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1781/3563] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:05:24 2022] POST /identity/v3/roles => generated 239 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:24.629914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:24.641607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437290f-c395-4aed-97c5-c155c207a9ee tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:24.655480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:24.656110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:24.656389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:24.656669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:24.657343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:24.658593 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:24.658593 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:24.658593 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:24.659830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:24.890876 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1783/3564] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:05:24 2022] POST /identity/v3/groups => generated 326 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:24.895347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:24.911343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eaf1f-a461-4dff-89b0-167d5a5011a3 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:24.916273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:24.917399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:24.917661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:24.918107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups/db30493b5d03484f939a12cc5e94a19a/users/110f1e5c260548ea907225b15c39644f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:24.926393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=db30493b5d03484f939a12cc5e94a19a, user_id=110f1e5c260548ea907225b15c39644f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:24.927570 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:24.927570 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:24.927570 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:24.928964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:25.174443 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1782/3565] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:05:24 2022] PUT /identity/v3/groups/db30493b5d03484f939a12cc5e94a19a/users/110f1e5c260548ea907225b15c39644f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:25.179584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:25.199196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cd6cd-0b54-435c-84ff-458f378d5776 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:25.367682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb337f-0a9d-48a0-8f1e-5cd02169bb4e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:25.387737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb337f-0a9d-48a0-8f1e-5cd02169bb4e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:25.390517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb337f-0a9d-48a0-8f1e-5cd02169bb4e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:25.390973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb337f-0a9d-48a0-8f1e-5cd02169bb4e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/88bf00ae12b84c38956ba10dfb1f6976/groups/db30493b5d03484f939a12cc5e94a19a/roles/562acbcb4c9849a98a618439ec50f161` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:25.398147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb337f-0a9d-48a0-8f1e-5cd02169bb4e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=88bf00ae12b84c38956ba10dfb1f6976, group_id=db30493b5d03484f939a12cc5e94a19a, role_id=562acbcb4c9849a98a618439ec50f161)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:25.402376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb337f-0a9d-48a0-8f1e-5cd02169bb4e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:25.545839 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1784/3566] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:25 2022] PUT /identity/v3/domains/88bf00ae12b84c38956ba10dfb1f6976/groups/db30493b5d03484f939a12cc5e94a19a/roles/562acbcb4c9849a98a618439ec50f161 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:25.550709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:25.578062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885fa87-8533-4aa3-b262-b35fd5a6e966 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:25.668234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:25.668787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:25.669348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:25.692128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:25.692820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:25.693310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:25.693733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:25.695027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:25.696968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:25.734129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] MFA Rules not processed for user `daad1d169d0f420eb03b5a33f2a4e0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:25.734129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:25.790998 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1785/3567] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:05:25.811673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:25.814469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:25.974378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4b7f3-bda5-4319-b7d8-b6bc8f3eb21f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:25.995302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:25.996442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:25.996563 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1783/3568] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:25 2022] POST /identity/v3/domains => generated 277 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:25.997047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:25.997415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:25.998434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:26.016129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:26.021323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:26.039759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:26.054799 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1786/3569] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:26.141346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05018-6b63-442c-a67d-9825524ef4fb tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:26.149275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9699575-3e10-4782-9e22-739344935134 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:26.150054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9699575-3e10-4782-9e22-739344935134 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:26.150577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9699575-3e10-4782-9e22-739344935134 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:26.151087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9699575-3e10-4782-9e22-739344935134 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:26.152179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9699575-3e10-4782-9e22-739344935134 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:26.154118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9699575-3e10-4782-9e22-739344935134 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:26.248861 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1784/3570] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:05:25 2022] POST /identity/v3/roles => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:26.254318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:26.288046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d37a-1da8-48fc-a301-e0f1121aa5c2 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:26.301325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:26.307054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:26.307581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:26.308097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/926165a894494ab4b26d4ef7616a1a83/users/110f1e5c260548ea907225b15c39644f/roles/68a86df590e841c1a80d7655a58c71d6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:26.369792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=926165a894494ab4b26d4ef7616a1a83, user_id=110f1e5c260548ea907225b15c39644f, role_id=68a86df590e841c1a80d7655a58c71d6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:26.377235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:26.420832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:26.421906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:26.423023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:26.448769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:26.452257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:26.519178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1787/3571] 10.222.0.78 () {60 vars in 1480 bytes} [Sun Aug 28 20:05:26 2022] PUT /identity/v3/domains/926165a894494ab4b26d4ef7616a1a83/users/110f1e5c260548ea907225b15c39644f/roles/68a86df590e841c1a80d7655a58c71d6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:26.523776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:26.594028 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1785/3572] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:26.663432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0ae8-12d3-4d07-bee5-8f9662445d60 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:26.669174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:26.670370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:26.670370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:26.670650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:26.671139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:26.672843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:26.886969 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1788/3573] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:05:26 2022] POST /identity/v3/domains => generated 275 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:26.887778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:26.917101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2415cd-6deb-4e57-bcda-8b6c98f1e883 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:27.030596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:27.031319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:27.031668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:27.032676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:27.032944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:27.035154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:27.194913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1786/3574] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:05:26 2022] POST /identity/v3/roles => generated 240 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:27.198840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:27.200647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:27.219877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c8de-ba90-40b0-b4dd-1a47e0e1d5a9 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:27.230885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:27.231578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:27.231867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:27.232148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:27.232861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:27.238956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:27.476436 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1789/3575] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:05:27 2022] POST /identity/v3/groups => generated 326 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:27.477325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:27.493644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80a0a-4fb6-4930-a1da-6475e29acf3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:27.505787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:27.506530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:27.506883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:27.507433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups/4809f474f862427ebc02eb583ebd3cca/users/110f1e5c260548ea907225b15c39644f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:27.517959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4809f474f862427ebc02eb583ebd3cca, user_id=110f1e5c260548ea907225b15c39644f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:27.524726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:27.753659 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1787/3576] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:05:27 2022] PUT /identity/v3/groups/4809f474f862427ebc02eb583ebd3cca/users/110f1e5c260548ea907225b15c39644f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:27.758237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:27.770621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f309-5043-4ef0-a9e6-430555f7cd23 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:27.897404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:27.898727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:27.899022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:27.899340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/492441b05e9e475e803c4aefb36c0194/groups/4809f474f862427ebc02eb583ebd3cca/roles/28fd745c7ff94f3fac25877984c38f6e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:27.902499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=492441b05e9e475e803c4aefb36c0194, group_id=4809f474f862427ebc02eb583ebd3cca, role_id=28fd745c7ff94f3fac25877984c38f6e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:27.908607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:28.068980 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1790/3577] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:27 2022] PUT /identity/v3/domains/492441b05e9e475e803c4aefb36c0194/groups/4809f474f862427ebc02eb583ebd3cca/roles/28fd745c7ff94f3fac25877984c38f6e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:28.073486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:28.318701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3984605-46ed-4b17-abf0-80ff1d2998c5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:28.517308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110f1e5c260548ea907225b15c39644f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc12c8c7ec9426ead3beb11c7cc0e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:28.518614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:28.519277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:28.522254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] PATH_INFO: `/v3/auth/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:28.523631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:28.528293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:28.673407 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1788/3578] 10.222.0.78 () {58 vars in 1143 bytes} [Sun Aug 28 20:05:28 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 601 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:28.679398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:28.859682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caac62-6060-4600-b08c-0a6a82780a92 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:28.867544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:28.872085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:28.872085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:28.872085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/492441b05e9e475e803c4aefb36c0194/groups/4809f474f862427ebc02eb583ebd3cca/roles/28fd745c7ff94f3fac25877984c38f6e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:28.874227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=492441b05e9e475e803c4aefb36c0194, group_id=4809f474f862427ebc02eb583ebd3cca, role_id=28fd745c7ff94f3fac25877984c38f6e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:28.876154 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:28.876154 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:28.876154 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:28.880865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:28.900001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 28fd745c7ff94f3fac25877984c38f6e was removed from group 4809f474f862427ebc02eb583ebd3cca on domain 492441b05e9e475e803c4aefb36c0194. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:28.900716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:28.901720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:29.100785 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1791/3579] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:05:28 2022] DELETE /identity/v3/domains/492441b05e9e475e803c4aefb36c0194/groups/4809f474f862427ebc02eb583ebd3cca/roles/28fd745c7ff94f3fac25877984c38f6e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:29.106025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:29.116595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:29.166592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6b32-540b-40a3-8587-eb44a702ecc6 tempest-TokensV3TestJSON-1756846706 tempest-TokensV3TestJSON-1756846706-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:29.272649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:29.274020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:29.274688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:29.275219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups/4809f474f862427ebc02eb583ebd3cca/users/110f1e5c260548ea907225b15c39644f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:29.280592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4809f474f862427ebc02eb583ebd3cca, user_id=110f1e5c260548ea907225b15c39644f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:29.282771 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:29.282771 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:29.282771 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:29.284636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:29.410938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:29.606310 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1789/3580] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:05:29 2022] DELETE /identity/v3/groups/4809f474f862427ebc02eb583ebd3cca/users/110f1e5c260548ea907225b15c39644f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:29.611870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:29.624978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5258-c7a9-4f09-89a4-e4fe1505e83e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:29.862583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:29.864441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:29.866646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:29.867775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups/4809f474f862427ebc02eb583ebd3cca` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:29.875107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4809f474f862427ebc02eb583ebd3cca)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:29.877350 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:29.877350 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:29.877350 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:29.880702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:30.031488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:30.035529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:30.165812 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1792/3581] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:05:29 2022] DELETE /identity/v3/groups/4809f474f862427ebc02eb583ebd3cca => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:30.168764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:30.186930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7222-d12f-4001-9dad-be8a36ee3d2a tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:30.328442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:30.329841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:30.330208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:30.330489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:30.333798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:30.349544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:30.352654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:30.366983 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1790/3582] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:30.386360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dbf4-e51b-4547-8858-a9d37f20b035 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:30.402587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:30.403837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:30.404310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:30.405159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles/28fd745c7ff94f3fac25877984c38f6e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:30.411404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28fd745c7ff94f3fac25877984c38f6e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:30.415629 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:30.415629 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:30.415629 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:30.420423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:30.752067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 28fd745c7ff94f3fac25877984c38f6e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:30.752471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:30.755359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:30.763392 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1793/3583] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:30 2022] DELETE /identity/v3/roles/28fd745c7ff94f3fac25877984c38f6e => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:30.763711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:30.785593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbef10-ac55-41ee-bb35-d9ee170615a6 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:30.947595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:30.949201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:30.949201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:30.949738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/492441b05e9e475e803c4aefb36c0194` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:30.961264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=492441b05e9e475e803c4aefb36c0194)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:30.961674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:30.995817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '492441b05e9e475e803c4aefb36c0194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:30.998182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '492441b05e9e475e803c4aefb36c0194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.219870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '492441b05e9e475e803c4aefb36c0194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.221647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '492441b05e9e475e803c4aefb36c0194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.236268 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1791/3584] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:30 2022] PATCH /identity/v3/domains/492441b05e9e475e803c4aefb36c0194 => generated 276 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:05:31.241440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:31.243747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:31.280408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e056c1e-570e-46bf-9f2d-f33182c243ca tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:31.410967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:31.411690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:31.412005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:31.412289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/492441b05e9e475e803c4aefb36c0194` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:31.426202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=492441b05e9e475e803c4aefb36c0194)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:31.427854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:31.460724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '492441b05e9e475e803c4aefb36c0194'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.465085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '492441b05e9e475e803c4aefb36c0194'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.614091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:31.654169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492441b05e9e475e803c4aefb36c0194', 'request_id': 'req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.670790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492441b05e9e475e803c4aefb36c0194', 'request_id': 'req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.692370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492441b05e9e475e803c4aefb36c0194', 'request_id': 'req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.867055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] The token cache is being invalidate because project 492441b05e9e475e803c4aefb36c0194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:31.867654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.870090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.901169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '492441b05e9e475e803c4aefb36c0194', 'request_id': 'req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.902184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '492441b05e9e475e803c4aefb36c0194', 'request_id': 'req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.910506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '492441b05e9e475e803c4aefb36c0194', 'request_id': 'req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:31.931797 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1794/3585] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:31 2022] DELETE /identity/v3/domains/492441b05e9e475e803c4aefb36c0194 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:31.932068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:31.932068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:31.951411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9b214-7287-4d4c-b80d-af16fafadeae tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:32.061184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:32.064453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:32.066551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:32.066872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/926165a894494ab4b26d4ef7616a1a83/users/110f1e5c260548ea907225b15c39644f/roles/68a86df590e841c1a80d7655a58c71d6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:32.076869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=926165a894494ab4b26d4ef7616a1a83, user_id=110f1e5c260548ea907225b15c39644f, role_id=68a86df590e841c1a80d7655a58c71d6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:32.079118 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:32.079118 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:32.079118 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:32.086150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:32.106238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 68a86df590e841c1a80d7655a58c71d6 was removed from user 110f1e5c260548ea907225b15c39644f on domain 926165a894494ab4b26d4ef7616a1a83. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:32.106622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:32.107702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:32.330997 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1792/3586] 10.222.0.78 () {58 vars in 1464 bytes} [Sun Aug 28 20:05:31 2022] DELETE /identity/v3/domains/926165a894494ab4b26d4ef7616a1a83/users/110f1e5c260548ea907225b15c39644f/roles/68a86df590e841c1a80d7655a58c71d6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:32.336341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:32.339160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:32.366392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3e99b-003f-4fcb-a3e4-75b93713c4ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:32.459762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:32.460410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:32.460876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:32.461312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles/68a86df590e841c1a80d7655a58c71d6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:32.463366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_role(role_id=68a86df590e841c1a80d7655a58c71d6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:32.465669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:32.812232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:32.819909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 68a86df590e841c1a80d7655a58c71d6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:32.820285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:32.821101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4c9ad16-7c53-4217-9103-4af90924d8a2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:32.828285 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1795/3587] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:32 2022] DELETE /identity/v3/roles/68a86df590e841c1a80d7655a58c71d6 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:32.828543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:32.830201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:32.852387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292eb65-8ff3-48aa-80ef-f368b5af3177 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:32.878876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:32.879219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:32.879440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:32.923230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] MFA Rules not processed for user `daad1d169d0f420eb03b5a33f2a4e0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:32.925123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:33.003880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:33.004552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:33.004843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:33.005231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/926165a894494ab4b26d4ef7616a1a83` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:33.012363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=926165a894494ab4b26d4ef7616a1a83)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:33.014608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:33.065067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '926165a894494ab4b26d4ef7616a1a83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.066638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '926165a894494ab4b26d4ef7616a1a83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.104390 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1796/3588] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:33.299741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '926165a894494ab4b26d4ef7616a1a83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.300575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '926165a894494ab4b26d4ef7616a1a83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.309434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:33.313002 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1793/3589] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:32 2022] PATCH /identity/v3/domains/926165a894494ab4b26d4ef7616a1a83 => generated 278 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:33.329269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:33.338051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25217-0491-464e-ae46-3cfc46a7f0eb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:33.490688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:33.491383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:33.491865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:33.492372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/926165a894494ab4b26d4ef7616a1a83` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:33.516134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=926165a894494ab4b26d4ef7616a1a83)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:33.522260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:33.576359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '926165a894494ab4b26d4ef7616a1a83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.587312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '926165a894494ab4b26d4ef7616a1a83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.865838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926165a894494ab4b26d4ef7616a1a83', 'request_id': 'req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.876719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926165a894494ab4b26d4ef7616a1a83', 'request_id': 'req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:33.889001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926165a894494ab4b26d4ef7616a1a83', 'request_id': 'req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.063880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] The token cache is being invalidate because project 926165a894494ab4b26d4ef7616a1a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:34.063880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.064378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.098896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '926165a894494ab4b26d4ef7616a1a83', 'request_id': 'req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.099897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '926165a894494ab4b26d4ef7616a1a83', 'request_id': 'req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.115779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '926165a894494ab4b26d4ef7616a1a83', 'request_id': 'req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.123768 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1797/3590] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:33 2022] DELETE /identity/v3/domains/926165a894494ab4b26d4ef7616a1a83 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:34.128259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:34.130266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:34.145246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51266b3a-d1cb-46a7-8d62-13af258270e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:34.278735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:34.279758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:34.280263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:34.280692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/88bf00ae12b84c38956ba10dfb1f6976/groups/db30493b5d03484f939a12cc5e94a19a/roles/562acbcb4c9849a98a618439ec50f161` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:34.285608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=88bf00ae12b84c38956ba10dfb1f6976, group_id=db30493b5d03484f939a12cc5e94a19a, role_id=562acbcb4c9849a98a618439ec50f161)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:34.291224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:34.304238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 562acbcb4c9849a98a618439ec50f161 was removed from group db30493b5d03484f939a12cc5e94a19a on domain 88bf00ae12b84c38956ba10dfb1f6976. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:34.304930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.306193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.478566 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1794/3591] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:05:34 2022] DELETE /identity/v3/domains/88bf00ae12b84c38956ba10dfb1f6976/groups/db30493b5d03484f939a12cc5e94a19a/roles/562acbcb4c9849a98a618439ec50f161 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:34.480102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:34.482284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:34.509491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b21c0-ff80-4245-99e6-10bc0b7157d2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:34.597989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:34.598984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:34.599384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:34.599780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups/db30493b5d03484f939a12cc5e94a19a/users/110f1e5c260548ea907225b15c39644f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:34.602050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=db30493b5d03484f939a12cc5e94a19a, user_id=110f1e5c260548ea907225b15c39644f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:34.603897 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:34.603897 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:05:34.603897 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:05:34.606490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:34.769801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:34.930869 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1798/3592] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:05:34 2022] DELETE /identity/v3/groups/db30493b5d03484f939a12cc5e94a19a/users/110f1e5c260548ea907225b15c39644f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:34.938313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:34.948268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:34.973562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76174d0-4512-462e-a39b-f3114743c726 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:35.112905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:35.114855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:35.115375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:35.122562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/groups/db30493b5d03484f939a12cc5e94a19a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:35.125336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_group(group_id=db30493b5d03484f939a12cc5e94a19a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:35.127874 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:35.127874 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:35.127874 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:35.131087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:35.461673 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1795/3593] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:05:34 2022] DELETE /identity/v3/groups/db30493b5d03484f939a12cc5e94a19a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:35.463247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:35.484982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d65-cd54-48a1-b56b-ad096922b6f5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:35.669982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:35.669982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:35.669982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:35.670686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles/562acbcb4c9849a98a618439ec50f161` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:35.673767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_role(role_id=562acbcb4c9849a98a618439ec50f161)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:35.675718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:35.758466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:35.827022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 562acbcb4c9849a98a618439ec50f161 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:35.827777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:35.842560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:35.853273 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1799/3594] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:35 2022] DELETE /identity/v3/roles/562acbcb4c9849a98a618439ec50f161 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:35.862318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:35.866304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:35.912687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8a655-a7fd-48aa-aad8-8e897a73b933 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:36.071227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:36.072571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:36.072858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:36.073134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/88bf00ae12b84c38956ba10dfb1f6976` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:36.079490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=88bf00ae12b84c38956ba10dfb1f6976)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:36.082234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:36.127504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.129227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.379675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:36.381194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.383055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.389073 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1796/3595] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:35 2022] PATCH /identity/v3/domains/88bf00ae12b84c38956ba10dfb1f6976 => generated 277 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:36.395366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:36.431179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d7f9-4296-4c6d-8e39-0460e98e547d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:36.536071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:36.536975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:36.537106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:36.537504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/88bf00ae12b84c38956ba10dfb1f6976` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:36.554722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=88bf00ae12b84c38956ba10dfb1f6976)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:36.557030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:36.611933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.620893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.904038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976', 'request_id': 'req-395b8437-0612-4da4-9893-f7e3d15ead1e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.912907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976', 'request_id': 'req-395b8437-0612-4da4-9893-f7e3d15ead1e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:36.921122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976', 'request_id': 'req-395b8437-0612-4da4-9893-f7e3d15ead1e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.100869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] The token cache is being invalidate because project 88bf00ae12b84c38956ba10dfb1f6976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:37.100869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.100869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.107365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976', 'request_id': 'req-395b8437-0612-4da4-9893-f7e3d15ead1e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.108259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976', 'request_id': 'req-395b8437-0612-4da4-9893-f7e3d15ead1e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.124788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '88bf00ae12b84c38956ba10dfb1f6976', 'request_id': 'req-395b8437-0612-4da4-9893-f7e3d15ead1e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.139582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1800/3596] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:36 2022] DELETE /identity/v3/domains/88bf00ae12b84c38956ba10dfb1f6976 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:37.141769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:37.143438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:37.158605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5fc37-5844-4471-b19c-b6552ce83822 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:37.262368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:37.264787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:37.265275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:37.265780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/0e0fb1c598884d658a43d5c6896b713c/users/110f1e5c260548ea907225b15c39644f/roles/78f58fa021ab4f579ad09d5c0b1dcb0c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:37.272402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0e0fb1c598884d658a43d5c6896b713c, user_id=110f1e5c260548ea907225b15c39644f, role_id=78f58fa021ab4f579ad09d5c0b1dcb0c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:37.279120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:37.295094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 78f58fa021ab4f579ad09d5c0b1dcb0c was removed from user 110f1e5c260548ea907225b15c39644f on domain 0e0fb1c598884d658a43d5c6896b713c. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:37.295881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.297433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:37.580091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1797/3597] 10.222.0.78 () {58 vars in 1464 bytes} [Sun Aug 28 20:05:37 2022] DELETE /identity/v3/domains/0e0fb1c598884d658a43d5c6896b713c/users/110f1e5c260548ea907225b15c39644f/roles/78f58fa021ab4f579ad09d5c0b1dcb0c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:37.580997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:37.580997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:37.602822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b8437-0612-4da4-9893-f7e3d15ead1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:37.763245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:37.764676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:37.765801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:37.768410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles/78f58fa021ab4f579ad09d5c0b1dcb0c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:37.770362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_role(role_id=78f58fa021ab4f579ad09d5c0b1dcb0c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:37.772461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:38.009834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 78f58fa021ab4f579ad09d5c0b1dcb0c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:38.010161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.027228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.027228 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1801/3598] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:37 2022] DELETE /identity/v3/roles/78f58fa021ab4f579ad09d5c0b1dcb0c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:38.033150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:38.035051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:38.060550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd362c-e9f7-45d6-9ee6-18a6c765234c tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:38.203976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:38.205016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:38.206599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:38.207841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/0e0fb1c598884d658a43d5c6896b713c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:38.213148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e0fb1c598884d658a43d5c6896b713c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:38.220691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:38.267594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.268771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.525143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.525883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.539180 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1798/3599] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:38 2022] PATCH /identity/v3/domains/0e0fb1c598884d658a43d5c6896b713c => generated 277 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:38.542323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:38.542687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:38.562873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca76bf-1694-425d-8127-01ca9dd7a09f tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:38.661460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:38.663870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:38.664359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:38.664799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/0e0fb1c598884d658a43d5c6896b713c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:38.681035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e0fb1c598884d658a43d5c6896b713c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:38.684161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:38.715333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.720107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:38.736273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:39.096249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c', 'request_id': 'req-18a404fa-9310-4195-a306-0351d2f1a2ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.114558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c', 'request_id': 'req-18a404fa-9310-4195-a306-0351d2f1a2ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.134983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c', 'request_id': 'req-18a404fa-9310-4195-a306-0351d2f1a2ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.349935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] The token cache is being invalidate because project 0e0fb1c598884d658a43d5c6896b713c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:39.350612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.351506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.371151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c', 'request_id': 'req-18a404fa-9310-4195-a306-0351d2f1a2ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.372065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c', 'request_id': 'req-18a404fa-9310-4195-a306-0351d2f1a2ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.381658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e0fb1c598884d658a43d5c6896b713c', 'request_id': 'req-18a404fa-9310-4195-a306-0351d2f1a2ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:39.401911 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1802/3600] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:05:38 2022] DELETE /identity/v3/domains/0e0fb1c598884d658a43d5c6896b713c => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:39.412319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:39.414615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:39.450218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1bfd4-e7c4-404e-8a81-01840691a583 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:39.542711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:39.543495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:39.543851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:39.544321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:39.545138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:39.550189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:39.570197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1799/3601] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:39.575276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:39.577244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:39.619162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a404fa-9310-4195-a306-0351d2f1a2ea tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:39.627158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:39.628534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:39.630110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:39.630665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/5cfe182c67b644c38383f1454c67dd03/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:39.634966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5cfe182c67b644c38383f1454c67dd03, user_id=6dc57ebe998447859999d22014729e65, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:39.639110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:39.943086 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1803/3602] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:39 2022] PUT /identity/v3/projects/5cfe182c67b644c38383f1454c67dd03/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:39.943639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:39.956893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e642d6-1455-463b-81e7-ad6c2db8a5ba tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:40.049108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:40.050047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:40.051568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:40.052461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:40.052867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:40.054251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:40.063370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:40.159865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1800/3603] 10.222.0.78 () {58 vars in 1146 bytes} [Sun Aug 28 20:05:39 2022] GET /identity/v3/auth/projects => generated 828 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:05:40.165237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:40.182664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69453-3c27-4c6c-9bac-a543402dfbc2 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:40.199331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:40.200043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:40.200332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:40.200612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/5cfe182c67b644c38383f1454c67dd03/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:40.202680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=5cfe182c67b644c38383f1454c67dd03, user_id=6dc57ebe998447859999d22014729e65, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:40.205977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:40.213128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 5f91ad37e210416db6e993bd952ab9e3 was removed from user 6dc57ebe998447859999d22014729e65 on project 5cfe182c67b644c38383f1454c67dd03. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:40.213128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:40.213794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:40.339639 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1804/3604] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:05:40 2022] DELETE /identity/v3/projects/5cfe182c67b644c38383f1454c67dd03/users/6dc57ebe998447859999d22014729e65/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:40.341832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:40.350394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:40.378539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fa75-f347-4574-a38f-2d47e603b1e1 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:40.470483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:40.471001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:40.471581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:40.471946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:40.472675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:40.475012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:40.712657 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1801/3605] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:40 2022] POST /identity/v3/users => generated 323 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:40.714979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:40.735502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb365b-7573-4108-bc2e-d6e72a9fe9f6 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:40.741710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:40.742871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:40.743235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:40.743643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:40.744535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:40.747092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:40.921585 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1805/3606] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:40 2022] POST /identity/v3/projects => generated 363 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:40.928416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:40.945624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0ee78-af84-4ee9-8b10-c9fbfcda954b tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:41.077357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:41.078020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:41.098895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:41.098895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:41.098895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:41.098895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:41.324356 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1802/3607] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:40 2022] POST /identity/v3/projects => generated 363 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:41.341273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:41.364347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0e3b-9e8f-4046-ac35-5474c3fe38c0 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:41.502892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:41.504019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:41.504697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:41.505380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:41.506594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:41.508857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:41.681901 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1806/3608] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:05:41 2022] POST /identity/v3/roles => generated 240 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:41.686235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:41.704160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a749-99f4-46f6-a478-e2b92a777070 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:41.711781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa32f5-e1fd-42f9-8001-8d4ce0780e3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:41.712757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa32f5-e1fd-42f9-8001-8d4ce0780e3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:41.713202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa32f5-e1fd-42f9-8001-8d4ce0780e3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:41.713703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa32f5-e1fd-42f9-8001-8d4ce0780e3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/0cfe3fef77334127805e0573adf6c4f2/users/e2523d6a29274b9ca6b4da79947329fa/roles/9be13674bd624caa87214b42628a6604` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:41.748581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa32f5-e1fd-42f9-8001-8d4ce0780e3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0cfe3fef77334127805e0573adf6c4f2, user_id=e2523d6a29274b9ca6b4da79947329fa, role_id=9be13674bd624caa87214b42628a6604)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:41.754787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa32f5-e1fd-42f9-8001-8d4ce0780e3e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:41.848375 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1803/3609] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:41 2022] PUT /identity/v3/projects/0cfe3fef77334127805e0573adf6c4f2/users/e2523d6a29274b9ca6b4da79947329fa/roles/9be13674bd624caa87214b42628a6604 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:41.853787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:41.871226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afdfe7-98b8-4cfb-b320-42467ff94e91 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:41.951211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da520c9-a903-46a6-b312-6d4cc0372d39 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:41.952067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da520c9-a903-46a6-b312-6d4cc0372d39 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:41.952356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da520c9-a903-46a6-b312-6d4cc0372d39 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:41.952640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da520c9-a903-46a6-b312-6d4cc0372d39 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/b2a04c016253431db9a4219d17b1d3b9/users/e2523d6a29274b9ca6b4da79947329fa/roles/9be13674bd624caa87214b42628a6604` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:41.955781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da520c9-a903-46a6-b312-6d4cc0372d39 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b2a04c016253431db9a4219d17b1d3b9, user_id=e2523d6a29274b9ca6b4da79947329fa, role_id=9be13674bd624caa87214b42628a6604)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:41.959987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da520c9-a903-46a6-b312-6d4cc0372d39 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:42.142899 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1807/3610] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:41 2022] PUT /identity/v3/projects/b2a04c016253431db9a4219d17b1d3b9/users/e2523d6a29274b9ca6b4da79947329fa/roles/9be13674bd624caa87214b42628a6604 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:42.148077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:42.148645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:42.148942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:42.210210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] MFA Rules not processed for user `e2523d6a29274b9ca6b4da79947329fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:42.212028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:42.216947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1804/3611] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:42 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:05:42.222175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6789-0727-44ec-97a6-1236ee478b6a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:42.222509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6789-0727-44ec-97a6-1236ee478b6a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:42.222749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6789-0727-44ec-97a6-1236ee478b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:42.246379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d6fa6789-0727-44ec-97a6-1236ee478b6a None None] MFA Rules not processed for user `e2523d6a29274b9ca6b4da79947329fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:42.247520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d6fa6789-0727-44ec-97a6-1236ee478b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:42.457618 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1808/3612] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:42 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 20:05:42.458962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:42.576378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7938ef2-2e2d-46b4-81b4-512466625b92 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:42.587634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:42.588188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:42.588476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:42.591512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:42.616416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:42.619261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:42.798103 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1805/3613] 10.222.0.78 () {56 vars in 1308 bytes} [Sun Aug 28 20:05:42 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:42.798686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:42.798986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:42.800016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:42.820802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] MFA Rules not processed for user `e2523d6a29274b9ca6b4da79947329fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:42.822551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:42.935021 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1809/3614] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:42 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 20:05:42.938679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:42.955264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c780-3669-471a-8687-b609b68cad51 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:42.972678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:42.973539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:42.973889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:42.974374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/roles/9be13674bd624caa87214b42628a6604` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:42.976519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9be13674bd624caa87214b42628a6604)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:42.978874 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:05:42.978874 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:05:42.978874 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:05:42.982362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:43.222606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:43.261339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invalidating the token cache because role 9be13674bd624caa87214b42628a6604 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:43.261974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.267528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.274573 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1806/3615] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:42 2022] DELETE /identity/v3/roles/9be13674bd624caa87214b42628a6604 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:43.278912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:43.304547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb203-4c01-4761-ad44-0891a0c7d0ba None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:43.331622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:43.334172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:43.447980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:43.449502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:43.449907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:43.450211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/b2a04c016253431db9a4219d17b1d3b9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:43.451477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b2a04c016253431db9a4219d17b1d3b9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:43.454470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:43.572823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e862fd-f356-4987-b9cb-a03f51ae8412 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:43.582060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:43.582698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:43.582975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:43.583265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:43.595630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:43.632808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:43.634467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:43.646343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a04c016253431db9a4219d17b1d3b9', 'request_id': 'req-51686d59-05ab-4f65-97e3-43949a2374b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.660727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a04c016253431db9a4219d17b1d3b9', 'request_id': 'req-51686d59-05ab-4f65-97e3-43949a2374b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.667870 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1807/3616] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:43.678101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a04c016253431db9a4219d17b1d3b9', 'request_id': 'req-51686d59-05ab-4f65-97e3-43949a2374b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.834494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] The token cache is being invalidate because project b2a04c016253431db9a4219d17b1d3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:43.835213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.837330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:43.841915 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1810/3617] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:43 2022] DELETE /identity/v3/projects/b2a04c016253431db9a4219d17b1d3b9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:43.849716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:43.851108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:43.876933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c44c-430d-427c-9442-0ed06d9ceab9 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:44.062203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:44.065756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:44.067918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:44.068665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/b2a04c016253431db9a4219d17b1d3b9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:44.122033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b2a04c016253431db9a4219d17b1d3b9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:44.124513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Could not find project: b2a04c016253431db9a4219d17b1d3b9.: keystone.exception.ProjectNotFound: Could not find project: b2a04c016253431db9a4219d17b1d3b9. Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 20:05:44.148093 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b2a04c016253431db9a4219d17b1d3b9. Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:44.155005 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1808/3618] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:43 2022] DELETE /identity/v3/projects/b2a04c016253431db9a4219d17b1d3b9 => generated 113 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:05:44.156868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:44.158441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:44.202578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51686d59-05ab-4f65-97e3-43949a2374b5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:44.232807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:44.236706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:44.238297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:44.238587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:44.238872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/projects/0cfe3fef77334127805e0573adf6c4f2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:44.245187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0cfe3fef77334127805e0573adf6c4f2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:44.248899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:44.480554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfe3fef77334127805e0573adf6c4f2', 'request_id': 'req-88211082-fd21-47ab-a5a8-afc627284612'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:44.495923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfe3fef77334127805e0573adf6c4f2', 'request_id': 'req-88211082-fd21-47ab-a5a8-afc627284612'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:44.507811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfe3fef77334127805e0573adf6c4f2', 'request_id': 'req-88211082-fd21-47ab-a5a8-afc627284612'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:44.683877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] The token cache is being invalidate because project 0cfe3fef77334127805e0573adf6c4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:44.684785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:44.685232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:44.687373 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1811/3619] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:44 2022] DELETE /identity/v3/projects/0cfe3fef77334127805e0573adf6c4f2 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:44.692221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:44.694690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:44.714549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e05c-b443-46ba-a91c-bb45b16f6a07 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:44.809488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:44.810523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:44.810972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:44.811391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/users/e2523d6a29274b9ca6b4da79947329fa` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:44.813512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e2523d6a29274b9ca6b4da79947329fa)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:44.815375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:45.129019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2523d6a29274b9ca6b4da79947329fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:45.129019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2523d6a29274b9ca6b4da79947329fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:45.289518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2523d6a29274b9ca6b4da79947329fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:45.307134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2523d6a29274b9ca6b4da79947329fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:45.308699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2523d6a29274b9ca6b4da79947329fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:45.339909 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1809/3620] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:44 2022] DELETE /identity/v3/users/e2523d6a29274b9ca6b4da79947329fa => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:45.342916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:45.356037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211082-fd21-47ab-a5a8-afc627284612 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:45.510464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:45.511820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:45.512284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:45.512732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/492441b05e9e475e803c4aefb36c0194` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:45.522174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Could not find domain: 492441b05e9e475e803c4aefb36c0194.: keystone.exception.DomainNotFound: Could not find domain: 492441b05e9e475e803c4aefb36c0194. Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 492441b05e9e475e803c4aefb36c0194. Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:45.533638 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:45.536076 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 492441b05e9e475e803c4aefb36c0194. Aug 28 20:05:45.538161 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:45.544602 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1812/3621] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:45 2022] PATCH /identity/v3/domains/492441b05e9e475e803c4aefb36c0194 => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:05:45.549534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:45.552316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:45.568583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a4b1-0739-4078-b1ac-aca7a85b2ec5 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:45.574086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:45.574744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:45.575071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:45.575309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/926165a894494ab4b26d4ef7616a1a83` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:45.583723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Could not find domain: 926165a894494ab4b26d4ef7616a1a83.: keystone.exception.DomainNotFound: Could not find domain: 926165a894494ab4b26d4ef7616a1a83. Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 926165a894494ab4b26d4ef7616a1a83. Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:45.590038 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:45.600714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 926165a894494ab4b26d4ef7616a1a83. Aug 28 20:05:45.601966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:45.603015 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1810/3622] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:45 2022] PATCH /identity/v3/domains/926165a894494ab4b26d4ef7616a1a83 => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:05:45.603168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:45.617580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250691ca-1cfd-4376-acec-9f8ec150cd1e tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:45.630326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:45.631149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:45.631544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:45.631905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/88bf00ae12b84c38956ba10dfb1f6976` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:45.641152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Could not find domain: 88bf00ae12b84c38956ba10dfb1f6976.: keystone.exception.DomainNotFound: Could not find domain: 88bf00ae12b84c38956ba10dfb1f6976. Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 88bf00ae12b84c38956ba10dfb1f6976. Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:45.647546 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:45.649027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 88bf00ae12b84c38956ba10dfb1f6976. Aug 28 20:05:45.650199 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:05:45.654976 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1813/3623] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:45 2022] PATCH /identity/v3/domains/88bf00ae12b84c38956ba10dfb1f6976 => generated 112 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 20:05:45.657112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:45.671587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82543-fc51-4aa9-809a-fbf12501d9cd tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:45.693342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411432db-06c0-4bbe-b264-f7b2801d9174 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc57ebe998447859999d22014729e65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd859dca861746c5b39eb85a4685e597', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:45.693342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411432db-06c0-4bbe-b264-f7b2801d9174 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:45.693342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411432db-06c0-4bbe-b264-f7b2801d9174 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:45.694711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411432db-06c0-4bbe-b264-f7b2801d9174 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] PATH_INFO: `/v3/domains/0e0fb1c598884d658a43d5c6896b713c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:45.707869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411432db-06c0-4bbe-b264-f7b2801d9174 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-411432db-06c0-4bbe-b264-f7b2801d9174 tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Could not find domain: 0e0fb1c598884d658a43d5c6896b713c.: keystone.exception.DomainNotFound: Could not find domain: 0e0fb1c598884d658a43d5c6896b713c. Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0e0fb1c598884d658a43d5c6896b713c. Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:05:45.718069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:05:45.720523 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0e0fb1c598884d658a43d5c6896b713c. Aug 28 20:05:45.722423 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:05:45.727859 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1811/3624] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:05:45 2022] PATCH /identity/v3/domains/0e0fb1c598884d658a43d5c6896b713c => generated 112 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:05:45.727954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:45.727954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:45.840637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758af1-d9ea-47d0-831c-2dede4eb6a1d tempest-TokensV3TestJSON-1913544743 tempest-TokensV3TestJSON-1913544743-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:45.853251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:45.853944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:45.854232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:45.854511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] PATH_INFO: `/v3/users/0d8b438c9ba248688c101a7db17625d8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:45.856018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8b438c9ba248688c101a7db17625d8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:45.861111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:46.560539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8b438c9ba248688c101a7db17625d8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:46.586062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8b438c9ba248688c101a7db17625d8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:46.597381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8b438c9ba248688c101a7db17625d8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:46.598199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8b438c9ba248688c101a7db17625d8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:46.598848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8b438c9ba248688c101a7db17625d8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:46.746514 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1814/3625] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:45 2022] DELETE /identity/v3/users/0d8b438c9ba248688c101a7db17625d8 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:46.755032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:46.758989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:46.759456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:46.811101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:46.813686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:46.944646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1812/3626] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:46.957146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:46.958970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:47.033367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2e4f-c0a7-4aba-9117-7fcedf006339 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:47.037415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:47.038039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:47.038349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:47.038620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:47.050294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:47.052035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:47.063381 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1815/3627] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:47.925468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:47.927186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:47.945680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28594382-f78f-4f39-a3a4-2ebbbc5ccf03 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:47.957121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:47.957768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:47.960867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:47.975003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] PATH_INFO: `/v3/projects/5cfe182c67b644c38383f1454c67dd03` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:47.976837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfe182c67b644c38383f1454c67dd03)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:47.979352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:48.161681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfe182c67b644c38383f1454c67dd03', 'request_id': 'req-7c7402d7-5b1d-493f-b213-5c1cab855ab1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.177151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfe182c67b644c38383f1454c67dd03', 'request_id': 'req-7c7402d7-5b1d-493f-b213-5c1cab855ab1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.189017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfe182c67b644c38383f1454c67dd03', 'request_id': 'req-7c7402d7-5b1d-493f-b213-5c1cab855ab1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.445628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] The token cache is being invalidate because project 5cfe182c67b644c38383f1454c67dd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:48.445937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.446575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.448219 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1813/3628] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:47 2022] DELETE /identity/v3/projects/5cfe182c67b644c38383f1454c67dd03 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:48.452715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:48.465415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e1998-3203-4667-a6b0-020046f506bb service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:48.541877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:48.542549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:48.543487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:48.543814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] PATH_INFO: `/v3/users/6dc57ebe998447859999d22014729e65` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:48.545155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc57ebe998447859999d22014729e65)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:48.547168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:48.933156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc57ebe998447859999d22014729e65'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.951011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc57ebe998447859999d22014729e65'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.974642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc57ebe998447859999d22014729e65'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.975694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc57ebe998447859999d22014729e65'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:48.976693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc57ebe998447859999d22014729e65'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:49.122571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:49.129132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1816/3629] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:48 2022] DELETE /identity/v3/users/6dc57ebe998447859999d22014729e65 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:50.003936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:50.005454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:50.061409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7402d7-5b1d-493f-b213-5c1cab855ab1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:50.090060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:50.091493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:50.192242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:50.192841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:50.193298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:50.193577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] PATH_INFO: `/v3/projects/cd859dca861746c5b39eb85a4685e597` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:50.194892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd859dca861746c5b39eb85a4685e597)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:50.197921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:50.235836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af9a4b-0f73-4a24-a0af-a80d6e21d8a7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:50.241956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:50.242664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:50.242947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:50.243234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] PATH_INFO: `/v3/users/a79d4f7fcf5a497d80ae244da048f83a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:50.244589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79d4f7fcf5a497d80ae244da048f83a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:50.246788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:50.534901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:50.564425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd859dca861746c5b39eb85a4685e597', 'request_id': 'req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:50.571967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd859dca861746c5b39eb85a4685e597', 'request_id': 'req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:50.582286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd859dca861746c5b39eb85a4685e597', 'request_id': 'req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:50.930872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] The token cache is being invalidate because project cd859dca861746c5b39eb85a4685e597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:50.932793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:50.934021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:50.939792 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1814/3630] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:50 2022] DELETE /identity/v3/projects/cd859dca861746c5b39eb85a4685e597 => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:50.942345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79d4f7fcf5a497d80ae244da048f83a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:50.970413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:50.972738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:50.989045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79d4f7fcf5a497d80ae244da048f83a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.001366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79d4f7fcf5a497d80ae244da048f83a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.002781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79d4f7fcf5a497d80ae244da048f83a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.003916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ecb4ec36-a80c-474c-8738-5c2cb713d0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79d4f7fcf5a497d80ae244da048f83a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.122510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ed19-2017-46b2-ad03-2a4fbc4c1e72 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:51.132697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:51.133815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:51.134354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:51.135007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] PATH_INFO: `/v3/users/110f1e5c260548ea907225b15c39644f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:51.136704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110f1e5c260548ea907225b15c39644f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:51.140701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:51.534827 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1817/3631] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:50 2022] DELETE /identity/v3/users/a79d4f7fcf5a497d80ae244da048f83a => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:51.539456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:51.539984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:51.540270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:51.566351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:51.566351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:51.650079 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1818/3632] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:51.658125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.660064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:51.660188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.663958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:51.745217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.756127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.756886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110f1e5c260548ea907225b15c39644f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:51.789340 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1815/3633] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:50 2022] DELETE /identity/v3/users/110f1e5c260548ea907225b15c39644f => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:51.815967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937d1a7-012b-43ca-a7e5-43bc1f7b94fa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:51.891019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:51.891630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:51.891911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:51.892271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:51.894092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:51.974760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:51.976263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:51.988837 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1819/3634] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:05:52.687069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:52.692511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:52.711203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915164d1-2097-4e82-86e8-e24093b94755 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:52.718075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:52.720398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:52.720692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:52.721000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] PATH_INFO: `/v3/projects/7cc12c8c7ec9426ead3beb11c7cc0e10` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:52.723059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc12c8c7ec9426ead3beb11c7cc0e10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:52.725617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:53.010203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:53.011999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:53.032284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de457-77f5-459e-976b-169f72c88e02 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:53.055506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc12c8c7ec9426ead3beb11c7cc0e10', 'request_id': 'req-0600739f-ef95-4551-81ab-a4b30e5c1e1a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.064560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc12c8c7ec9426ead3beb11c7cc0e10', 'request_id': 'req-0600739f-ef95-4551-81ab-a4b30e5c1e1a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.073791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc12c8c7ec9426ead3beb11c7cc0e10', 'request_id': 'req-0600739f-ef95-4551-81ab-a4b30e5c1e1a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.154154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:53.155082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.155623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.157190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] PATH_INFO: `/v3/projects/7996b61ca579418b9a690269e4ef9554` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.158869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7996b61ca579418b9a690269e4ef9554)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:53.161735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:53.233533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] The token cache is being invalidate because project 7cc12c8c7ec9426ead3beb11c7cc0e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:53.234509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.238496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0600739f-ef95-4551-81ab-a4b30e5c1e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.238496 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1816/3635] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:52 2022] DELETE /identity/v3/projects/7cc12c8c7ec9426ead3beb11c7cc0e10 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:53.244374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e920d1a-dcdf-4744-9050-0d3f7e56a00e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.246384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e920d1a-dcdf-4744-9050-0d3f7e56a00e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.247929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e920d1a-dcdf-4744-9050-0d3f7e56a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.294568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e920d1a-dcdf-4744-9050-0d3f7e56a00e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:53.301342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e920d1a-dcdf-4744-9050-0d3f7e56a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:53.306819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1817/3636] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:05:53.317125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04518efc-5197-4718-9777-133107868d63 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.317689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04518efc-5197-4718-9777-133107868d63 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.318014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04518efc-5197-4718-9777-133107868d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.342044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-04518efc-5197-4718-9777-133107868d63 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:53.343932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-04518efc-5197-4718-9777-133107868d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:53.361676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1818/3637] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:05:53.366004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04518efc-5197-4718-9777-133107868d63 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:53.376205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04518efc-5197-4718-9777-133107868d63 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:53.382104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:53.382104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.382104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.382483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.382846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:05:53.383168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:53.384844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:53.406922 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1819/3638] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:53.412026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:53.425904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb90ac-fc6b-444b-9e58-c2396e54b78f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:53.431308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:53.431939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.432557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.432557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.433117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:53.435036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:53.456920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7996b61ca579418b9a690269e4ef9554', 'request_id': 'req-330232dd-62bd-440d-a296-45ec13c1bd54'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.464585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7996b61ca579418b9a690269e4ef9554', 'request_id': 'req-330232dd-62bd-440d-a296-45ec13c1bd54'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.485539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7996b61ca579418b9a690269e4ef9554', 'request_id': 'req-330232dd-62bd-440d-a296-45ec13c1bd54'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.613664 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1820/3639] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:53 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:53.615217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:53.657666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] The token cache is being invalidate because project 7996b61ca579418b9a690269e4ef9554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:53.658544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.659484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:53.662742 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1820/3640] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:53 2022] DELETE /identity/v3/projects/7996b61ca579418b9a690269e4ef9554 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:53.666098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:53.668210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:53.713678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643948be-ebf2-42b6-a3f4-10487359fbdc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:53.722459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:53.723229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.723627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.724006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.724759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:53.726907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:53.786177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330232dd-62bd-440d-a296-45ec13c1bd54 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:53.791194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:53.791844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:53.792128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:53.792408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] PATH_INFO: `/v3/users/cbe1d6cd96054fbeb6bbf73ad0ad0eb2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:53.793685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe1d6cd96054fbeb6bbf73ad0ad0eb2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:53.795772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:55.086672 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1821/3641] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:53 2022] POST /identity/v3/users => generated 297 bytes in 1472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:55.091556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:55.093973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:55.106835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a1f94-4832-42dc-a70b-7d60b4b02555 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:55.112594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:55.113654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.113654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.113931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.115087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:55.116279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:55.128531 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1822/3642] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:05:55.133184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:55.144757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1111-87fe-4be9-a9f7-ca0a21a48b77 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:55.157157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:55.158158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.158653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.158921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.159765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:55.161947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:55.179414 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1823/3643] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:05:55.180136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:55.193671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fea2d9-026c-4773-9fb5-7dcaaf8841a5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:55.202087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48fc52-f800-43c4-9532-6e2bc3c1b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:55.203740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48fc52-f800-43c4-9532-6e2bc3c1b738 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.204413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48fc52-f800-43c4-9532-6e2bc3c1b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.205097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48fc52-f800-43c4-9532-6e2bc3c1b738 admin admin] PATH_INFO: `/v3/projects/46690e0db31943ca8f910b5efe0e4ca1/users/bb95d70071c74abb80d589b437890a10/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.232179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48fc52-f800-43c4-9532-6e2bc3c1b738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46690e0db31943ca8f910b5efe0e4ca1, user_id=bb95d70071c74abb80d589b437890a10, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:55.236307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48fc52-f800-43c4-9532-6e2bc3c1b738 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:55.323408 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1824/3644] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:55 2022] PUT /identity/v3/projects/46690e0db31943ca8f910b5efe0e4ca1/users/bb95d70071c74abb80d589b437890a10/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:55.336957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.337660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.337660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.354408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe1d6cd96054fbeb6bbf73ad0ad0eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:55.373474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe1d6cd96054fbeb6bbf73ad0ad0eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:55.384471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] MFA Rules not processed for user `bb95d70071c74abb80d589b437890a10`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:55.385954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:55.388458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe1d6cd96054fbeb6bbf73ad0ad0eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:55.389211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe1d6cd96054fbeb6bbf73ad0ad0eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:55.391001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe1d6cd96054fbeb6bbf73ad0ad0eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:55.490477 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1825/3645] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:55.495659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:55.506581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f73e6-207e-492c-a3e9-3c5a3726b3f9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:55.511058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8da34-6f54-49a0-b99d-9b76fd324bc2 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:55.511879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8da34-6f54-49a0-b99d-9b76fd324bc2 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.512165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8da34-6f54-49a0-b99d-9b76fd324bc2 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.512619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8da34-6f54-49a0-b99d-9b76fd324bc2 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.513296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8da34-6f54-49a0-b99d-9b76fd324bc2 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:55.514661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8da34-6f54-49a0-b99d-9b76fd324bc2 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:55.599789 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1821/3646] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:05:53 2022] DELETE /identity/v3/users/cbe1d6cd96054fbeb6bbf73ad0ad0eb2 => generated 0 bytes in 1934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:05:55.792473 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1826/3647] 10.222.0.78 () {60 vars in 1314 bytes} [Sun Aug 28 20:05:55 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 789 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:55.797028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:55.871585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689fb54-9161-40aa-8b16-e2698ee516f4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:55.877719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:55.878431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.878709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.879088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/98305f6145ef492c84d755cad75d8562` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.896563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:get_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=98305f6145ef492c84d755cad75d8562)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:55.898381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:55.901181 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1822/3648] 10.222.0.78 () {58 vars in 1392 bytes} [Sun Aug 28 20:05:55 2022] GET /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/98305f6145ef492c84d755cad75d8562 => generated 689 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:55.905766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:55.906089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:55.906373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:55.931742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] MFA Rules not processed for user `bb95d70071c74abb80d589b437890a10`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:55.933091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:56.172282 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1827/3649] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:55 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 20:05:56.176341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:56.190360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41564e-ae78-4669-a12c-9be93b28c252 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:56.197329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:56.198196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:56.198579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:56.199161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/98305f6145ef492c84d755cad75d8562` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:56.201206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=98305f6145ef492c84d755cad75d8562)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:56.203262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:56.310948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:56.460354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1823/3650] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:05:56 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/98305f6145ef492c84d755cad75d8562 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:56.466295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:56.473812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:56.481067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:56.491375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6cc0d-ddd9-49f7-89bc-b9df95a23809 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:56.510943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:56.514822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:56.515148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:56.516235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:56.516950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:56.518449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:56.648714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc01a8-6839-4060-8156-3d3f8f89eda0 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:56.665988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:56.666648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:56.666940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:56.667203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] PATH_INFO: `/v3/projects/99b2c649562341168ace7bb5286939e6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:56.668836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b2c649562341168ace7bb5286939e6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:56.670797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:56.923627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1828/3651] 10.222.0.78 () {60 vars in 1315 bytes} [Sun Aug 28 20:05:56 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 921 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:56.927928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:56.940900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef84c39-3cf7-475a-9dd3-bef44a6bc9fd tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:56.946991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:56.947972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:56.948391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:56.948587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/3b232daa58214d1380363483b0403423` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:56.964042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=3b232daa58214d1380363483b0403423)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:56.967440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:57.043008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b2c649562341168ace7bb5286939e6', 'request_id': 'req-696cfdc5-f10e-451b-9c75-4ade9ce81efe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:57.064975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b2c649562341168ace7bb5286939e6', 'request_id': 'req-696cfdc5-f10e-451b-9c75-4ade9ce81efe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:57.073091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b2c649562341168ace7bb5286939e6', 'request_id': 'req-696cfdc5-f10e-451b-9c75-4ade9ce81efe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:57.221086 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1829/3652] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:05:56 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/3b232daa58214d1380363483b0403423 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:57.223064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:57.238862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429af9-4a67-4f3a-86b7-ef7d34ac912d tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:57.259863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] The token cache is being invalidate because project 99b2c649562341168ace7bb5286939e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:05:57.260503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:57.261714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-696cfdc5-f10e-451b-9c75-4ade9ce81efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:05:57.263939 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1824/3653] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:05:56 2022] DELETE /identity/v3/projects/99b2c649562341168ace7bb5286939e6 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:57.272121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fbd5e-ccd0-4682-9559-96607745c700 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:57.272867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fbd5e-ccd0-4682-9559-96607745c700 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:57.274092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fbd5e-ccd0-4682-9559-96607745c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:57.338218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2c4fbd5e-ccd0-4682-9559-96607745c700 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:57.340381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2c4fbd5e-ccd0-4682-9559-96607745c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:57.351565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:57.372844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:57.373502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:57.373785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:57.374102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:57.375380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:57.376563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:57.500715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1825/3654] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:57.515532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:57.515532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:57.515532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:57.562929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:57.564841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:57.581060 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1826/3655] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:57.582237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:57.596712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf33455-3936-47f8-9b43-ff5f2a44a98d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:57.602852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:57.603380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:57.603661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:57.603938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:57.604597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:05:57.604970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:57.606634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:57.623896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1827/3656] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:05:57.629010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:57.646504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836ef3-0fa0-4054-9602-6d11b2172fbd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:57.652270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:57.653021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:57.654217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:57.654217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:57.664455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:57.664455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:57.678455 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1830/3657] 10.222.0.78 () {60 vars in 1315 bytes} [Sun Aug 28 20:05:57 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 812 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:57.681222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:57.683357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:57.698473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43bf16-cf19-4b7a-ba1b-5fedd4afe8ff tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:57.703164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:57.710047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:57.710047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:57.710047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/ae19b5a6d6504297a6189ed19983eafc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:57.717443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=ae19b5a6d6504297a6189ed19983eafc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:57.719065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:57.911717 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1828/3658] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:57 2022] POST /identity/v3/projects => generated 403 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:57.917028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:57.977406 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1831/3659] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:05:57 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/ae19b5a6d6504297a6189ed19983eafc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:57.983142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:57.998578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed000a-b2c6-45e8-9106-0135303ce7ed tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.088527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fdedb-3718-4b9b-b3d0-832b6167cb3a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.098568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.099441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.100019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.101446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.102366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.115109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.173247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.173937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.174230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.174516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.175191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.176495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.242643 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1829/3660] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:57 2022] POST /identity/v3/users => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:58.244348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.269164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f746a22-ebdc-48dd-84d7-7d73b0a9d0da admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.278765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.279522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.279988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.284011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.284011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.284011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.306738 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1830/3661] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:05:58.306738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.318071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69314e-40d8-4c9d-b998-2247ec704acd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.325549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.326252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.326536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.326813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.328069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.330376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.354604 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1831/3662] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:58.355601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.369725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27221c23-ff88-44d3-afca-0bd6c8c73686 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.379506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7f0e8-dd53-4adf-95ea-2af9c6f56610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.379506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f0e8-dd53-4adf-95ea-2af9c6f56610 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.379506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f0e8-dd53-4adf-95ea-2af9c6f56610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.379506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f0e8-dd53-4adf-95ea-2af9c6f56610 admin admin] PATH_INFO: `/v3/projects/2b071d4c32714b619f4c8e4b64a81de9/users/442c19be53874c58b1c986e89eabe2e7/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.399329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7f0e8-dd53-4adf-95ea-2af9c6f56610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b071d4c32714b619f4c8e4b64a81de9, user_id=442c19be53874c58b1c986e89eabe2e7, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.402248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7f0e8-dd53-4adf-95ea-2af9c6f56610 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.418317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1832/3663] 10.222.0.78 () {60 vars in 1314 bytes} [Sun Aug 28 20:05:57 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 789 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:58.419896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.434710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2604-d4f1-4128-9d02-21fcfb7d9e15 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.442304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.443367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.443923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.444409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.445311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.447044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.570131 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1832/3664] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:58 2022] PUT /identity/v3/projects/2b071d4c32714b619f4c8e4b64a81de9/users/442c19be53874c58b1c986e89eabe2e7/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:58.581676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.582156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.582263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.630453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] MFA Rules not processed for user `442c19be53874c58b1c986e89eabe2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:58.634953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:58.704884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1833/3665] 10.222.0.78 () {60 vars in 1314 bytes} [Sun Aug 28 20:05:58 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 789 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:58.706927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.737598 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1833/3666] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:05:58.740940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.747691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886bf59-8bea-44a3-a330-53a9ef7ba146 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.888661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.890342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.890857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.891484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.892274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.894569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:58.917622 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1834/3667] 10.222.0.78 () {58 vars in 1293 bytes} [Sun Aug 28 20:05:58 2022] GET /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:05:58.931715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:58.954825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e85e1e-7bdf-4448-a086-b84163199dcf tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.966711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:58.967151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:58.967581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:58.968398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/8118a0da945843cbb046fa26f5b35cb8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:58.975512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacb8c9-f9ef-4368-9448-8e8a0004002c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:58.985553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=8118a0da945843cbb046fa26f5b35cb8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:58.988801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:59.014381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:59.017956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:59.019960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:59.020738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:59.025092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:59.033316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:59.184331 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1835/3668] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:05:58 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/8118a0da945843cbb046fa26f5b35cb8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:59.189238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:59.205468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893af1-8060-45df-bc6a-553f246a5325 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:59.219298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:59.221115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:59.221933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:59.222716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/d3519afa2f6b4913920a92e1dcfd3371` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:59.255492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=d3519afa2f6b4913920a92e1dcfd3371)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:59.261844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:59.271772 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1834/3669] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:05:58 2022] POST /identity/v3/projects => generated 403 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:05:59.277564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:59.448551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b064c1-0fca-4345-a721-d9c36775a379 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:59.465244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:59.466418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:59.467015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:59.467607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:59.469553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:59.473540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:59.636962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1836/3670] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:05:59 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/d3519afa2f6b4913920a92e1dcfd3371 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:05:59.642972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:59.660946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c14d6-fbea-4014-9450-3d311c313985 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:59.776193 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1835/3671] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:05:59 2022] POST /identity/v3/users => generated 308 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:05:59.777433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:59.781762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:59.782712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:59.783104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:59.783396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:59.784498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:59.785797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:59.789175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259e73-e8a8-4130-b1fb-12ad595fb2b7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:59.794591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:59.795304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:59.795662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:59.796052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:59.797301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:59.799091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:59.811966 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1836/3672] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:05:59.832448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:59.846443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6def2f-938b-4155-9b8c-0db90bb9c94e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:59.854640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:59.855452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:59.856391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:59.857305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] PATH_INFO: `/v3/projects/ea4b400b45a54defa26c4d57488ed797/users/9f716f2c92ce48e59dc3c49dcda26ecb/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:59.877369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4b400b45a54defa26c4d57488ed797, user_id=9f716f2c92ce48e59dc3c49dcda26ecb, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:59.880642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.097259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1837/3673] 10.222.0.78 () {60 vars in 1314 bytes} [Sun Aug 28 20:05:59 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 789 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:00.101145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.124319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b137-cf04-44bb-b7f6-5bb576651c8e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.134564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.135242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.135526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.135802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.141929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:create_application_credential(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:00.143426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.170644 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1837/3674] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:05:59 2022] PUT /identity/v3/projects/ea4b400b45a54defa26c4d57488ed797/users/9f716f2c92ce48e59dc3c49dcda26ecb/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:00.175351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.385949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1bee-098a-4f08-a811-c1468b87cb35 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.392754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.393984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.394464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.395000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.396258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:00.401071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.441773 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1838/3675] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:00.441773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.459578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8113f5b-6597-4f0a-9667-b5a33bc6559f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.467671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc205-35e8-4c5c-b938-8c07c20b8e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.469380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc205-35e8-4c5c-b938-8c07c20b8e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.469380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc205-35e8-4c5c-b938-8c07c20b8e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.469564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc205-35e8-4c5c-b938-8c07c20b8e18 admin admin] PATH_INFO: `/v3/projects/ea4b400b45a54defa26c4d57488ed797/users/9f716f2c92ce48e59dc3c49dcda26ecb/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.476654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc205-35e8-4c5c-b938-8c07c20b8e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4b400b45a54defa26c4d57488ed797, user_id=9f716f2c92ce48e59dc3c49dcda26ecb, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:00.479384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc205-35e8-4c5c-b938-8c07c20b8e18 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.493272 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1838/3676] 10.222.0.78 () {60 vars in 1314 bytes} [Sun Aug 28 20:06:00 2022] POST /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials => generated 788 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:00.499718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.509562 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1839/3677] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:00 2022] PUT /identity/v3/projects/ea4b400b45a54defa26c4d57488ed797/users/9f716f2c92ce48e59dc3c49dcda26ecb/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:00.517555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d35cf-23f2-4392-be89-9a847c866e4e tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.521819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.522139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.522415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.617733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] MFA Rules not processed for user `9f716f2c92ce48e59dc3c49dcda26ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:00.617733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:00.617950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.617950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.617950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.618174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.618174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Adding query filter params (name=tempest-application_credential-915137806) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:00.618174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:00.618174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.630939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1839/3678] 10.222.0.78 () {58 vars in 1384 bytes} [Sun Aug 28 20:06:00 2022] GET /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials?name=tempest-application_credential-915137806 => generated 885 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:00.630939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.631774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:00.706984 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1840/3679] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:00.706984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.720400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216774a8-dd31-4bb2-8233-348aaecc6753 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.724985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.725827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.726213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.726788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/cdae7eaa721c4f43b634bdbe78d07ab6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.737697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=cdae7eaa721c4f43b634bdbe78d07ab6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:00.739675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.746475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb5428-6a0a-40f0-9072-98e0018d738f tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.757770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.759467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.760181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.762102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:00.766474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:00.788312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:00.789932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:00.821126 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1840/3680] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:00.821126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.821126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:00.960527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435af820-948e-4e8f-a338-5d82e504a73e service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:00.981284 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1841/3681] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:06:00 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/cdae7eaa721c4f43b634bdbe78d07ab6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:00.982533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:00.984338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:00.985558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:00.986206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:00.986842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:01.002181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000b6a-9d26-46fa-9e54-f2f5be901044 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:01.004333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:01.008093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:01.008305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb95d70071c74abb80d589b437890a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46690e0db31943ca8f910b5efe0e4ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:01.008773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:01.009062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:01.009339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/b251cae9276f45bfbdca6785a69500c7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:01.027150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bb95d70071c74abb80d589b437890a10, application_credential_id=b251cae9276f45bfbdca6785a69500c7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:01.035995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:01.043807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1841/3682] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:01.091583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:01.094620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:01.199248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1842/3683] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:06:00 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10/application_credentials/b251cae9276f45bfbdca6785a69500c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:01.205938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:01.210890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:01.330491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4170-3b1b-4963-9bcb-f330f5fb392a service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:01.380567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:01.380567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:01.380567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:01.380567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] PATH_INFO: `/v3/users/be98774a590b47cbaa5cd2516a4cc399` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:01.382805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be98774a590b47cbaa5cd2516a4cc399)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:01.388709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:01.481062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9e506-bac2-41d3-ba84-4d9d9219b483 tempest-ApplicationCredentialsV3Test-1517778628 tempest-ApplicationCredentialsV3Test-1517778628-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:01.495192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:01.495524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:01.495805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:01.496135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] PATH_INFO: `/v3/users/bb95d70071c74abb80d589b437890a10` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:01.499475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb95d70071c74abb80d589b437890a10)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:01.502868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:01.694960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:01.838836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be98774a590b47cbaa5cd2516a4cc399'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:01.841604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be98774a590b47cbaa5cd2516a4cc399'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:01.966216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb95d70071c74abb80d589b437890a10'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:01.972767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be98774a590b47cbaa5cd2516a4cc399'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:01.985235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be98774a590b47cbaa5cd2516a4cc399'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:01.986195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be98774a590b47cbaa5cd2516a4cc399'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:02.030396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1842/3684] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:01 2022] DELETE /identity/v3/users/be98774a590b47cbaa5cd2516a4cc399 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:02.031831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:02.033635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:02.139048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb95d70071c74abb80d589b437890a10'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:02.155419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb95d70071c74abb80d589b437890a10'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:02.157672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb95d70071c74abb80d589b437890a10'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:02.159119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-138f1077-8ef6-479e-a7a5-8ed087dcb759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb95d70071c74abb80d589b437890a10'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:02.198210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe7b6-a4f6-417c-aef5-e0c25fd7e022 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:02.204987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:02.205763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:02.206149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:02.206490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:02.208457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:02.281768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:02.283894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:02.299503 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1843/3685] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:02 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:02.326557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:02.328362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:02.344059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1843/3686] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:01 2022] DELETE /identity/v3/users/bb95d70071c74abb80d589b437890a10 => generated 0 bytes in 1138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:02.347877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:02.349241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:02.349778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:02.387690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:02.389143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:02.441399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c17ac-a791-4c6d-b6c2-65218589137f service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:02.492251 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1844/3687] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:02.504214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:02.510213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:02.527282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:02.528116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:02.528406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:02.528696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] PATH_INFO: `/v3/users/442c19be53874c58b1c986e89eabe2e7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:02.529929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=442c19be53874c58b1c986e89eabe2e7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:02.532506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:02.614907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90557f-9ced-4398-a258-88f2678c88ff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:02.621137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:02.622129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:02.622627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:02.623067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:02.660531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:02.662311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:02.678103 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1845/3688] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:02.680323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:02.692571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:02.723585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b8cb-e1cb-49a2-9fcb-88aa68c3ecef service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:02.735322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:02.736058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:02.736352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:02.736793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] PATH_INFO: `/v3/projects/e6fa4bad47cf497eb6a3daa9e369767d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:02.738238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fa4bad47cf497eb6a3daa9e369767d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:02.740531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:02.767860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:03.109502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442c19be53874c58b1c986e89eabe2e7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.110348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442c19be53874c58b1c986e89eabe2e7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.123593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fa4bad47cf497eb6a3daa9e369767d', 'request_id': 'req-d747b68c-942b-40ad-a85d-5443470cc219'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.132248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fa4bad47cf497eb6a3daa9e369767d', 'request_id': 'req-d747b68c-942b-40ad-a85d-5443470cc219'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.144600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fa4bad47cf497eb6a3daa9e369767d', 'request_id': 'req-d747b68c-942b-40ad-a85d-5443470cc219'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.298949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442c19be53874c58b1c986e89eabe2e7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.310015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442c19be53874c58b1c986e89eabe2e7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.312031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5db68f57-6b44-4888-a21c-dc0f6eebb2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442c19be53874c58b1c986e89eabe2e7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.333872 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1844/3689] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:02 2022] DELETE /identity/v3/users/442c19be53874c58b1c986e89eabe2e7 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:03.338698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.338991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.339391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.360959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:03.362251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:03.429275 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1845/3690] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:03.440873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:03.442557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:03.506900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] The token cache is being invalidate because project e6fa4bad47cf497eb6a3daa9e369767d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:03.507150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.510987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:03.522144 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1846/3691] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:02 2022] DELETE /identity/v3/projects/e6fa4bad47cf497eb6a3daa9e369767d => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:03.529730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:03.535059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:03.539434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca615a8-fae2-4762-adbd-3ddaca33509c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:03.544561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:03.545355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.545765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.546241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.548666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:03.566452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:03.568672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5310f-fdf6-41fe-a2a5-9a15e7cc2b32 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:03.582258 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1846/3692] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:03.583813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d9c60-f9bc-4c52-a4e2-050f52dc97b2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.584285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d9c60-f9bc-4c52-a4e2-050f52dc97b2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.584631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d9c60-f9bc-4c52-a4e2-050f52dc97b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.608038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-138d9c60-f9bc-4c52-a4e2-050f52dc97b2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:03.610431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-138d9c60-f9bc-4c52-a4e2-050f52dc97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:03.627392 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1847/3693] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:03.642339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.643164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.643678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.672582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:03.674991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b68c-942b-40ad-a85d-5443470cc219 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:03.676151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:03.694402 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1848/3694] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:03.694598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:03.695335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.695473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.695649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] PATH_INFO: `/v3/projects/46690e0db31943ca8f910b5efe0e4ca1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.697116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:03.698460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46690e0db31943ca8f910b5efe0e4ca1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:03.700674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:03.719470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43cc4-ef25-4893-8190-71a7818a1e3e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:03.720487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:03.721873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.722421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.723010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.724579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:03.726328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:03.728623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:03.746061 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1849/3695] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:03.771715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:03.788812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41978d1-b0fd-472e-8c04-f8c24c0f1285 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:03.795153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:03.805309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:03.805309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:03.805309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:03.805309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:03.805309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.077732 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1850/3696] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:03 2022] POST /identity/v3/projects => generated 373 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:04.079566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.105285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46690e0db31943ca8f910b5efe0e4ca1', 'request_id': 'req-1b601479-9c1a-4fe3-bf90-889c93cd0751'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:04.124301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46690e0db31943ca8f910b5efe0e4ca1', 'request_id': 'req-1b601479-9c1a-4fe3-bf90-889c93cd0751'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:04.138442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46690e0db31943ca8f910b5efe0e4ca1', 'request_id': 'req-1b601479-9c1a-4fe3-bf90-889c93cd0751'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:04.198110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6e58-f783-4788-b3cf-9d2f38067c70 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.206434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.213398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.213398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.213398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.213398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.213398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.318254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] The token cache is being invalidate because project 46690e0db31943ca8f910b5efe0e4ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:04.324516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:04.324516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b601479-9c1a-4fe3-bf90-889c93cd0751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:04.324516 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1847/3697] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:03 2022] DELETE /identity/v3/projects/46690e0db31943ca8f910b5efe0e4ca1 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:04.328519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13309c0-a23f-4693-b83c-252e199ef73d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.328953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13309c0-a23f-4693-b83c-252e199ef73d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.329326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13309c0-a23f-4693-b83c-252e199ef73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.355622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d13309c0-a23f-4693-b83c-252e199ef73d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:04.357013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d13309c0-a23f-4693-b83c-252e199ef73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:04.373924 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1848/3698] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:04.375659 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1851/3699] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:04 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:04.378100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.378578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.379036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.380264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.382575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:04.397615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae262754-2bef-4335-b0bf-609322f68e52 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.402922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:04.403402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.404262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.404653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.404893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:04.405130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.406616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.408363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.423822 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1852/3700] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:04.424960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1849/3701] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:04.428341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.428569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.441477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ce4ad-ee8f-4ba9-b3ba-c75878f8f315 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.444314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afd585-e323-4387-a13a-eb38ee502503 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.454590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.455220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.455580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.456518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.457136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.457410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.457678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.458366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:04.458670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.460564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.462331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.463218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.464986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.482051 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1850/3702] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:06:04.484029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1853/3703] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:06:04.486051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.494746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.498496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9e5ba-e37f-4f89-a76d-d4f7ca61e6b3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.504716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.505731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.506164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.506353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] PATH_INFO: `/v3/projects/a159c1a1434347748a4b836d3e5f0efe/users/4c0e404e10ed4d7eaf2b8825b444d1f2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.510024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4490-a458-41da-ba6c-b6802eb73da3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.516705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5134c-ceff-494f-a1ee-2d0aab60ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.517745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5134c-ceff-494f-a1ee-2d0aab60ec84 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.518243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5134c-ceff-494f-a1ee-2d0aab60ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.518715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5134c-ceff-494f-a1ee-2d0aab60ec84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.519614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5134c-ceff-494f-a1ee-2d0aab60ec84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.522513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5134c-ceff-494f-a1ee-2d0aab60ec84 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.526390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a159c1a1434347748a4b836d3e5f0efe, user_id=4c0e404e10ed4d7eaf2b8825b444d1f2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.529142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.694632 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1851/3704] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:04 2022] PUT /identity/v3/projects/a159c1a1434347748a4b836d3e5f0efe/users/4c0e404e10ed4d7eaf2b8825b444d1f2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:04.695485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.697263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:04.766622 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1854/3705] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:04 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:04.768136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.768433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.768766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.781570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbceb2-3b01-4c10-8c45-0ae06c48ea87 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.803270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:04.806205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:04.885435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.886260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.886546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.886824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] PATH_INFO: `/v3/projects/2b071d4c32714b619f4c8e4b64a81de9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.888060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b071d4c32714b619f4c8e4b64a81de9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.890015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:04.905092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1855/3706] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:04.907719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:04.924833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed11ad0-b88e-4ed7-96b5-5ca018358a55 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:04.930666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:04.931517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:04.931769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:04.932093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:04.932771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:04.934884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.088199 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1856/3707] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:04 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:05.089374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.091219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:05.115605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b071d4c32714b619f4c8e4b64a81de9', 'request_id': 'req-722b85e6-f50c-4e7c-807d-6c1b764a697e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.127452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b071d4c32714b619f4c8e4b64a81de9', 'request_id': 'req-722b85e6-f50c-4e7c-807d-6c1b764a697e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.135686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b071d4c32714b619f4c8e4b64a81de9', 'request_id': 'req-722b85e6-f50c-4e7c-807d-6c1b764a697e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.169318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea15f3d-e204-42d3-841e-91e14b2afdb8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.222452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.223179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.223368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.223666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.265045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] The token cache is being invalidate because project 2b071d4c32714b619f4c8e4b64a81de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:05.265327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.266044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.267577 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1852/3708] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:04 2022] DELETE /identity/v3/projects/2b071d4c32714b619f4c8e4b64a81de9 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:05.268399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.269786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:05.292975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.294457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.306871 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1857/3709] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:05.307574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.319166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f797d-eafb-4f09-80d9-8ea409e89c9f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.324527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.325392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.325550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.325821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] PATH_INFO: `/v3/users/9f716f2c92ce48e59dc3c49dcda26ecb` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.327205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f716f2c92ce48e59dc3c49dcda26ecb)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.329167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.382914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b85e6-f50c-4e7c-807d-6c1b764a697e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.390928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.391869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.392292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.392756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.393733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.396506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.418282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1853/3710] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:05.424534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.436297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f656-439f-407c-9c5a-dd328e465396 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.452427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.453089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.453340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.453625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.454320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.456052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.469316 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1854/3711] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:05.475242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.488548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14b98f-765e-461e-87a5-e135b61a4efb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.493526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8c6d-d6bb-4a56-9548-eb7776bcf5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.494220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8c6d-d6bb-4a56-9548-eb7776bcf5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.494507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8c6d-d6bb-4a56-9548-eb7776bcf5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.494792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8c6d-d6bb-4a56-9548-eb7776bcf5b3 admin admin] PATH_INFO: `/v3/projects/ccd9af11cbf04752b6a76db56cf446e0/users/59e26a1638dd4e85961393317eb8ab7a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.512521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c8c6d-d6bb-4a56-9548-eb7776bcf5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd9af11cbf04752b6a76db56cf446e0, user_id=59e26a1638dd4e85961393317eb8ab7a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.515364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c8c6d-d6bb-4a56-9548-eb7776bcf5b3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.579258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:05.647658 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1855/3712] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:05 2022] PUT /identity/v3/projects/ccd9af11cbf04752b6a76db56cf446e0/users/59e26a1638dd4e85961393317eb8ab7a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:05.659502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.659819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.660084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.692696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] MFA Rules not processed for user `59e26a1638dd4e85961393317eb8ab7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:05.700982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:05.762430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1856/3713] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:05.767526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.770069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f716f2c92ce48e59dc3c49dcda26ecb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.770777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f716f2c92ce48e59dc3c49dcda26ecb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.776916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340fcf-821f-4641-b441-92fef8bb7ce8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.782496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e26a1638dd4e85961393317eb8ab7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd9af11cbf04752b6a76db56cf446e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.783116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.783401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.783679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.784824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.785622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.787546 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1857/3714] 10.222.0.78 () {58 vars in 1143 bytes} [Sun Aug 28 20:06:05 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:05.792949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.868098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6629e1a-7ae4-45ff-a0ae-8560d76e0dce tempest-IdentityCatalogTest-1468146315 tempest-IdentityCatalogTest-1468146315-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.873107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.873779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.874346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.877399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] PATH_INFO: `/v3/users/59e26a1638dd4e85961393317eb8ab7a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.877399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e26a1638dd4e85961393317eb8ab7a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.877925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.898855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f716f2c92ce48e59dc3c49dcda26ecb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.908068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f716f2c92ce48e59dc3c49dcda26ecb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.908874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35aaa925-728e-421b-8e51-48186d6398d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f716f2c92ce48e59dc3c49dcda26ecb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:05.929570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1858/3715] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:05 2022] DELETE /identity/v3/users/9f716f2c92ce48e59dc3c49dcda26ecb => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:06.241887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e26a1638dd4e85961393317eb8ab7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:06.259566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e26a1638dd4e85961393317eb8ab7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:06.269788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e26a1638dd4e85961393317eb8ab7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:06.270702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e26a1638dd4e85961393317eb8ab7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:06.271908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e26a1638dd4e85961393317eb8ab7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:06.421640 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1858/3716] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:05 2022] DELETE /identity/v3/users/59e26a1638dd4e85961393317eb8ab7a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:06.427643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835104fa-be7c-447c-ac96-18420060630c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:06.430376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835104fa-be7c-447c-ac96-18420060630c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:06.430661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835104fa-be7c-447c-ac96-18420060630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:06.454470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-835104fa-be7c-447c-ac96-18420060630c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:06.455799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-835104fa-be7c-447c-ac96-18420060630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:06.541636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1859/3717] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:06.555117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:06.555117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:06.628254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d755d-0281-4199-aa9d-f8129480796c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:06.635251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd87d22-bd08-4f24-a923-c3b724797e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:06.636354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87d22-bd08-4f24-a923-c3b724797e70 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:06.636864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87d22-bd08-4f24-a923-c3b724797e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:06.637367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87d22-bd08-4f24-a923-c3b724797e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:06.648032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd87d22-bd08-4f24-a923-c3b724797e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:06.649524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd87d22-bd08-4f24-a923-c3b724797e70 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:06.660334 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1859/3718] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:06.726595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835104fa-be7c-447c-ac96-18420060630c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:06.728129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-835104fa-be7c-447c-ac96-18420060630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:06.756400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835104fa-be7c-447c-ac96-18420060630c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:06.777320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:06.778694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:06.779042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:06.779322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] PATH_INFO: `/v3/projects/ea4b400b45a54defa26c4d57488ed797` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:06.780814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4b400b45a54defa26c4d57488ed797)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:06.785326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:07.059972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4b400b45a54defa26c4d57488ed797', 'request_id': 'req-c5a29164-c036-4a81-88e7-97e3b0bac974'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:07.066169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4b400b45a54defa26c4d57488ed797', 'request_id': 'req-c5a29164-c036-4a81-88e7-97e3b0bac974'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:07.072615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4b400b45a54defa26c4d57488ed797', 'request_id': 'req-c5a29164-c036-4a81-88e7-97e3b0bac974'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:07.278067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] The token cache is being invalidate because project ea4b400b45a54defa26c4d57488ed797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:07.278593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:07.280006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c5a29164-c036-4a81-88e7-97e3b0bac974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:07.283335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1860/3719] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:06 2022] DELETE /identity/v3/projects/ea4b400b45a54defa26c4d57488ed797 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:07.291483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.291483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.291483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.321050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:07.323558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:07.420031 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1860/3720] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:07.431434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.434647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.435118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.464630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:07.465925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:07.482238 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1861/3721] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:07.486554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:07.496654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1b5a6-05f1-4152-8df2-26031e682d7c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:07.502175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:07.502334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.502608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.502849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.503500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:07.503854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:07.505390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:07.520837 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1861/3722] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:06:07.525279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:07.536177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554a90-d6e5-4343-90ec-c299e9c93d99 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:07.540886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:07.542540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.542540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.542540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.542924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:07.544654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:07.651510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:07.656568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:07.675542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812aab-2ce8-41cd-9450-6cc5505f437d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:07.680690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:07.681663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.681785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.682096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] PATH_INFO: `/v3/projects/ccd9af11cbf04752b6a76db56cf446e0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.683284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd9af11cbf04752b6a76db56cf446e0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:07.685192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:07.806066 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1862/3723] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:07 2022] POST /identity/v3/projects => generated 391 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:07.806992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:07.881816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2333d2-890a-4bc7-8d6d-581188be9887 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:07.884570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:07.894215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:07.901490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.901490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.901490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.901490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:07.901490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.000018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd9af11cbf04752b6a76db56cf446e0', 'request_id': 'req-5c3483fe-ae79-4a11-970a-8071604d4960'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:08.020487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd9af11cbf04752b6a76db56cf446e0', 'request_id': 'req-5c3483fe-ae79-4a11-970a-8071604d4960'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:08.031154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd9af11cbf04752b6a76db56cf446e0', 'request_id': 'req-5c3483fe-ae79-4a11-970a-8071604d4960'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:08.129948 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1863/3724] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:07 2022] POST /identity/v3/users => generated 296 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:08.132751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.144495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809dd6-d017-44eb-b230-680847da9ba3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.179287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] The token cache is being invalidate because project ccd9af11cbf04752b6a76db56cf446e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:08.179718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:08.180657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c3483fe-ae79-4a11-970a-8071604d4960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:08.182952 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1862/3725] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:07 2022] DELETE /identity/v3/projects/ccd9af11cbf04752b6a76db56cf446e0 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:08.187868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f2f5-d606-416b-a3db-09c97471b5af None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.188155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f2f5-d606-416b-a3db-09c97471b5af None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.188529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f2f5-d606-416b-a3db-09c97471b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.211263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.211551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9125f2f5-d606-416b-a3db-09c97471b5af None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:08.211993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.212423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.212610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9125f2f5-d606-416b-a3db-09c97471b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:08.212722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.213464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.215184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.221626 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1863/3726] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:08.229526 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1864/3727] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:08.229697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.229892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.230181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.230531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.232350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:08.245411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85def46-a1e7-451d-a47d-362e17922d70 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.250229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.250406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:08.250784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.251075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.251344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.251566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:08.252016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.253591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.259842 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1864/3728] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:08.268632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.268783 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1865/3729] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:06:08.269665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.274538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d6c4-a5a7-44b2-9685-958d191ca952 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.279837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.281054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.281341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.281619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.282326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:08.282639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.284300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.286058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053a18f-82a6-4ac8-b9ea-f4a7559de27c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.291188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b85639-7e40-48c2-bcf6-072ffd3f5876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.291849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85639-7e40-48c2-bcf6-072ffd3f5876 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.292156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85639-7e40-48c2-bcf6-072ffd3f5876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.292428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85639-7e40-48c2-bcf6-072ffd3f5876 admin admin] PATH_INFO: `/v3/projects/a02567a66fba4a08be37c9d215c65209/users/43735123479d425397bd46d5f03e8834/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.298061 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1865/3730] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:06:08.305737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.310432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b85639-7e40-48c2-bcf6-072ffd3f5876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02567a66fba4a08be37c9d215c65209, user_id=43735123479d425397bd46d5f03e8834, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.314662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b85639-7e40-48c2-bcf6-072ffd3f5876 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.318847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdfe31-58e3-4047-a631-1387e0b5e832 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.323785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.324391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.324730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.325005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.325649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.328147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.581544 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1866/3731] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:08 2022] PUT /identity/v3/projects/a02567a66fba4a08be37c9d215c65209/users/43735123479d425397bd46d5f03e8834/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:08.592841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.593060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.593329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.594814 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1866/3732] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:08 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:08.601052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.659489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] MFA Rules not processed for user `43735123479d425397bd46d5f03e8834`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:08.660813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:08.834791 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1867/3733] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:08.839235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:08.839458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef639d-ac72-4de4-ae03-0ecd62b9ade7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.848098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.848740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.849015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.849343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.850032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.852414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:08.858005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e7ce-e50b-4819-9e29-250c45c11b39 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:08.875974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:08.876674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:08.876960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:08.877314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:08.878130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:08.881357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.132356 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1867/3734] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:08 2022] POST /identity/v3/users => generated 300 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:09.138396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.141412 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1868/3735] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:08 2022] POST /identity/v3/projects => generated 391 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:09.146579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.197650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c5f3-718e-49f6-b41c-99f8839ed652 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.326559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304eedb-4b6e-46ad-b0b4-6b6c3dadff99 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.332799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.333355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.333649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.333954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.334614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.336678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.430936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.431573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.440017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.440969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.442675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.444627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.477844 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1868/3736] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:09.483159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.488485 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1869/3737] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:09 2022] POST /identity/v3/users => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:09.498469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5108a7f-1144-45dc-b83c-4a9fc74ef1b6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.505102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.537523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.537523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.537523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.537523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] PATH_INFO: `/v3/projects/94d90a8e758241a0be798544617a321d/users/6bd9da6d4d504c0a82d6d36a0cb10b61/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.544774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1cbb-5e3b-4fc3-9309-25bcaa2be3b5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.550876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d90a8e758241a0be798544617a321d, user_id=6bd9da6d4d504c0a82d6d36a0cb10b61, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.554222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.560253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.560907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.561694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.562022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.563290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.565418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.609917 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1870/3738] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:09.610961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.630816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abcf49-7e93-4422-bfcc-2f71464c2bc5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.645801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.646908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.647200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.647489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] PATH_INFO: `/v3/projects/538391942d9f409dad2b3109d5241a47/users/ae8dcaf2834548689e8a17385513eb21/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.677292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538391942d9f409dad2b3109d5241a47, user_id=ae8dcaf2834548689e8a17385513eb21, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.683208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.693834 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1869/3739] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:09 2022] PUT /identity/v3/projects/94d90a8e758241a0be798544617a321d/users/6bd9da6d4d504c0a82d6d36a0cb10b61/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:09.695267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.774643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001c2a6-afc6-48bf-82b7-9270fdb12da6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.780617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.781337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.781628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.781947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.782635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.784387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.800246 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1870/3740] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:06:09.804759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.827903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f232-cd28-4e4e-9fce-0a4c7d5e4401 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:09.830426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24730e18-c11c-4bd5-909a-b2a350ca65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:09.831250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730e18-c11c-4bd5-909a-b2a350ca65ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.831561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730e18-c11c-4bd5-909a-b2a350ca65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.833984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730e18-c11c-4bd5-909a-b2a350ca65ee admin admin] PATH_INFO: `/v3/projects/94d90a8e758241a0be798544617a321d/users/6bd9da6d4d504c0a82d6d36a0cb10b61/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.837427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24730e18-c11c-4bd5-909a-b2a350ca65ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d90a8e758241a0be798544617a321d, user_id=6bd9da6d4d504c0a82d6d36a0cb10b61, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:09.840196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24730e18-c11c-4bd5-909a-b2a350ca65ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:09.853956 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1871/3741] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:09 2022] PUT /identity/v3/projects/94d90a8e758241a0be798544617a321d/users/6bd9da6d4d504c0a82d6d36a0cb10b61/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:09.861365 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1871/3742] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:09 2022] PUT /identity/v3/projects/538391942d9f409dad2b3109d5241a47/users/ae8dcaf2834548689e8a17385513eb21/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:09.868352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:09.869140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:09.873401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:09.874632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:09.921196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] MFA Rules not processed for user `6bd9da6d4d504c0a82d6d36a0cb10b61`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:09.923240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:10.031434 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1872/3743] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:10.032809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.047088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2703a2-2364-41d1-829e-7f335edc5b34 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.161568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.162250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.162533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.162809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.163581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.165311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.182512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1872/3744] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:10.184529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.199527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ba5c-a9b6-4f98-89a4-97ca8750bb2a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.202842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c9ae-bf96-46b6-b176-392fa86a5658 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.206557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.212573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.213060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.223770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.223770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.223770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.227419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b522-d050-4653-9432-868707f1f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.228378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b522-d050-4653-9432-868707f1f51e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.228662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b522-d050-4653-9432-868707f1f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.230436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b522-d050-4653-9432-868707f1f51e admin admin] PATH_INFO: `/v3/projects/538391942d9f409dad2b3109d5241a47/users/ae8dcaf2834548689e8a17385513eb21/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.236248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b522-d050-4653-9432-868707f1f51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=538391942d9f409dad2b3109d5241a47, user_id=ae8dcaf2834548689e8a17385513eb21, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.245768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b522-d050-4653-9432-868707f1f51e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.269901 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1873/3745] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:10 2022] PUT /identity/v3/projects/538391942d9f409dad2b3109d5241a47/users/ae8dcaf2834548689e8a17385513eb21/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:10.277375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.277775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.278203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.312903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] MFA Rules not processed for user `ae8dcaf2834548689e8a17385513eb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:10.314635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:10.421228 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1874/3746] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:10.428017 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1873/3747] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:10 2022] POST /identity/v3/projects => generated 383 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:10.433824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.544766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cb0d3-58ae-4465-89db-a38efafb353e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.637270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.638273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.638464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.638730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.656298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.656298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.657824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.659609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:10.791668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d902-44bb-480d-911a-6b83b3483600 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.800669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.801433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.803471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.803471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.867754 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1875/3748] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:10 2022] POST /identity/v3/users => generated 292 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:10.871641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.899015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035306bb-0a41-4820-8545-3813af698122 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.906433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.907335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.907848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.908277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.909107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.910969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.921038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.927292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.928585 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1876/3749] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:10.929872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.941538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1874/3750] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:10.943482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d66d7f-3d95-4180-b303-cd2a3c8f4b6a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.949549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.950250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.950534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.950847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:10.951489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:10.954253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:10.967224 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1877/3751] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:10.971602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:10.984199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13466025-d8b9-4d61-a5db-ed10555655fe service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:10.993929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1d0ba-2a94-456d-aec1-241ee3ee46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:10.993929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1d0ba-2a94-456d-aec1-241ee3ee46f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:10.993929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1d0ba-2a94-456d-aec1-241ee3ee46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:10.993929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1d0ba-2a94-456d-aec1-241ee3ee46f7 admin admin] PATH_INFO: `/v3/projects/b387d345ca23405d830600b9479ede89/users/ee7a1d0812a94586812442cfa27408be/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:11.003158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:11.010650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1d0ba-2a94-456d-aec1-241ee3ee46f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b387d345ca23405d830600b9479ede89, user_id=ee7a1d0812a94586812442cfa27408be, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:11.013406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1d0ba-2a94-456d-aec1-241ee3ee46f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:11.020478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2e62-3bcb-499b-b9ff-00d2e1939783 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:11.026675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:11.027306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:11.027592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:11.027868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:11.099161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:11.102592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:11.111317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:11.121797 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1878/3752] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:11.134286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:11.146546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c74e7c-365e-4f09-ba17-295d1efe122e service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:11.150935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:11.151691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:11.152224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:11.152595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] PATH_INFO: `/v3/users/43735123479d425397bd46d5f03e8834` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:11.154154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=43735123479d425397bd46d5f03e8834)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:11.156686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:11.300032 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1875/3753] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:10 2022] PUT /identity/v3/projects/b387d345ca23405d830600b9479ede89/users/ee7a1d0812a94586812442cfa27408be/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:11.312519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:11.312838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:11.313367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:11.360685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] MFA Rules not processed for user `ee7a1d0812a94586812442cfa27408be`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:11.362203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:11.453699 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1876/3754] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:11.462419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:11.464734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:11.559817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0c1e-b735-4183-b485-8cd970d3f985 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:11.564389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b99ec-89f7-4262-b85e-2cc7832856ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:11.565021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b99ec-89f7-4262-b85e-2cc7832856ed service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:11.565304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b99ec-89f7-4262-b85e-2cc7832856ed service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:11.565577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b99ec-89f7-4262-b85e-2cc7832856ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:11.635980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b99ec-89f7-4262-b85e-2cc7832856ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:11.637409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b99ec-89f7-4262-b85e-2cc7832856ed service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:11.647669 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1877/3755] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:11.854713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43735123479d425397bd46d5f03e8834'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:11.855648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43735123479d425397bd46d5f03e8834'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:11.996515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43735123479d425397bd46d5f03e8834'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:12.015456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43735123479d425397bd46d5f03e8834'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:12.015456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43735123479d425397bd46d5f03e8834'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:12.056021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1879/3756] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:11 2022] DELETE /identity/v3/users/43735123479d425397bd46d5f03e8834 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:12.060426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:12.060984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:12.060984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:12.084337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:12.085581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:12.168019 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1878/3757] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:12.188544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:12.196204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:12.491374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf5b1a-2a15-4f17-b845-9f08257e7cfd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:12.501075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:12.502051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:12.526450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:12.526450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:12.526450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:12.526450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:12.537080 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1880/3758] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:12.618117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:13.223409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:13.225640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:13.255862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005865-dd1c-4cfb-9133-51928cb1bf5e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:13.263624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:13.264605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:13.265036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:13.265465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] PATH_INFO: `/v3/users/6bd9da6d4d504c0a82d6d36a0cb10b61` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:13.267488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd9da6d4d504c0a82d6d36a0cb10b61)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:13.271510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:13.750959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:13.753746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:13.775715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52f83-3655-4a9a-ab6a-4489035ee4ad service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:13.779545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd9da6d4d504c0a82d6d36a0cb10b61'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:13.786403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:13.788797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:13.789310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:13.810917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] PATH_INFO: `/v3/projects/a02567a66fba4a08be37c9d215c65209` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:13.815014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02567a66fba4a08be37c9d215c65209)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:13.821913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:13.857720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd9da6d4d504c0a82d6d36a0cb10b61'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:13.887169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd9da6d4d504c0a82d6d36a0cb10b61'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:13.888124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd9da6d4d504c0a82d6d36a0cb10b61'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:13.888753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ba134c69-2fc8-4f18-bdc5-74db4b7e0a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd9da6d4d504c0a82d6d36a0cb10b61'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.042904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1879/3759] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:13 2022] DELETE /identity/v3/users/6bd9da6d4d504c0a82d6d36a0cb10b61 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:14.044489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:14.044797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:14.045072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:14.081064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:14.082522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:14.091384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02567a66fba4a08be37c9d215c65209', 'request_id': 'req-fda4ace1-d9be-4b69-a48f-04fb17df581b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.104497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02567a66fba4a08be37c9d215c65209', 'request_id': 'req-fda4ace1-d9be-4b69-a48f-04fb17df581b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.115745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02567a66fba4a08be37c9d215c65209', 'request_id': 'req-fda4ace1-d9be-4b69-a48f-04fb17df581b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.221502 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1880/3760] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:14.241986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:14.244783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:14.320927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] The token cache is being invalidate because project a02567a66fba4a08be37c9d215c65209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:14.321586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.322655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.324720 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1881/3761] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:13 2022] DELETE /identity/v3/projects/a02567a66fba4a08be37c9d215c65209 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:14.329546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:14.331690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:14.357952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a466190-de63-4ea9-bf0d-c5158b9b6cea None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:14.363418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:14.367107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4ace1-d9be-4b69-a48f-04fb17df581b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:14.367268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:14.367268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:14.367268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:14.367665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:14.371931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:14.373220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:14.373902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:14.374474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] PATH_INFO: `/v3/users/ae8dcaf2834548689e8a17385513eb21` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:14.376899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8dcaf2834548689e8a17385513eb21)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:14.380547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:14.384081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:14.386374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:14.400350 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1881/3762] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:14.931397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8dcaf2834548689e8a17385513eb21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:14.932881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8dcaf2834548689e8a17385513eb21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:15.155950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8dcaf2834548689e8a17385513eb21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:15.168015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8dcaf2834548689e8a17385513eb21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:15.171393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31f04cf3-44ed-4986-a519-80042fdbd5d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8dcaf2834548689e8a17385513eb21'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:15.217804 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1882/3763] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:14 2022] DELETE /identity/v3/users/ae8dcaf2834548689e8a17385513eb21 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:15.348175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:15.349778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:15.375275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cba34-31c0-4151-8645-0e49149a0a4e service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:15.518681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:15.519912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:15.520473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:15.520767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] PATH_INFO: `/v3/projects/94d90a8e758241a0be798544617a321d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:15.523322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d90a8e758241a0be798544617a321d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:15.527063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:15.600226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:15.600456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:15.600737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:15.648853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] MFA Rules not processed for user `4c0e404e10ed4d7eaf2b8825b444d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:15.650683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:15.763640 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1883/3764] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:15.765308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:15.767065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:15.784553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e1ca1-1e39-404d-8605-804c40ed39d2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:15.791105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:15.795219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:15.795219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:15.795219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] PATH_INFO: `/v3/users/eed4805ccbd34375809fd12330bcfca6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:15.795219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed4805ccbd34375809fd12330bcfca6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:15.797641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:15.969995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d90a8e758241a0be798544617a321d', 'request_id': 'req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:15.983211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d90a8e758241a0be798544617a321d', 'request_id': 'req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:15.992896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d90a8e758241a0be798544617a321d', 'request_id': 'req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.169818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed4805ccbd34375809fd12330bcfca6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.171441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed4805ccbd34375809fd12330bcfca6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.198698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] The token cache is being invalidate because project 94d90a8e758241a0be798544617a321d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:16.199281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.200889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c80bba5c-ef1f-419a-8eeb-ecfd40bcc088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.204234 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1882/3765] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:15 2022] DELETE /identity/v3/projects/94d90a8e758241a0be798544617a321d => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:16.211598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:16.211598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:16.211598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:16.242574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] MFA Rules not processed for user `4c0e404e10ed4d7eaf2b8825b444d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:16.244166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:16.328477 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1883/3766] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:16.329261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:16.331609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:16.331884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed4805ccbd34375809fd12330bcfca6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.362051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed4805ccbd34375809fd12330bcfca6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.363177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed4805ccbd34375809fd12330bcfca6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.396706 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1884/3767] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:15 2022] DELETE /identity/v3/users/eed4805ccbd34375809fd12330bcfca6 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:16.397899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:16.403868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:16.429409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a9780-e22c-4961-aa7c-b14531173db3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:16.496564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b6ee-8a30-4ba3-9f8c-e959f60d0f1b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:16.502944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:16.503699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:16.504213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:16.504564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] PATH_INFO: `/v3/projects/538391942d9f409dad2b3109d5241a47` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:16.510581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538391942d9f409dad2b3109d5241a47)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:16.510581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:16.515960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:16.516887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:16.517322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:16.517756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] PATH_INFO: `/v3/users/ee7a1d0812a94586812442cfa27408be` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:16.519404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7a1d0812a94586812442cfa27408be)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:16.522101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:16.715601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538391942d9f409dad2b3109d5241a47', 'request_id': 'req-46264b8c-277c-49f1-b31f-c750161075b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.723870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538391942d9f409dad2b3109d5241a47', 'request_id': 'req-46264b8c-277c-49f1-b31f-c750161075b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.735915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538391942d9f409dad2b3109d5241a47', 'request_id': 'req-46264b8c-277c-49f1-b31f-c750161075b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.873227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] The token cache is being invalidate because project 538391942d9f409dad2b3109d5241a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:16.874528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.875674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:16.881897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1885/3768] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:16 2022] DELETE /identity/v3/projects/538391942d9f409dad2b3109d5241a47 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:16.881897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:16.884685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.004041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7a1d0812a94586812442cfa27408be'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:17.009344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264b8c-277c-49f1-b31f-c750161075b9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:17.016950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:17.017738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.018188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.018527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.022693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.022896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7a1d0812a94586812442cfa27408be'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:17.032989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7a1d0812a94586812442cfa27408be'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:17.034374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7a1d0812a94586812442cfa27408be'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:17.035436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35ac0886-14be-4c4c-831f-0911fd5603b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7a1d0812a94586812442cfa27408be'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:17.095660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:17.097349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec771e42-5444-42ad-bfc8-2f591372a9ae service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:17.109340 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1886/3769] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:17.110514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.110910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.111268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.151239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:17.154861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.227687 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1884/3770] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:16 2022] DELETE /identity/v3/users/ee7a1d0812a94586812442cfa27408be => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:17.229615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bddc53-bbe9-4566-be88-e7cd94fdf9ba None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.236599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bddc53-bbe9-4566-be88-e7cd94fdf9ba None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.239288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bddc53-bbe9-4566-be88-e7cd94fdf9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.307782 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1887/3771] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:17.309185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-82bddc53-bbe9-4566-be88-e7cd94fdf9ba None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:17.315112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-82bddc53-bbe9-4566-be88-e7cd94fdf9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.333941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:17.335864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.466196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745416-aeac-4167-9b85-202fa341dbcd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:17.481186 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1885/3772] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:17.490379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.491098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.491745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.540544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:17.544272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.555612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:17.556873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.558466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.559575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.575566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1886/3773] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:17.577640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:17.582029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:17.584848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:17.595986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a853b-9de1-45d5-a0c6-63f23101241b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:17.611563 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1888/3774] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:17.611997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:17.612740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.613191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.613629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.614344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:17.614657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:17.618486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:17.643794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1887/3775] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:17.649921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:17.664877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68200ade-5ae6-4132-a287-89e95850fc2d service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:17.676194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:17.677323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.677616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.680818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.683085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:17.688190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:17.743602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:17.834701 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1889/3776] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:17 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:17.838898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:17.861472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1431b8-d896-490f-be7e-5cddd806cbe8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:17.956550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:17.957576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.958202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.958789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.960569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:17.963721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:18.122351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:18.125199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:18.143233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ca40-a76a-44de-ba7d-6505b91e983c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:18.151326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:18.152103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:18.152460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:18.152809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] PATH_INFO: `/v3/projects/5785436cda5f45ca9852b0b284b8137a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:18.155066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5785436cda5f45ca9852b0b284b8137a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:18.156235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:18.243221 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1888/3777] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:17 2022] POST /identity/v3/users => generated 290 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:18.243221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:18.247518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:18.269348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ac2d-f74a-4b77-b2aa-693a8d4ab705 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:18.277888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:18.278946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:18.279429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:18.280410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] PATH_INFO: `/v3/projects/b387d345ca23405d830600b9479ede89` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:18.282632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b387d345ca23405d830600b9479ede89)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:18.286175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:18.573437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b387d345ca23405d830600b9479ede89', 'request_id': 'req-be50fb5f-230e-4898-b0bb-1d4c37bd6125'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.577183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5785436cda5f45ca9852b0b284b8137a', 'request_id': 'req-e7d59717-d560-458f-a565-23fd85683139'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.582765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b387d345ca23405d830600b9479ede89', 'request_id': 'req-be50fb5f-230e-4898-b0bb-1d4c37bd6125'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.594555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b387d345ca23405d830600b9479ede89', 'request_id': 'req-be50fb5f-230e-4898-b0bb-1d4c37bd6125'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.599635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5785436cda5f45ca9852b0b284b8137a', 'request_id': 'req-e7d59717-d560-458f-a565-23fd85683139'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.609931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5785436cda5f45ca9852b0b284b8137a', 'request_id': 'req-e7d59717-d560-458f-a565-23fd85683139'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.795909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] The token cache is being invalidate because project b387d345ca23405d830600b9479ede89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:18.796460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.798209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.809138 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1889/3778] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:18 2022] DELETE /identity/v3/projects/b387d345ca23405d830600b9479ede89 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:18.811119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:18.816475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:18.876428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] The token cache is being invalidate because project 5785436cda5f45ca9852b0b284b8137a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:18.876716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.877431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7d59717-d560-458f-a565-23fd85683139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:18.881803 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1890/3779] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:18 2022] DELETE /identity/v3/projects/5785436cda5f45ca9852b0b284b8137a => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:18.881803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:18.881803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:18.881803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:18.929332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:18.929332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:18.988858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50fb5f-230e-4898-b0bb-1d4c37bd6125 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:18.994534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:18.995227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:18.995516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:18.995779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:18.996423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:18.998340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.018348 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1890/3780] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:19.018348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:19.019388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:19.041444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:19.049121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590eec-35bd-48e7-b49f-948730a8f92e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:19.051349 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1891/3781] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:19.052789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:19.054525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:19.056965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:19.057964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.058311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.059170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] PATH_INFO: `/v3/users/22077261042643ea8a6d1c42c07c28db` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.061701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22077261042643ea8a6d1c42c07c28db)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:19.063817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.069267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792e94-10cb-4f2b-b9d7-0cc3a96a9e04 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:19.079028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e350d9f-6500-4a30-acf3-4991268fdf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:19.079028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e350d9f-6500-4a30-acf3-4991268fdf94 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.079028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e350d9f-6500-4a30-acf3-4991268fdf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.079028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e350d9f-6500-4a30-acf3-4991268fdf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.079420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e350d9f-6500-4a30-acf3-4991268fdf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:19.079420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e350d9f-6500-4a30-acf3-4991268fdf94 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.094367 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1892/3782] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:19.094367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.094367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.094367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.129810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:19.131463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:19.145878 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1893/3783] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:19.146877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:19.164003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a40b-8e07-4a5f-a338-79b81130faa7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:19.169829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:19.170752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.171170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.171602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] PATH_INFO: `/v3/projects/fc01b946ab004f14b610ca17218d6e71/users/12315ca7852d4f168f3f37e9d2ae184b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.193957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc01b946ab004f14b610ca17218d6e71, user_id=12315ca7852d4f168f3f37e9d2ae184b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:19.197087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.352561 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1894/3784] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:19 2022] PUT /identity/v3/projects/fc01b946ab004f14b610ca17218d6e71/users/12315ca7852d4f168f3f37e9d2ae184b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:19.358396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:19.408914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22077261042643ea8a6d1c42c07c28db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:19.426353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22077261042643ea8a6d1c42c07c28db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:19.434871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22077261042643ea8a6d1c42c07c28db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:19.435716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22077261042643ea8a6d1c42c07c28db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:19.438434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22077261042643ea8a6d1c42c07c28db'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:19.524426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c2b9-6377-4322-b6aa-d3cffd8fb082 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:19.542753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:19.543325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.543608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.543889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.544592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:19.544903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:19.547151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ade546-af03-4390-b46d-5fedeeebf1a1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.583963 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1895/3785] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:19.588218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.588945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.589376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.619762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:19.621467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:19.632522 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1896/3786] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:19.639616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:19.641503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1891/3787] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:19 2022] DELETE /identity/v3/users/22077261042643ea8a6d1c42c07c28db => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:19.643105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:19.656431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:19.658247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:19.666762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e133bf0-59b9-4d2f-b293-eb918e868a49 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:19.785463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b426fc-bfc0-45b0-ade0-46052ea5778b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:19.793781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:19.794934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.795768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.796160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.803504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:19.804800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:19.805984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:19.806581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:19.807718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:19.813101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.939687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:19.941400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:19.957845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1892/3788] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:20.146348 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1897/3789] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:19 2022] POST /identity/v3/projects => generated 383 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:20.151110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:20.181035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26774420-6b86-45e1-9c98-d986ef06303a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:20.357170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:20.361310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:20.389190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:20.390090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:20.390571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:20.391004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:20.392145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:20.394904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:20.515513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707ea4-4731-4e36-8874-7145ff1687b2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:20.522410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:20.522975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:20.523254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:20.523531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] PATH_INFO: `/v3/projects/f3ff7a0c01d44d66913f71941db638b0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:20.524726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ff7a0c01d44d66913f71941db638b0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:20.528289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:20.566987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1893/3790] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:20 2022] POST /identity/v3/users => generated 292 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:20.568171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:20.581893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3039470-6525-40de-b87b-9a4861be24f8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:20.589750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:20.590487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:20.590933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:20.591301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:20.592702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:20.595170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:20.616243 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1894/3791] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:20.617522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:20.636728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc45619-5717-4edc-8c50-1508fd27afce admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:20.644402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:20.646206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:20.646775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:20.647139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:20.647847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:20.652095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:20.665973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1895/3792] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:20.671713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:20.685475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b10ba-b2f5-4f52-b6d7-e298f41247d0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:20.693555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bd2a4-7be6-41af-894d-67dcf9aad748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:20.694286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd2a4-7be6-41af-894d-67dcf9aad748 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:20.694637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd2a4-7be6-41af-894d-67dcf9aad748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:20.695030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd2a4-7be6-41af-894d-67dcf9aad748 admin admin] PATH_INFO: `/v3/projects/802e13a5eb004f678ebe79b8d12ed934/users/3ea997629e1243deae2ca0231fb5a113/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:20.741300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bd2a4-7be6-41af-894d-67dcf9aad748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802e13a5eb004f678ebe79b8d12ed934, user_id=3ea997629e1243deae2ca0231fb5a113, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:20.749257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bd2a4-7be6-41af-894d-67dcf9aad748 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:20.919427 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1896/3793] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:20 2022] PUT /identity/v3/projects/802e13a5eb004f678ebe79b8d12ed934/users/3ea997629e1243deae2ca0231fb5a113/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:20.934605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ff7a0c01d44d66913f71941db638b0', 'request_id': 'req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:20.937050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:20.937676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:20.938723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:20.950921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ff7a0c01d44d66913f71941db638b0', 'request_id': 'req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:20.986899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ff7a0c01d44d66913f71941db638b0', 'request_id': 'req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:21.007407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] MFA Rules not processed for user `3ea997629e1243deae2ca0231fb5a113`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:21.008685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:21.105772 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1897/3794] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:21.112897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:21.147348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] The token cache is being invalidate because project f3ff7a0c01d44d66913f71941db638b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:21.148980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:21.150753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-64706cd8-bff4-4da1-9a4a-86cd0b85d25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:21.157906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1898/3795] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:20 2022] DELETE /identity/v3/projects/f3ff7a0c01d44d66913f71941db638b0 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:21.166862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e174cd1-876b-492b-9786-47a314a7207e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:21.173406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e174cd1-876b-492b-9786-47a314a7207e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:21.174131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e174cd1-876b-492b-9786-47a314a7207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:21.224772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6e174cd1-876b-492b-9786-47a314a7207e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:21.231182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6e174cd1-876b-492b-9786-47a314a7207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:21.414428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80195d80-8157-4bd8-83b7-9b0c92c74862 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:21.421048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:21.422112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:21.430157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:21.430157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:21.430157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:21.430157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:21.489997 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1899/3796] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:21.521396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:21.521396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:21.521396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:21.550872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:21.552532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:21.566925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1900/3797] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:21.574245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:21.588388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1898/3798] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:21 2022] POST /identity/v3/projects => generated 383 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:21.594379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:21.603751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:21.603990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebd5a8-dfc3-47b4-b583-a9fe5aa15f18 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:21.703621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:21.704524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:21.705273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:21.713793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:21.713793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:21.713793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:21.713793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:21.726829 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1901/3799] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:21.731673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:21.746898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671e25-b678-4351-885f-e08821dd6086 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:21.748370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ec1a-4f63-4189-b753-8850ce5b49c5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:21.759588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:21.772890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:21.773393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:21.773393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:21.773574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:21.773666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:21.773755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:21.773755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:21.773755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:21.774053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:21.774143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:21.774231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:21.951685 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1899/3800] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:21 2022] POST /identity/v3/users => generated 298 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:21.956502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:21.974691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1902/3801] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:21 2022] POST /identity/v3/projects => generated 395 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:21.978613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad193f-3957-4ff1-b372-2eb912539822 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:21.982765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.148759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.150037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.150331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.150611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.153046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.162798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.189936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1900/3802] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:06:22.196844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.201152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767175-2368-44c1-9f4f-4abde8c9cc7e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.214814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba41c-d42b-42fc-9ee3-dc05782e9311 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.216851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.221711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.221711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.221711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.222239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.223014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.224117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.224449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.224811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] PATH_INFO: `/v3/projects/0033f72b27f74afd89afdc020a98bf86/users/80314f25c2f44d16aef6a53ff52a6038/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.230207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.255118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0033f72b27f74afd89afdc020a98bf86, user_id=80314f25c2f44d16aef6a53ff52a6038, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.258871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.435915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1903/3803] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:21 2022] POST /identity/v3/users => generated 298 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:22.441955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.465071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae562c4a-8cc7-48c8-9d02-c65b61c242a4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.476535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.478072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.478451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.478907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.480372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.483167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.489933 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1901/3804] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:22 2022] PUT /identity/v3/projects/0033f72b27f74afd89afdc020a98bf86/users/80314f25c2f44d16aef6a53ff52a6038/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:22.494963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.517737 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1904/3805] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:22.528018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.548913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9b07-82e9-4534-9161-0468276adcba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.636212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e929e7-9e31-4fcf-aaee-8ce213eb402c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.642351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.642990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.643274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.643585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.644269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.646096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.658832 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1902/3806] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:22.664353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.669379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.677131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.677131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.677131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.677131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.677131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.678460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7bb25-5f93-4313-9dd7-896d0fd26976 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.684298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8856b1-afb8-4f6b-be5a-1d8b3915f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.685547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8856b1-afb8-4f6b-be5a-1d8b3915f668 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.686479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8856b1-afb8-4f6b-be5a-1d8b3915f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.686792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8856b1-afb8-4f6b-be5a-1d8b3915f668 admin admin] PATH_INFO: `/v3/projects/0033f72b27f74afd89afdc020a98bf86/users/80314f25c2f44d16aef6a53ff52a6038/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.689517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8856b1-afb8-4f6b-be5a-1d8b3915f668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0033f72b27f74afd89afdc020a98bf86, user_id=80314f25c2f44d16aef6a53ff52a6038, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.692517 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1905/3807] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:06:22.696256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8856b1-afb8-4f6b-be5a-1d8b3915f668 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.697980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.711302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd9d13-fa76-4fba-ad64-5284b058606c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:22.713262 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1903/3808] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:22 2022] PUT /identity/v3/projects/0033f72b27f74afd89afdc020a98bf86/users/80314f25c2f44d16aef6a53ff52a6038/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:22.736346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.736997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.737638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.777741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] MFA Rules not processed for user `80314f25c2f44d16aef6a53ff52a6038`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:22.777741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:22.805134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1a83-a23f-4753-a87b-a377a994d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:22.805939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1a83-a23f-4753-a87b-a377a994d3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:22.806314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1a83-a23f-4753-a87b-a377a994d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:22.806835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1a83-a23f-4753-a87b-a377a994d3f4 admin admin] PATH_INFO: `/v3/projects/b138a3360b80463eb25c185e162f262b/users/6b9b11e51a7e45bebfdfb8fe8497fac4/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:22.846250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f1a83-a23f-4753-a87b-a377a994d3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b138a3360b80463eb25c185e162f262b, user_id=6b9b11e51a7e45bebfdfb8fe8497fac4, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:22.850790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f1a83-a23f-4753-a87b-a377a994d3f4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:22.907970 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1904/3809] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:22.921210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:22.924610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:23.031886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410d86-a7a6-4290-9099-36c037f1fe7d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:23.036736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:23.037372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:23.037653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:23.037955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:23.039837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:23.144330 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1906/3810] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:22 2022] PUT /identity/v3/projects/b138a3360b80463eb25c185e162f262b/users/6b9b11e51a7e45bebfdfb8fe8497fac4/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:23.159780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:23.163051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:23.164053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:23.164796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:23.173127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:23.229361 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1905/3811] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:23.244330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] MFA Rules not processed for user `6b9b11e51a7e45bebfdfb8fe8497fac4`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:23.248409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:23.465134 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1907/3812] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:23.467386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:23.481282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd8639-a3bd-4aca-bf14-78ac4cbe6384 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:23.606718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:23.608452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:23.608760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:23.609307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:23.612193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:23.615023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:24.034999 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1906/3813] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:23 2022] POST /identity/v3/projects => generated 395 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:24.037497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:24.060948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e566e-c920-434e-b9c4-251de2d94981 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:24.185966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:24.189136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:24.189661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:24.195421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:24.195421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:24.199064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:24.432772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1908/3814] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:24 2022] POST /identity/v3/users => generated 304 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:24.440036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:24.454944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980405e-5206-42d2-83bd-d5baee678284 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:24.473670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:24.475009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:24.476598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:24.477069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:24.477918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:24.480885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:24.501635 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1907/3815] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:24.502375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:24.532322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb937e-1f71-48bc-b89d-d90528f027e9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:24.540129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:24.542819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:24.552260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:24.571064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] PATH_INFO: `/v3/projects/a0b9d46bee694ceb86c6eb7ca0e7b03a/users/f0cd718cef2a45f1b940e2964b463c82/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:24.603025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b9d46bee694ceb86c6eb7ca0e7b03a, user_id=f0cd718cef2a45f1b940e2964b463c82, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:24.606975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:25.354722 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1909/3816] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:24 2022] PUT /identity/v3/projects/a0b9d46bee694ceb86c6eb7ca0e7b03a/users/f0cd718cef2a45f1b940e2964b463c82/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:25.491033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:25.491033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4a1d-3d88-411e-a974-873480b2fd71 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:25.491033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9fee-277b-461b-8aed-18a82666cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:25.491033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9fee-277b-461b-8aed-18a82666cf0d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:25.494806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9fee-277b-461b-8aed-18a82666cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:25.494806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9fee-277b-461b-8aed-18a82666cf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:25.494806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf9fee-277b-461b-8aed-18a82666cf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:25.494806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf9fee-277b-461b-8aed-18a82666cf0d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:25.494806 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1908/3817] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:25.496544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:25.496544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b37f92-a81c-4b79-a041-c37a8ccebcda admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:25.496544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:25.496544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:25.497597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:25.497597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] PATH_INFO: `/v3/projects/a0b9d46bee694ceb86c6eb7ca0e7b03a/users/f0cd718cef2a45f1b940e2964b463c82/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:25.497597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b9d46bee694ceb86c6eb7ca0e7b03a, user_id=f0cd718cef2a45f1b940e2964b463c82, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:25.497597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:25.497597 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1910/3818] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:25 2022] PUT /identity/v3/projects/a0b9d46bee694ceb86c6eb7ca0e7b03a/users/f0cd718cef2a45f1b940e2964b463c82/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:25.498731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:25.498731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:25.498731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:25.498731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] MFA Rules not processed for user `f0cd718cef2a45f1b940e2964b463c82`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:25.498731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:25.498731 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1909/3819] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:25.500938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:25.500938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:25.544726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4b62-0607-4690-b9a0-518c9be8e46d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:25.555082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:25.555722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:25.556568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:25.556969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:25.580253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:25.582664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:25.606075 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1911/3820] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:25 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:25.783282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:26.095624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:26.099649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:26.199939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909edbd-7a0b-412a-8406-e36d7d2628cf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:26.217546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:26.218292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:26.218617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:26.221186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:26.246090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:26.265694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ef4a9-f60e-4e8a-af5c-fd9d0868600d service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:26.291616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5897f-d01d-4300-ac44-f93487961cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:26.292638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5897f-d01d-4300-ac44-f93487961cd1 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:26.293111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5897f-d01d-4300-ac44-f93487961cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:26.293559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5897f-d01d-4300-ac44-f93487961cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:26.406512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:26.409425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:26.432933 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1910/3821] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:26.439987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5897f-d01d-4300-ac44-f93487961cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:26.441779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5897f-d01d-4300-ac44-f93487961cd1 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:26.462420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1912/3822] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:26 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:26.488335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:26.701288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15fcda-d2e6-4b09-86cc-fa1dbd666b17 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:26.735828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:26.735828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:26.735828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:26.736384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] PATH_INFO: `/v3/users/6b9b11e51a7e45bebfdfb8fe8497fac4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:26.740570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9b11e51a7e45bebfdfb8fe8497fac4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:26.762244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:27.085825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:27.161363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9b11e51a7e45bebfdfb8fe8497fac4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:27.202673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9b11e51a7e45bebfdfb8fe8497fac4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:27.224143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9b11e51a7e45bebfdfb8fe8497fac4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:27.224939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9b11e51a7e45bebfdfb8fe8497fac4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:27.225632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9b11e51a7e45bebfdfb8fe8497fac4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:27.346260 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1911/3823] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:26 2022] DELETE /identity/v3/users/6b9b11e51a7e45bebfdfb8fe8497fac4 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:27.351206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:27.351501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:27.352051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:27.444589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:27.445970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:27.580280 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1913/3824] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:27.617939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:27.619761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:27.741415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560782e-742f-45c5-98ce-30f3459f7b45 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:27.746580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:27.747308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:27.747808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:27.748642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:27.765906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:27.768082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:27.783845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1912/3825] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:30.345217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:30.345217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:30.387413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d821-1e9e-4fc3-86fd-cd28347dbe12 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:30.429062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:30.429062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:30.429062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:30.429062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] PATH_INFO: `/v3/projects/b138a3360b80463eb25c185e162f262b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:30.429785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b138a3360b80463eb25c185e162f262b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:30.430412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:30.794264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b138a3360b80463eb25c185e162f262b', 'request_id': 'req-034749fd-9136-4092-872e-dba85c725cd9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:30.812742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b138a3360b80463eb25c185e162f262b', 'request_id': 'req-034749fd-9136-4092-872e-dba85c725cd9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:30.823115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b138a3360b80463eb25c185e162f262b', 'request_id': 'req-034749fd-9136-4092-872e-dba85c725cd9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:30.988642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] The token cache is being invalidate because project b138a3360b80463eb25c185e162f262b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:30.988642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:30.989577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-034749fd-9136-4092-872e-dba85c725cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:30.992126 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1914/3826] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:30 2022] DELETE /identity/v3/projects/b138a3360b80463eb25c185e162f262b => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:30.996585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:31.014635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74751cf8-6262-47af-89fe-f8f8e9b74f77 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:31.153293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:31.153835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:31.155500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:31.155888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] PATH_INFO: `/v3/users/f0cd718cef2a45f1b940e2964b463c82` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:31.158926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cd718cef2a45f1b940e2964b463c82)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:31.162758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:31.282164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:31.282782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:31.283714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:31.327375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:31.328974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:31.427982 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1915/3827] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:31.595534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cd718cef2a45f1b940e2964b463c82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:31.632685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cd718cef2a45f1b940e2964b463c82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:31.658400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cd718cef2a45f1b940e2964b463c82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:31.660693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cd718cef2a45f1b940e2964b463c82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:31.661071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1b358f39-8663-4a52-b389-9d670dd65f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cd718cef2a45f1b940e2964b463c82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:31.789059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1913/3828] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:30 2022] DELETE /identity/v3/users/f0cd718cef2a45f1b940e2964b463c82 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:32.095544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:32.807479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:32.810811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:32.832230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c5e48-d179-4d89-9919-bb60e09c6a26 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:32.944977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:32.945694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:32.946075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:32.946702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] PATH_INFO: `/v3/projects/a0b9d46bee694ceb86c6eb7ca0e7b03a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:32.948907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b9d46bee694ceb86c6eb7ca0e7b03a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:32.954653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:33.230051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b9d46bee694ceb86c6eb7ca0e7b03a', 'request_id': 'req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:33.244252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b9d46bee694ceb86c6eb7ca0e7b03a', 'request_id': 'req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:33.258244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b9d46bee694ceb86c6eb7ca0e7b03a', 'request_id': 'req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:33.378276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] The token cache is being invalidate because project a0b9d46bee694ceb86c6eb7ca0e7b03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:33.378276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:33.378276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-db0b3b6b-268b-4ff2-a141-ba5ae07b38a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:33.378276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1916/3829] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:32 2022] DELETE /identity/v3/projects/a0b9d46bee694ceb86c6eb7ca0e7b03a => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:33.380503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:33.381066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:33.381066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:33.438750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:33.440930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:33.570287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1914/3830] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:33.571517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:33.572029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:33.572456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:33.639481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:33.650614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:33.664810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1917/3831] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:33.669223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:33.681480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb93e46-9bd5-415f-ae03-c6d76d7335e1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:33.693914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:33.694989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:33.695454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:33.695996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:33.696886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:33.697380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:33.701052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:33.733389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1915/3832] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:33.734602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:33.747413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8155f6-9f28-4ff7-b0df-dff2e8ddf157 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:33.755810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:33.756745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:33.757130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:33.757535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:33.758445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:33.760680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:33.771165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:34.003585 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1918/3833] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:33 2022] POST /identity/v3/projects => generated 371 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:34.007922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.029772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155a280-d271-466a-b695-ebffef27efa6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.042252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.044928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.211343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.212204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.213148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.215303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.216393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.219172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.255302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05763f-1b20-41d7-aa29-d5c95cdd57cf admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.264195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.270529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.271123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.271603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.279956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.306195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.307880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adce3c-5f6c-46b0-b3e8-060add5f32ba service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.339150 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1919/3834] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:34.340690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bdfe-c7a2-4860-bf2d-8046f8751363 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.341138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bdfe-c7a2-4860-bf2d-8046f8751363 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.342190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bdfe-c7a2-4860-bf2d-8046f8751363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.414495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6f96bdfe-c7a2-4860-bf2d-8046f8751363 None None] MFA Rules not processed for user `12315ca7852d4f168f3f37e9d2ae184b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:34.415939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f96bdfe-c7a2-4860-bf2d-8046f8751363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.489093 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1916/3835] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:34 2022] POST /identity/v3/users => generated 286 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:34.493208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.495372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.529265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65534-24a2-4192-a2d2-b8ee1b1be002 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.535673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.536559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.537001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.537445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.539836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.554244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.556438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.580142 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1917/3836] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:34.581440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.593553 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1920/3837] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:34.597209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d09ea2-7812-46af-b228-5e595a9fec5a service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.603359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.604233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.604673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.605147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.606018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.607176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.607476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.607831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.609001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.624352 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1918/3838] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:34.634310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.645175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] MFA Rules not processed for user `12315ca7852d4f168f3f37e9d2ae184b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:34.646647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534ce2f-62e9-4388-b14f-fec73e7be28a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.646823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.655402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.656033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.656316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.656594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.657547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.660247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.663093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1921/3839] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:34.677277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.678660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:34.684371 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1919/3840] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:34.689915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:34.705275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44d02-f0ed-47b9-9c76-875d65aa3532 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.721668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda4d7-791e-4ec7-8d84-029c2d47edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.722376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda4d7-791e-4ec7-8d84-029c2d47edcb admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.722969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda4d7-791e-4ec7-8d84-029c2d47edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.723245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda4d7-791e-4ec7-8d84-029c2d47edcb admin admin] PATH_INFO: `/v3/projects/5333697315e84535bea128ef30c49204/users/150a196ea7894060b6abcb033b52911d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.749641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dda4d7-791e-4ec7-8d84-029c2d47edcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5333697315e84535bea128ef30c49204, user_id=150a196ea7894060b6abcb033b52911d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.754108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dda4d7-791e-4ec7-8d84-029c2d47edcb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.791205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6426-6479-4189-9757-6f0ea907a8e3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:34.803930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346f319-352d-4766-a432-1b3ff6baa1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:34.804559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f319-352d-4766-a432-1b3ff6baa1dd service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.804848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f319-352d-4766-a432-1b3ff6baa1dd service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.805121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f319-352d-4766-a432-1b3ff6baa1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.820284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f319-352d-4766-a432-1b3ff6baa1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:34.822628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f319-352d-4766-a432-1b3ff6baa1dd service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:34.837283 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1922/3841] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:06:34.907844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.907844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.907994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.945515 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1920/3842] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:34 2022] PUT /identity/v3/projects/5333697315e84535bea128ef30c49204/users/150a196ea7894060b6abcb033b52911d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:34.959010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:34.959862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:34.961025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:34.961511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:34.975045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:35.002361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] MFA Rules not processed for user `150a196ea7894060b6abcb033b52911d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:35.004260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:35.097811 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1923/3843] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:35.115594 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1921/3844] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:36.002867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:36.004651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:36.101910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643dc57-2239-44f6-91a0-6455e3623839 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:36.110154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde6cd-b272-4246-961c-bc15d43a3467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:36.110902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde6cd-b272-4246-961c-bc15d43a3467 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:36.111188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde6cd-b272-4246-961c-bc15d43a3467 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:36.111458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde6cd-b272-4246-961c-bc15d43a3467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:36.122105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde6cd-b272-4246-961c-bc15d43a3467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:36.123800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde6cd-b272-4246-961c-bc15d43a3467 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:36.134528 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1924/3845] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:38.720552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:38.835052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386ff6-a3e3-4b54-867e-cf97c805cb7a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:38.840940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:38.845305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:38.846620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:38.847343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] PATH_INFO: `/v3/users/150a196ea7894060b6abcb033b52911d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:38.849533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] RBAC: Authorizing `identity:delete_user(user_id=150a196ea7894060b6abcb033b52911d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:38.852096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:39.350845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150a196ea7894060b6abcb033b52911d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:39.389250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150a196ea7894060b6abcb033b52911d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:39.420515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150a196ea7894060b6abcb033b52911d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:39.421390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150a196ea7894060b6abcb033b52911d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:39.422065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150a196ea7894060b6abcb033b52911d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:39.662587 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1922/3846] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:38 2022] DELETE /identity/v3/users/150a196ea7894060b6abcb033b52911d => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:39.668029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:39.668484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:39.668864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:39.741047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:39.743375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:39.933337 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1925/3847] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:40.004558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:40.010095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:40.212887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74773-ab78-41b3-8717-2a0f0563116a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:40.226464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:40.227732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:40.228672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:40.228775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:40.246280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:40.249199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:40.270167 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1923/3848] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:40.812036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:40.815200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:40.966213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ff1f2-5bd6-4c7f-a809-ce19f4028e80 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:40.975819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:40.976752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:40.977189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:40.977666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:40.980064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:40.996917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:40.999669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:41.028291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1926/3849] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:41.245548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:42.191367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:42.194325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:42.214719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40ccf-036c-4219-b9b0-33daca550acd service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:42.221458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:42.222611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:42.223596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:42.224319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] PATH_INFO: `/v3/users/cc1a9bccd86b4a3b881314fe5a1505ec` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:42.226755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1a9bccd86b4a3b881314fe5a1505ec)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:42.230184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:42.338575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:42.518739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:42.520833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:42.542899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26e7f-10d0-494e-8f67-8f7052830aba service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:42.577729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:42.578909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:42.579420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:42.580827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] PATH_INFO: `/v3/projects/5333697315e84535bea128ef30c49204` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:42.587402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5333697315e84535bea128ef30c49204)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:42.591054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:42.765742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1a9bccd86b4a3b881314fe5a1505ec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:42.806432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1a9bccd86b4a3b881314fe5a1505ec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:42.822554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1a9bccd86b4a3b881314fe5a1505ec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:42.823631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1a9bccd86b4a3b881314fe5a1505ec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:42.824771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2308ff1b-ac2d-45cb-b113-22e67cc952f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1a9bccd86b4a3b881314fe5a1505ec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:42.994915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5333697315e84535bea128ef30c49204', 'request_id': 'req-c701e322-ea07-4078-9dee-4765c49a8685'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:43.007952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5333697315e84535bea128ef30c49204', 'request_id': 'req-c701e322-ea07-4078-9dee-4765c49a8685'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:43.024205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5333697315e84535bea128ef30c49204', 'request_id': 'req-c701e322-ea07-4078-9dee-4765c49a8685'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:43.105941 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1924/3850] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:42 2022] DELETE /identity/v3/users/cc1a9bccd86b4a3b881314fe5a1505ec => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:43.309205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] The token cache is being invalidate because project 5333697315e84535bea128ef30c49204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:43.309650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:43.311333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c701e322-ea07-4078-9dee-4765c49a8685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:43.314759 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1927/3851] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:42 2022] DELETE /identity/v3/projects/5333697315e84535bea128ef30c49204 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:43.319766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:43.320307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:43.320307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:43.397794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:43.398801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:43.554704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:43.555247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:43.555433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:43.555627 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1925/3852] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:43.603212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:43.610330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:43.633422 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1928/3853] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:43.638043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:43.654258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dc221-6b96-463c-b7b5-e91aa1ad20cd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:43.667255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:43.668224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:43.668607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:43.669994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:43.671790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:43.672215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:43.676650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:43.718059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1926/3854] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:43.719805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:43.742675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca018-d1ba-4fe7-84fc-bc1f3acaa210 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:43.748598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:43.749232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:43.749517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:43.755703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:43.756616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:43.758804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:43.996813 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1929/3855] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:43 2022] POST /identity/v3/projects => generated 383 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:44.002582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:44.022861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56d091-445d-4571-9c07-966af77c5cbd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:44.088180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:44.092360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:44.118421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:44.119435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.119812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.120191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.121748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:44.127892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:44.255145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382cbb-a507-4ffa-8e52-f1e7ea0f17dc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:44.263782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:44.266211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.266511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.267780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] PATH_INFO: `/v3/projects/52acaef1cb324f4984b245e8378121b9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.269752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52acaef1cb324f4984b245e8378121b9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:44.272476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:44.342619 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1927/3856] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:44 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:44.344330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:44.358417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59c1c-2af0-46f5-b38e-6174f5fc5fe3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:44.366095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:44.367729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.368215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.368694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.370471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:44.381992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:44.416461 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1928/3857] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:44.417936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:44.434174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd96d-e0c6-44f0-8e53-00a759ff17da admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:44.442974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:44.443844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.444314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.444751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.445573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:44.447815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:44.467886 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1929/3858] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:44.469292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:44.482790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f3460-7a65-4463-a792-e7684649ec8c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:44.488976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75384e5-a683-4516-a59f-7bc0d0fbb5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:44.490056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75384e5-a683-4516-a59f-7bc0d0fbb5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.490552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75384e5-a683-4516-a59f-7bc0d0fbb5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.491031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75384e5-a683-4516-a59f-7bc0d0fbb5d8 admin admin] PATH_INFO: `/v3/projects/de7e762a0aa94cb9a0b1741de3a41470/users/0d4ee7b208bb436baa43f80e53276c5c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.527326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75384e5-a683-4516-a59f-7bc0d0fbb5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7e762a0aa94cb9a0b1741de3a41470, user_id=0d4ee7b208bb436baa43f80e53276c5c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:44.531748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75384e5-a683-4516-a59f-7bc0d0fbb5d8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:44.540216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52acaef1cb324f4984b245e8378121b9', 'request_id': 'req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:44.548561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52acaef1cb324f4984b245e8378121b9', 'request_id': 'req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:44.557737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52acaef1cb324f4984b245e8378121b9', 'request_id': 'req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:44.701129 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1930/3859] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:44 2022] PUT /identity/v3/projects/de7e762a0aa94cb9a0b1741de3a41470/users/0d4ee7b208bb436baa43f80e53276c5c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:44.707160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.707160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.707934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.736784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] The token cache is being invalidate because project 52acaef1cb324f4984b245e8378121b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:44.737268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:44.738079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a1164a9-9baf-4c2e-9884-1a418d0d7a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:44.739716 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1930/3860] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:44 2022] DELETE /identity/v3/projects/52acaef1cb324f4984b245e8378121b9 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:44.745009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5563dc-9c35-47f0-9e57-34ecf27ce6f8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.745819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5563dc-9c35-47f0-9e57-34ecf27ce6f8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.746374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5563dc-9c35-47f0-9e57-34ecf27ce6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.751235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] MFA Rules not processed for user `0d4ee7b208bb436baa43f80e53276c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:44.752781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:44.781244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3b5563dc-9c35-47f0-9e57-34ecf27ce6f8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:44.784980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3b5563dc-9c35-47f0-9e57-34ecf27ce6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:44.882400 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1931/3861] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:44.896203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:44.896505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:44.898637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:44.912671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1931/3862] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:44.939403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:44.942811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:44.973392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:44.977345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:44.993978 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1932/3863] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:45.001052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:45.030142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068992-4eec-4bbf-a2e7-b0004a20414b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.040786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.048064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.048064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.048064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.048064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:45.048064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.054762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.100603 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1933/3864] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:06:45.108193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:45.137833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbe50f-b296-4202-9e8e-bf8a246a3b71 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.148474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.149402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.149899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.150444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.151768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.153607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900df01-10f5-45fd-9135-af5c8161cee6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.154601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.159541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.160379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.168497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.168497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.175202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.179022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.201657 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1932/3865] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:45.338086 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1934/3866] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:45 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:45.340326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:45.355672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae206c8-c23b-4dd4-ad33-37dd5fbeb65f service glance] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.443676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.444324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.447873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.447873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.447873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.449533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.614710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1933/3867] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:45 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:06:45.619129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:45.631887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecadff-2ef8-4c98-aa6c-fcb26b00944b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.639740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.640556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.641041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.641650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.642504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.644870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.663028 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1935/3868] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:45.664051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:45.677665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8b35-f357-4324-b38a-edec921eda0d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.683662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b8db-f155-4dab-ba69-9f300bc0e396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.684351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b8db-f155-4dab-ba69-9f300bc0e396 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.685754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b8db-f155-4dab-ba69-9f300bc0e396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.685754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b8db-f155-4dab-ba69-9f300bc0e396 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.686291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7b8db-f155-4dab-ba69-9f300bc0e396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.688198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7b8db-f155-4dab-ba69-9f300bc0e396 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.724913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1934/3869] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:45.728938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:45.755395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce15e8-546c-4cab-8931-9bba4c4a9ce6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:45.775434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:45.776133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.776430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.776688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] PATH_INFO: `/v3/projects/70e091e467644ee387e57f1801e9cc83/users/44d4d778a2f149e1ae5d96280a7e01cc/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.802002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e091e467644ee387e57f1801e9cc83, user_id=44d4d778a2f149e1ae5d96280a7e01cc, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:45.805671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:45.911234 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1936/3870] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:45 2022] PUT /identity/v3/projects/70e091e467644ee387e57f1801e9cc83/users/44d4d778a2f149e1ae5d96280a7e01cc/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:45.918915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8ba70-222d-4520-8b1a-f24db7023c24 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:45.919511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8ba70-222d-4520-8b1a-f24db7023c24 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:45.919899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8ba70-222d-4520-8b1a-f24db7023c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:45.988390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e1c8ba70-222d-4520-8b1a-f24db7023c24 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:45.988390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1c8ba70-222d-4520-8b1a-f24db7023c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:46.101592 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1935/3871] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:46.157152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:46.158954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:46.273402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936828b5-6063-4cbc-8e5d-fde0b5d269fc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:46.277584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:46.278516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:46.279034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:46.279486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:46.292259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:46.294814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:46.307405 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1937/3872] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:46.731625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babd53-49eb-4cf8-a712-a25c0e89b48c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:46.731625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babd53-49eb-4cf8-a712-a25c0e89b48c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:46.731625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babd53-49eb-4cf8-a712-a25c0e89b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:46.776948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-09babd53-49eb-4cf8-a712-a25c0e89b48c None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:46.779284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-09babd53-49eb-4cf8-a712-a25c0e89b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:46.907628 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1936/3873] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:06:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:46.994819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:47.080774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:47.081947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:47.192175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0933-3e2e-4ffb-8e9d-61d91017d645 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:47.206650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:47.207543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:47.207888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:47.208097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:47.228126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:47.231936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:47.255966 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1938/3874] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:06:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:06:48.362365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:49.721905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:49.722520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:49.722520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:49.764080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:49.767296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:49.788052 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1937/3875] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:06:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:49.802534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:49.821111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76025-4d51-4b3c-a3f4-52b75f0760bb service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:49.828138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393b9d3-e63a-465a-a7cd-f67d72d72dc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:49.828999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393b9d3-e63a-465a-a7cd-f67d72d72dc6 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:49.829481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393b9d3-e63a-465a-a7cd-f67d72d72dc6 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:49.830040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393b9d3-e63a-465a-a7cd-f67d72d72dc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:49.843497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393b9d3-e63a-465a-a7cd-f67d72d72dc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:49.845751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393b9d3-e63a-465a-a7cd-f67d72d72dc6 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:49.860165 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1939/3876] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:06:51.131988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:51.776620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:51.779813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:51.816680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aca292-2a95-44b3-8bfd-3dd779ca9205 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:51.830467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:51.831828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:51.832568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:51.833321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] PATH_INFO: `/v3/users/3ea997629e1243deae2ca0231fb5a113` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:51.836107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea997629e1243deae2ca0231fb5a113)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:51.840586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:51.938781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:51.940109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:51.940554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:51.964764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:51.966592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:51.978109 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1940/3877] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:06:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:51.993967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:52.011906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68879-9f1e-4dbe-b846-46909c464a7a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:52.019002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827260-dcbb-43d6-8702-0d1967492de0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:52.020024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827260-dcbb-43d6-8702-0d1967492de0 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:52.020465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827260-dcbb-43d6-8702-0d1967492de0 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:52.020892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827260-dcbb-43d6-8702-0d1967492de0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:52.042861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827260-dcbb-43d6-8702-0d1967492de0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:52.045623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827260-dcbb-43d6-8702-0d1967492de0 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:52.070742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1941/3878] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:06:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:06:52.213224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea997629e1243deae2ca0231fb5a113'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:52.239084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea997629e1243deae2ca0231fb5a113'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:52.247804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea997629e1243deae2ca0231fb5a113'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:52.248666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea997629e1243deae2ca0231fb5a113'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:52.249406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea997629e1243deae2ca0231fb5a113'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:52.402567 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1938/3879] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:51 2022] DELETE /identity/v3/users/3ea997629e1243deae2ca0231fb5a113 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:52.405081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d99d-ec79-4a26-8383-2e6e6e6482d7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:52.406244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d99d-ec79-4a26-8383-2e6e6e6482d7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:52.413222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d99d-ec79-4a26-8383-2e6e6e6482d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:52.433220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3924d99d-ec79-4a26-8383-2e6e6e6482d7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:52.435644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3924d99d-ec79-4a26-8383-2e6e6e6482d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:52.539515 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1942/3880] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:52.550877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:52.552818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:52.640513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fb6d-6a00-4582-923f-e67e9c2bb310 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:52.646780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:52.654476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:52.654476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:52.654476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:52.666350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:52.668561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:52.689466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1939/3881] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:52.822618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:52.823234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:52.823696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:52.847049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] MFA Rules not processed for user `0d4ee7b208bb436baa43f80e53276c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:52.848338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:52.926088 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1943/3882] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:53.085167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:53.086945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:53.112214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd448e-dfbd-42d6-a865-819b6d9c7908 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:53.128948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:53.129792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:53.130101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:53.130481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] PATH_INFO: `/v3/projects/802e13a5eb004f678ebe79b8d12ed934` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:53.132797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=802e13a5eb004f678ebe79b8d12ed934)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:53.134860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:53.388248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802e13a5eb004f678ebe79b8d12ed934', 'request_id': 'req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:53.428834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802e13a5eb004f678ebe79b8d12ed934', 'request_id': 'req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:53.452872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802e13a5eb004f678ebe79b8d12ed934', 'request_id': 'req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:53.532240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:53.612128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] The token cache is being invalidate because project 802e13a5eb004f678ebe79b8d12ed934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:53.612427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:53.618457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-68536ce4-9c0b-4e13-b320-cc2c5a3f6a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:53.621319 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1940/3883] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:53 2022] DELETE /identity/v3/projects/802e13a5eb004f678ebe79b8d12ed934 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:53.625976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:53.643361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526f581-0ca2-4a02-acdb-9e5e67a7cc8f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:53.701883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:53.702161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:53.702447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:53.768574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] MFA Rules not processed for user `0d4ee7b208bb436baa43f80e53276c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:53.769530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:53.895799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:53.902719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:53.905373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:53.906343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] PATH_INFO: `/v3/users/80314f25c2f44d16aef6a53ff52a6038` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:53.910479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80314f25c2f44d16aef6a53ff52a6038)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:53.914114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:53.963323 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1941/3884] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:06:54.264816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80314f25c2f44d16aef6a53ff52a6038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:54.265520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80314f25c2f44d16aef6a53ff52a6038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:54.357589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80314f25c2f44d16aef6a53ff52a6038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:54.366724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80314f25c2f44d16aef6a53ff52a6038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:54.367573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5635bcb7-5324-4a99-b20c-634010a80a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80314f25c2f44d16aef6a53ff52a6038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:54.392786 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1944/3885] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:06:53 2022] DELETE /identity/v3/users/80314f25c2f44d16aef6a53ff52a6038 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:54.452202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:54.820953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:54.822281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:54.867560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bcdec-b1db-40e9-abee-4ccb97534a4e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:54.966359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:54.967530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:54.968705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:54.969257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] PATH_INFO: `/v3/projects/0033f72b27f74afd89afdc020a98bf86` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:54.983407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0033f72b27f74afd89afdc020a98bf86)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:54.991209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:55.243693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0033f72b27f74afd89afdc020a98bf86', 'request_id': 'req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:55.250398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0033f72b27f74afd89afdc020a98bf86', 'request_id': 'req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:55.258712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0033f72b27f74afd89afdc020a98bf86', 'request_id': 'req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:55.452643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] The token cache is being invalidate because project 0033f72b27f74afd89afdc020a98bf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:06:55.453062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:55.455139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7df5831-abf3-4299-a25f-ccfd0ed48cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:06:55.458381 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1942/3886] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:06:54 2022] DELETE /identity/v3/projects/0033f72b27f74afd89afdc020a98bf86 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:55.471625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:55.473603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:55.474516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:55.739902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:55.741538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:55.822537 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1945/3887] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:55.830892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:55.831463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:55.831463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:55.853783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:55.858659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:55.873262 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1943/3888] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:55.925828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:55.927777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424af2-6e58-4dec-95e1-e00bbb2ebd5a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:55.936170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:55.936944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:55.937315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:55.938115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:55.938928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:06:55.939510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:55.941650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:55.956015 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1946/3889] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:06:55.961323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:55.972557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0c11e-ea02-4c10-a6c0-2ff8416e0e2f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:55.978062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:55.978708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:55.979311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:55.979768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:55.980476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:55.983019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:56.352794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1944/3890] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:55 2022] POST /identity/v3/projects => generated 385 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:56.357664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:56.370399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac77d4-6e84-4a7e-a4f2-d76fb67d4853 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:56.484301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:56.485981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:56.486556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:56.487096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:56.488869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:56.491707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:56.762246 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1947/3891] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:56 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:56.767904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:56.783753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a776134-b431-46e1-aa62-97f1fa4e4353 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:56.802656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:56.806353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:56.807002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:56.807715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:56.810942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:56.818863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:56.851466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1945/3892] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:56.855570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:56.893052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c27bd-0532-437a-8fdf-586a556f46ac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:56.964945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76de2-d629-41a1-b6e0-271b3c30a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:56.968563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76de2-d629-41a1-b6e0-271b3c30a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:56.968890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76de2-d629-41a1-b6e0-271b3c30a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:56.974450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76de2-d629-41a1-b6e0-271b3c30a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:56.976950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea76de2-d629-41a1-b6e0-271b3c30a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:56.987650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea76de2-d629-41a1-b6e0-271b3c30a0dc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:57.030950 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1948/3893] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:57.035677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:57.131783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1c188-f611-4c2e-b426-a42853f00d2a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:57.182604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:57.183305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:57.188676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:57.189038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] PATH_INFO: `/v3/projects/23f5b3a680e04ad5ad897e16f9e1e460/users/1a6189849289415ca2e96cf9667f8ac7/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:57.269640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f5b3a680e04ad5ad897e16f9e1e460, user_id=1a6189849289415ca2e96cf9667f8ac7, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:57.276414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:57.405412 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1946/3894] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:57 2022] PUT /identity/v3/projects/23f5b3a680e04ad5ad897e16f9e1e460/users/1a6189849289415ca2e96cf9667f8ac7/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:57.420257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:57.421083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:57.421544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:57.524854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] MFA Rules not processed for user `1a6189849289415ca2e96cf9667f8ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:57.527042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:57.657460 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1949/3895] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:57.663077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:57.809648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168e0da-63f2-4d3d-88ef-1f764e84f78b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:57.818983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:57.820035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:57.821317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:57.822018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:57.823291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:57.825580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:58.076827 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1947/3896] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:06:57 2022] POST /identity/v3/projects => generated 381 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:58.084430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:58.116255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1fcb-2222-4093-9e5e-5dee70be587b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:58.248324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:58.248324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:58.248653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:58.248773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:58.249957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:58.252350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:58.434882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1950/3897] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:06:58 2022] POST /identity/v3/users => generated 297 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:06:58.441556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:58.461129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac948df-ef4d-4c54-bbc9-a58c0df7625b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:58.471235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:58.473530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:58.473530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:58.473799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:58.474376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:58.480295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:58.514423 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1948/3898] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:58.517680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:58.534901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f391b9-1bd9-4d5e-8443-f4c9dc555623 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:58.548677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:58.549677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:58.551599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:58.552276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] PATH_INFO: `/v3/projects/cd80762025be4dfcb54480caf390e5fd/users/19e5f5edb42e46f89c114637fb5c389f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:58.573205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd80762025be4dfcb54480caf390e5fd, user_id=19e5f5edb42e46f89c114637fb5c389f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:58.576951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:58.850957 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1951/3899] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:58 2022] PUT /identity/v3/projects/cd80762025be4dfcb54480caf390e5fd/users/19e5f5edb42e46f89c114637fb5c389f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:06:58.852394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:58.886338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a85a0-3c21-43a4-9500-ca11efe9e013 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:59.112380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0875-95a2-49e4-817b-ee6f55cb797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:59.112380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0875-95a2-49e4-817b-ee6f55cb797f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:59.114923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0875-95a2-49e4-817b-ee6f55cb797f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:59.116613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0875-95a2-49e4-817b-ee6f55cb797f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:59.118411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0875-95a2-49e4-817b-ee6f55cb797f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:59.121982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0875-95a2-49e4-817b-ee6f55cb797f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:59.163697 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1949/3900] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:06:59.167969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:59.188494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403961-f9d2-484f-a67c-e1b5d23b331e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:59.217763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:59.218630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:59.219015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:59.219414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] PATH_INFO: `/v3/projects/cd80762025be4dfcb54480caf390e5fd/users/19e5f5edb42e46f89c114637fb5c389f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:59.230839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd80762025be4dfcb54480caf390e5fd, user_id=19e5f5edb42e46f89c114637fb5c389f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:59.236594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:59.280731 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1952/3901] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:06:59 2022] PUT /identity/v3/projects/cd80762025be4dfcb54480caf390e5fd/users/19e5f5edb42e46f89c114637fb5c389f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:06:59.282556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79639060-9eba-4260-a8cf-8e3dfc055f0e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:59.282850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79639060-9eba-4260-a8cf-8e3dfc055f0e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:59.283127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79639060-9eba-4260-a8cf-8e3dfc055f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:59.365584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-79639060-9eba-4260-a8cf-8e3dfc055f0e None None] MFA Rules not processed for user `19e5f5edb42e46f89c114637fb5c389f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:59.367227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-79639060-9eba-4260-a8cf-8e3dfc055f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:59.561979 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1950/3902] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:59.562197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:59.564920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:59.580815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:59.581122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:59.581391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:59.672606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] MFA Rules not processed for user `44d4d778a2f149e1ae5d96280a7e01cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:59.679488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:59.767592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ff00e-9578-43d4-af43-d573a8fc2623 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:59.782422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:59.783413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:59.783950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:59.784118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:59.788725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:59.853968 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1951/3903] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:59.856002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:59.859352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:59.946423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:59.949457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd70e74-ecea-46a7-b797-e50d96516840 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:59.974253 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1953/3904] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:00.030701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d01f-3b71-439e-92cb-9e6232d0410e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:00.044315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8689b-9313-4153-ab61-8360c8d4c4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:00.049358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8689b-9313-4153-ab61-8360c8d4c4bc service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:00.049358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8689b-9313-4153-ab61-8360c8d4c4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:00.049358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8689b-9313-4153-ab61-8360c8d4c4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:00.073305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8689b-9313-4153-ab61-8360c8d4c4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:00.073703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8689b-9313-4153-ab61-8360c8d4c4bc service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:00.099414 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1952/3905] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:01.713113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:02.438882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:03.480335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:04.362586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa12969-1ca7-44ff-a414-51f5345f732b None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:04.363163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa12969-1ca7-44ff-a414-51f5345f732b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:04.363163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa12969-1ca7-44ff-a414-51f5345f732b None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:04.365536 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1954/3906] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:07:04.370689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:04.370978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:04.371795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:04.456733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:04.461565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:04.469836 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1953/3907] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:07:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:04.534382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa12969-1ca7-44ff-a414-51f5345f732b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:04.535448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bfa12969-1ca7-44ff-a414-51f5345f732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:04.564078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa12969-1ca7-44ff-a414-51f5345f732b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:04.569715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:04.576016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:04.576016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:04.576016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:04.583061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:04.584939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:04.595868 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1955/3908] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:05.941449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:05.946788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:06.070768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d6fe-ac1d-4cfc-8196-34bd1cd47ec8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:06.077560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:06.078647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:06.079101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:06.079608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] PATH_INFO: `/v3/users/4c0e404e10ed4d7eaf2b8825b444d1f2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:06.082795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0e404e10ed4d7eaf2b8825b444d1f2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:06.085014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:06.489243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0e404e10ed4d7eaf2b8825b444d1f2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:06.529042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0e404e10ed4d7eaf2b8825b444d1f2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:06.542863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0e404e10ed4d7eaf2b8825b444d1f2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:06.544503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0e404e10ed4d7eaf2b8825b444d1f2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:06.545623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9325fc6e-3570-4fc3-b040-ae3b22274dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0e404e10ed4d7eaf2b8825b444d1f2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:06.680802 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1954/3909] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:05 2022] DELETE /identity/v3/users/4c0e404e10ed4d7eaf2b8825b444d1f2 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:08.040660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:08.064243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9b2b-9230-4b7a-aee6-de978b8ae420 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:08.169651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:08.170926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:08.171508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:08.172103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] PATH_INFO: `/v3/projects/a159c1a1434347748a4b836d3e5f0efe` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:08.174142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a159c1a1434347748a4b836d3e5f0efe)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:08.190694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:08.353925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a159c1a1434347748a4b836d3e5f0efe', 'request_id': 'req-e2e692dd-418f-48e8-8547-f31f684231f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:08.364155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a159c1a1434347748a4b836d3e5f0efe', 'request_id': 'req-e2e692dd-418f-48e8-8547-f31f684231f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:08.382535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a159c1a1434347748a4b836d3e5f0efe', 'request_id': 'req-e2e692dd-418f-48e8-8547-f31f684231f0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:08.504506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] The token cache is being invalidate because project a159c1a1434347748a4b836d3e5f0efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:08.505377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:08.506682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2e692dd-418f-48e8-8547-f31f684231f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:08.514483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:08.514956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:08.515169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:08.530811 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1956/3910] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:08 2022] DELETE /identity/v3/projects/a159c1a1434347748a4b836d3e5f0efe => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:08.551688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:08.553168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:08.696800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1955/3911] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:08.706775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:08.707066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:08.707345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:08.735434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:08.737059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:08.750886 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1957/3912] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:08.755345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:08.773515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a67a9-aec1-4b20-8334-94cd91c2a11f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:08.780500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:08.782089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:08.782759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:08.784284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:08.785422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:08.794707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:08.798105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:08.830177 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1956/3913] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:08.835978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:08.858296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de990-f205-47a9-b25b-a46da4bf9df0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:08.866973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:08.868222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:08.868523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:08.868923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:08.869706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:08.872693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:09.070084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1958/3914] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:08 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:09.075767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:09.118973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d9ef-dab1-4c07-91b2-6d75138534d8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:09.332153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43045e7-0933-46d1-9417-080ce49cb205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:09.332933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43045e7-0933-46d1-9417-080ce49cb205 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:09.333517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43045e7-0933-46d1-9417-080ce49cb205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:09.334068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43045e7-0933-46d1-9417-080ce49cb205 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:09.334827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43045e7-0933-46d1-9417-080ce49cb205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:09.337141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43045e7-0933-46d1-9417-080ce49cb205 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:09.511820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1957/3915] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:09 2022] POST /identity/v3/users => generated 284 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:09.513926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:09.535298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9656-5858-4983-b4df-a12acdcf600c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:09.566918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:09.570238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:09.570238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:09.572833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:09.578804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:09.589909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:09.634962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e4060-bfb6-4a3a-8d4b-dfc61d40aea6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:09.635560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e4060-bfb6-4a3a-8d4b-dfc61d40aea6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:09.635910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e4060-bfb6-4a3a-8d4b-dfc61d40aea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:09.679105 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1959/3916] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:09.681702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:09.717668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8f6e4060-bfb6-4a3a-8d4b-dfc61d40aea6 None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:09.721474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8f6e4060-bfb6-4a3a-8d4b-dfc61d40aea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:09.741974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:09.741974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dcc0-9b86-47f5-ab83-b89265a7548a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:09.756409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:09.757194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:09.758193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:09.759149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:09.760441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:09.764240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:09.821704 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1960/3917] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:09.825269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:09.840960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e5bc-7a83-46ae-b153-213538615074 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:09.850083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:09.853030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:09.853476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:09.853764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] PATH_INFO: `/v3/projects/28d057c8fdf747988db165403edc2593/users/af4c64fac1e74e8aa06cc7483b12cf02/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:09.887856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d057c8fdf747988db165403edc2593, user_id=af4c64fac1e74e8aa06cc7483b12cf02, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:09.900303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:10.009898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1958/3918] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:10.070776 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1961/3919] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:09 2022] PUT /identity/v3/projects/28d057c8fdf747988db165403edc2593/users/af4c64fac1e74e8aa06cc7483b12cf02/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:07:10.079813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:10.080027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:10.080300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:10.111189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:10.115008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:10.359193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:10.362605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:10.378825 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1959/3920] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:10.389576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70b18-ad15-4567-a7ea-eee491ca4883 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:10.396619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:10.398245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:10.398832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:10.399667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:10.399956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:10.400234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] PATH_INFO: `/v3/users/1a6189849289415ca2e96cf9667f8ac7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:10.404539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6189849289415ca2e96cf9667f8ac7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:10.406760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:10.607858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf0ee-f33c-4351-b85e-40370b00b114 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:10.619958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213dab-98fa-49ba-bf12-16a19206a1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:10.620734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213dab-98fa-49ba-bf12-16a19206a1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:10.621076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213dab-98fa-49ba-bf12-16a19206a1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:10.621361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213dab-98fa-49ba-bf12-16a19206a1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:10.635003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e213dab-98fa-49ba-bf12-16a19206a1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:10.639741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e213dab-98fa-49ba-bf12-16a19206a1c9 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:10.654948 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1960/3921] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:10.766109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:10.849055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6189849289415ca2e96cf9667f8ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:10.849797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6189849289415ca2e96cf9667f8ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:10.987715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6189849289415ca2e96cf9667f8ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:10.992758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6189849289415ca2e96cf9667f8ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:10.998464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6189849289415ca2e96cf9667f8ac7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:11.035651 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1962/3922] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:10 2022] DELETE /identity/v3/users/1a6189849289415ca2e96cf9667f8ac7 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:07:11.041383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1d219-310e-478d-994e-d36dde380cef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:11.041674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1d219-310e-478d-994e-d36dde380cef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:11.041961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1d219-310e-478d-994e-d36dde380cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:11.069054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eae1d219-310e-478d-994e-d36dde380cef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:11.072012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eae1d219-310e-478d-994e-d36dde380cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:11.263512 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1961/3923] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:11.326696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:11.330085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:11.363796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1d219-310e-478d-994e-d36dde380cef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:11.365243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eae1d219-310e-478d-994e-d36dde380cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:11.452898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819cc2-19ec-49c5-863a-b7b589d83585 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:11.462951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:11.463995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:11.464471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:11.464937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:11.505378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:11.508174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:11.539691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1d219-310e-478d-994e-d36dde380cef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:11.545956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:11.552233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:11.552683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:11.553075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] PATH_INFO: `/v3/users/44d4d778a2f149e1ae5d96280a7e01cc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:11.554681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d4d778a2f149e1ae5d96280a7e01cc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:11.556941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:11.563572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1963/3924] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:11.933579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d4d778a2f149e1ae5d96280a7e01cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:11.948774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d4d778a2f149e1ae5d96280a7e01cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:11.957931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d4d778a2f149e1ae5d96280a7e01cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:11.958718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d4d778a2f149e1ae5d96280a7e01cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:11.959424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d4d778a2f149e1ae5d96280a7e01cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:12.155227 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1962/3925] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:11 2022] DELETE /identity/v3/users/44d4d778a2f149e1ae5d96280a7e01cc => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:07:12.796261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:12.854399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45b091-bf01-4f06-b469-3498f4e160a5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:12.934556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:12.935608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:12.936057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:12.936552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] PATH_INFO: `/v3/projects/70e091e467644ee387e57f1801e9cc83` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:12.938248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e091e467644ee387e57f1801e9cc83)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:12.940965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:13.034591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:13.036410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:13.063231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992bdc-8d07-4664-ae74-99916a01aa66 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:13.082008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:13.082692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.083724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.084038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] PATH_INFO: `/v3/projects/23f5b3a680e04ad5ad897e16f9e1e460` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.085342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f5b3a680e04ad5ad897e16f9e1e460)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:13.087593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:13.161894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e091e467644ee387e57f1801e9cc83', 'request_id': 'req-124586ac-dcd4-477a-9d0b-dc790041e0c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.171031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e091e467644ee387e57f1801e9cc83', 'request_id': 'req-124586ac-dcd4-477a-9d0b-dc790041e0c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.180286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e091e467644ee387e57f1801e9cc83', 'request_id': 'req-124586ac-dcd4-477a-9d0b-dc790041e0c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.243422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f5b3a680e04ad5ad897e16f9e1e460', 'request_id': 'req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.251312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f5b3a680e04ad5ad897e16f9e1e460', 'request_id': 'req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.259470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f5b3a680e04ad5ad897e16f9e1e460', 'request_id': 'req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.315756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] The token cache is being invalidate because project 70e091e467644ee387e57f1801e9cc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:13.316059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.316746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-124586ac-dcd4-477a-9d0b-dc790041e0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.323955 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1964/3926] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:12 2022] DELETE /identity/v3/projects/70e091e467644ee387e57f1801e9cc83 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:13.325216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f37d39-57d0-4e89-a7b4-14f8a7c8ccef None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.325508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f37d39-57d0-4e89-a7b4-14f8a7c8ccef None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.326001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f37d39-57d0-4e89-a7b4-14f8a7c8ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.368941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-19f37d39-57d0-4e89-a7b4-14f8a7c8ccef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:13.369826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19f37d39-57d0-4e89-a7b4-14f8a7c8ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:13.400166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] The token cache is being invalidate because project 23f5b3a680e04ad5ad897e16f9e1e460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:13.408570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.408570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.409917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1963/3927] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:13 2022] DELETE /identity/v3/projects/23f5b3a680e04ad5ad897e16f9e1e460 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:13.411159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:13.412886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:13.474087 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1965/3928] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:13.480139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.480573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.480860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.515219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:13.517446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:13.535148 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1966/3929] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:13.536531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:13.539883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3b80-714b-4ab2-ba55-a954a9cb4b26 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:13.546057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:13.547101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.547301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.547585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] PATH_INFO: `/v3/users/19e5f5edb42e46f89c114637fb5c389f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.548805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e5f5edb42e46f89c114637fb5c389f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:13.550390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff2605-adcb-4675-a069-f6aa73964c01 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:13.552307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:13.558235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:13.558986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.559267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.559542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.560227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:13.560527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:13.564760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:13.581953 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1967/3930] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:13.587068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:13.598278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd84a4-0c16-46f8-a554-b935a5e2920d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:13.606370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:13.606996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.607273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.607542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.608252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:13.610187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:13.790099 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1968/3931] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:13.794825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:13.883146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e5f5edb42e46f89c114637fb5c389f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.918269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e5f5edb42e46f89c114637fb5c389f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.929836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e5f5edb42e46f89c114637fb5c389f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.930818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e5f5edb42e46f89c114637fb5c389f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.931538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e5f5edb42e46f89c114637fb5c389f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:13.959014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c51e-a709-4d42-b4b8-123d4901cca5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:13.971284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:13.975821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:13.975821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:13.975821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:13.976551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:13.993384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:14.036222 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1964/3932] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:13 2022] DELETE /identity/v3/users/19e5f5edb42e46f89c114637fb5c389f => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:14.185393 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1969/3933] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:13 2022] POST /identity/v3/users => generated 293 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:14.189778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:14.191693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:14.344985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664af91-4edb-406b-8ae1-b63a19fda3e1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:14.361260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:14.363097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:14.366257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:14.366554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:14.367346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:14.369026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:14.398426 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1965/3934] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:14.400605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:14.415541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbd15-cbef-4621-bf05-788567c650a2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:14.427576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085e09f-a630-4421-b7aa-15ba83aed638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:14.427576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085e09f-a630-4421-b7aa-15ba83aed638 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:14.427576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085e09f-a630-4421-b7aa-15ba83aed638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:14.427576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085e09f-a630-4421-b7aa-15ba83aed638 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:14.428409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085e09f-a630-4421-b7aa-15ba83aed638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:14.429676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085e09f-a630-4421-b7aa-15ba83aed638 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:14.447934 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1970/3935] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:14.460385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:14.483424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeced3e-93be-4fcb-98ae-68bbb9698ce5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:14.495117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:14.497480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:14.498640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:14.499922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] PATH_INFO: `/v3/projects/5f430d2f2eb84bdeb339a27f480c44b0/users/7650a09fce6b4cdca778c6c77609b103/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:14.570121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f430d2f2eb84bdeb339a27f480c44b0, user_id=7650a09fce6b4cdca778c6c77609b103, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:14.580327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:14.773716 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1966/3936] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:14 2022] PUT /identity/v3/projects/5f430d2f2eb84bdeb339a27f480c44b0/users/7650a09fce6b4cdca778c6c77609b103/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:14.785235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:14.785480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:14.785661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:14.817299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] MFA Rules not processed for user `7650a09fce6b4cdca778c6c77609b103`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:14.819022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:14.915538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:14.917763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:14.922344 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1971/3937] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:14.923365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:14.930981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:15.098995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171c5b-d8a1-4150-8f27-804bc339e3d7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:15.112962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:15.114271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:15.114562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:15.114842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] PATH_INFO: `/v3/projects/cd80762025be4dfcb54480caf390e5fd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:15.116431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd80762025be4dfcb54480caf390e5fd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:15.118695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:15.197028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375cbf9-face-415c-8f89-924001aa4a55 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:15.228936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc5b29-5650-4b25-b4a3-67560e697c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:15.229911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5b29-5650-4b25-b4a3-67560e697c63 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:15.231217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5b29-5650-4b25-b4a3-67560e697c63 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:15.231784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5b29-5650-4b25-b4a3-67560e697c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:15.270441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc5b29-5650-4b25-b4a3-67560e697c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:15.286670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc5b29-5650-4b25-b4a3-67560e697c63 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:15.321153 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1972/3938] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:15.400411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd80762025be4dfcb54480caf390e5fd', 'request_id': 'req-e75c5372-d779-466c-ac3d-3b3bc81682bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:15.438303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd80762025be4dfcb54480caf390e5fd', 'request_id': 'req-e75c5372-d779-466c-ac3d-3b3bc81682bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:15.461975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd80762025be4dfcb54480caf390e5fd', 'request_id': 'req-e75c5372-d779-466c-ac3d-3b3bc81682bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:15.574348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] The token cache is being invalidate because project cd80762025be4dfcb54480caf390e5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:15.575012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:15.577778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e75c5372-d779-466c-ac3d-3b3bc81682bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:15.582692 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1967/3939] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:14 2022] DELETE /identity/v3/projects/cd80762025be4dfcb54480caf390e5fd => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:15.588166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:15.590046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:15.590645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:15.702038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:15.704118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:15.842118 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1973/3940] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:15.851244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:15.851669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:15.852132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:15.921697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:15.923393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:15.939361 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1968/3941] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:15.943161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:15.960213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c373f-d9e2-4fbe-89b2-2b2af0d7118a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:15.967908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:15.969191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:15.979664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:15.979664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:15.979664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:15.979664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:15.979664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:15.995053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1974/3942] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:16.000527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:16.017394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930781-c0da-40f9-8c75-eb1b6fde8c10 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:16.025174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:16.029494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:16.030158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:16.030652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:16.034631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:16.038461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:16.124671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:16.223297 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1969/3943] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:15 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:16.228124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:16.256084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680edbbf-8823-471c-92fd-1fbc00233276 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:16.582961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:16.583705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:16.583990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:16.585222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:16.585365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:16.588292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:16.844030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1975/3944] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:16 2022] POST /identity/v3/users => generated 296 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:16.849914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:16.883011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67979a-00ab-44de-a125-4e0b1756946e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:16.900257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:16.903848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:16.906586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:16.909406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:16.911609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:16.922972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:16.960145 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1970/3945] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:16.968330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:17.020133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace7759-559f-4a08-a61f-52baefc88990 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:17.034606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7453a-7b9a-4d1b-a935-f858e9197934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:17.035416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7453a-7b9a-4d1b-a935-f858e9197934 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:17.035828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7453a-7b9a-4d1b-a935-f858e9197934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:17.036198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7453a-7b9a-4d1b-a935-f858e9197934 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:17.037126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7453a-7b9a-4d1b-a935-f858e9197934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:17.039983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7453a-7b9a-4d1b-a935-f858e9197934 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:17.059505 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1976/3946] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:17.068506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:17.090524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741e519-15e0-4cfc-917b-a6dc035748ab admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:17.100586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:17.102314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:17.122829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:17.124059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:17.127620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] PATH_INFO: `/v3/projects/f367fbfb49cc4645b0fdfea0739b1620/users/66d472031aeb40ae9a8ccc7d623fa208/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:17.169091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f367fbfb49cc4645b0fdfea0739b1620, user_id=66d472031aeb40ae9a8ccc7d623fa208, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:17.187353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:17.321735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1971/3947] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:17 2022] PUT /identity/v3/projects/f367fbfb49cc4645b0fdfea0739b1620/users/66d472031aeb40ae9a8ccc7d623fa208/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:17.345332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:17.346930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:17.348395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:17.426465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] MFA Rules not processed for user `66d472031aeb40ae9a8ccc7d623fa208`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:17.428631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:17.548980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:17.591270 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1977/3948] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:17.688401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:17.690561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:18.015766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23745049-e60e-41fa-baa2-611872e2731b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:18.027216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24045c-7651-4c0b-8041-940aa22cbf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:18.028122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24045c-7651-4c0b-8041-940aa22cbf82 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:18.028648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24045c-7651-4c0b-8041-940aa22cbf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:18.030322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24045c-7651-4c0b-8041-940aa22cbf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:18.048437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24045c-7651-4c0b-8041-940aa22cbf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:18.050567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24045c-7651-4c0b-8041-940aa22cbf82 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:18.075630 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1972/3949] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:07:18.916233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:20.695738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:21.084534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:22.580454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:22.582596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:22.719816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:22.763915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e4315-d469-4d13-910d-a0cf86065353 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:22.787732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:22.787732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:22.787732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:22.787732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] PATH_INFO: `/v3/users/12315ca7852d4f168f3f37e9d2ae184b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:22.796269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12315ca7852d4f168f3f37e9d2ae184b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:22.799811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:23.143891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12315ca7852d4f168f3f37e9d2ae184b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:23.145415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12315ca7852d4f168f3f37e9d2ae184b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:23.189386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:23.221030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12315ca7852d4f168f3f37e9d2ae184b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:23.230366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12315ca7852d4f168f3f37e9d2ae184b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:23.234570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12315ca7852d4f168f3f37e9d2ae184b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:23.284867 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1978/3950] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:22 2022] DELETE /identity/v3/users/12315ca7852d4f168f3f37e9d2ae184b => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:24.105120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a0125-4802-4e44-b4d5-43430017fee2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:24.105469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a0125-4802-4e44-b4d5-43430017fee2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:24.105884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a0125-4802-4e44-b4d5-43430017fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:24.127337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:24.130728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:24.149479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-616a0125-4802-4e44-b4d5-43430017fee2 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:24.150877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-616a0125-4802-4e44-b4d5-43430017fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:24.247959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43634-2e21-43b7-ae04-7bc92a69804b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:24.304250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:24.304975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:24.305635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:24.306108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] PATH_INFO: `/v3/projects/fc01b946ab004f14b610ca17218d6e71` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:24.307221 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1973/3951] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:24.309091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc01b946ab004f14b610ca17218d6e71)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:24.312514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:24.328819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:24.331939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:24.332316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:24.373077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:24.374572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:24.398279 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1974/3952] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:24.417116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:24.420197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:24.537912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc01b946ab004f14b610ca17218d6e71', 'request_id': 'req-229854d6-f488-4cea-8ade-7d2052be905c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:24.546811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc01b946ab004f14b610ca17218d6e71', 'request_id': 'req-229854d6-f488-4cea-8ade-7d2052be905c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:24.561490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc01b946ab004f14b610ca17218d6e71', 'request_id': 'req-229854d6-f488-4cea-8ade-7d2052be905c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:24.585664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8986-4f90-426c-bc31-54b129b646dc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:24.686116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] The token cache is being invalidate because project fc01b946ab004f14b610ca17218d6e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:24.693596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:24.693596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-229854d6-f488-4cea-8ade-7d2052be905c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:24.699741 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1979/3953] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:24 2022] DELETE /identity/v3/projects/fc01b946ab004f14b610ca17218d6e71 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:24.701462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:24.701760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:24.702063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:24.720455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:24.721093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:24.721373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:24.721648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:24.723578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:24.734377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:24.735902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:24.851237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:24.853486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d93899-0561-46c8-88c4-4800b9d54ac9 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:24.938729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1975/3954] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:24.954775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1980/3955] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:24.973385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:24.978860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:24.982185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.026293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:25.029060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:25.030971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:25.047348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:25.055442 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1976/3956] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:25.061805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c496fc-560a-4082-9ae1-637fe7675f30 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:25.070102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:25.070778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:25.072029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:25.078435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.078435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:25.078435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:25.078435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:25.098187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:25.109297 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1981/3957] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:25.110235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292161-699a-42aa-9994-1952b732a0d2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:25.117825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:25.118683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:25.119150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:25.119452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.129781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:25.129781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:25.286942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1977/3958] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:25 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:25.291765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:25.306440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39d2a-8076-41ce-bf8a-aa123a3baa3f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:25.499525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:25.500337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:25.500689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:25.500971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.501845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:25.504119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:25.703731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:25.704279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1982/3959] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:25 2022] POST /identity/v3/users => generated 291 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:25.720738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12becb3c-ea6d-4e4b-8f33-78be133a0363 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:25.738907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:25.739567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:25.739854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:25.740135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.740852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:25.751012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:25.792221 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1978/3960] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:07:25.793714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:25.809205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194dae-f00a-4791-812a-3b3830156f69 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:25.822714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2885-cb2e-4020-9dac-4f0b71d44f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:25.823344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2885-cb2e-4020-9dac-4f0b71d44f0b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:25.824206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2885-cb2e-4020-9dac-4f0b71d44f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:25.824486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2885-cb2e-4020-9dac-4f0b71d44f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.825145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d2885-cb2e-4020-9dac-4f0b71d44f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:25.827935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d2885-cb2e-4020-9dac-4f0b71d44f0b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:25.854708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:25.857332 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1983/3961] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:25.871691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95c65-ef1d-4d17-8f93-27c8ea32f977 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:25.903279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a78e0d-dece-4b0e-b270-2c7b2605e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:25.904661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a78e0d-dece-4b0e-b270-2c7b2605e897 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:25.909719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a78e0d-dece-4b0e-b270-2c7b2605e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:25.909719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a78e0d-dece-4b0e-b270-2c7b2605e897 admin admin] PATH_INFO: `/v3/projects/203692bd2bae4a1aabf78de445be8fe2/users/f88456d9616643598fcb8444ca9bac26/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:25.944636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a78e0d-dece-4b0e-b270-2c7b2605e897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203692bd2bae4a1aabf78de445be8fe2, user_id=f88456d9616643598fcb8444ca9bac26, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:25.947675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a78e0d-dece-4b0e-b270-2c7b2605e897 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:26.037476 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1979/3962] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:25 2022] PUT /identity/v3/projects/203692bd2bae4a1aabf78de445be8fe2/users/f88456d9616643598fcb8444ca9bac26/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:26.048713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:26.049205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:26.049502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:26.136691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] MFA Rules not processed for user `f88456d9616643598fcb8444ca9bac26`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:26.138243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:26.253382 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1984/3963] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:26.265398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09538bc-cfa2-470e-b754-5a99600787d4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:26.265750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09538bc-cfa2-470e-b754-5a99600787d4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:26.266054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09538bc-cfa2-470e-b754-5a99600787d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:26.291261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f09538bc-cfa2-470e-b754-5a99600787d4 None None] MFA Rules not processed for user `f88456d9616643598fcb8444ca9bac26`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:26.292922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f09538bc-cfa2-470e-b754-5a99600787d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:26.309434 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1980/3964] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:26.354487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:26.692742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:26.813963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:26.816091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:27.241706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c098f-208b-419c-8c46-17b107fd30ab None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:27.241706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:27.241706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:27.241706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:27.262646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:27.262646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:27.262646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:27.262646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1985/3965] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:07:30.508481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:31.283153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:31.288028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:31.288520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:31.407029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:31.412550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:31.480612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:31.605137 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1981/3966] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:07:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:31.623027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:31.626027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:31.918502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ed95b-6814-4ea3-a906-f905ce0d2829 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:31.934505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:31.939061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:31.939061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:31.939061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:31.952169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:31.955106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:31.977014 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1986/3967] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:07:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:07:34.237000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:34.641398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:34.643905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:34.806284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:34.807178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedf604-8f9f-450d-975f-f47bfd5d3003 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:34.807285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:34.816922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:34.818626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:34.818626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:34.824042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] PATH_INFO: `/v3/users/7650a09fce6b4cdca778c6c77609b103` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:34.828149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7650a09fce6b4cdca778c6c77609b103)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:34.836230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:34.837551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c759-4ae7-4310-a495-6161d55b09b8 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:34.844927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:34.873477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:34.873477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:34.873477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:34.873477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] PATH_INFO: `/v3/users/66d472031aeb40ae9a8ccc7d623fa208` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:34.874120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d472031aeb40ae9a8ccc7d623fa208)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:34.877941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:35.289769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7650a09fce6b4cdca778c6c77609b103'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.337648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d472031aeb40ae9a8ccc7d623fa208'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.337648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d472031aeb40ae9a8ccc7d623fa208'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.368538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7650a09fce6b4cdca778c6c77609b103'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.402451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7650a09fce6b4cdca778c6c77609b103'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.403662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7650a09fce6b4cdca778c6c77609b103'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.404483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a042466a-69cc-40d1-a2d4-a46187578634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7650a09fce6b4cdca778c6c77609b103'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.499943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d472031aeb40ae9a8ccc7d623fa208'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.516093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d472031aeb40ae9a8ccc7d623fa208'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.517243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-512da735-bfab-44ca-84e8-84d692e000a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d472031aeb40ae9a8ccc7d623fa208'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:35.585084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1987/3968] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:34 2022] DELETE /identity/v3/users/66d472031aeb40ae9a8ccc7d623fa208 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:35.591646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.593581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.595424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.601715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1982/3969] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:34 2022] DELETE /identity/v3/users/7650a09fce6b4cdca778c6c77609b103 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:35.603287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.603581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.603862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.639509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:35.646238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:35.655473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:35.656775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:35.788447 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1983/3970] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:35.810238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:35.814767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:35.817754 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1988/3971] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:35.904667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:35.906451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:35.932123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a95e9-257e-4c3a-8f9f-67685767e923 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:35.938888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:35.939844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.940239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.940621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.955408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:35.960726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:35.990170 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1984/3972] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:07:36.083110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a653d-af3b-4470-baf0-ac2a2aac53a0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:36.104030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47445b8-0032-4cfb-ade4-a9f56c3449e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:36.104793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47445b8-0032-4cfb-ade4-a9f56c3449e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:36.105078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47445b8-0032-4cfb-ade4-a9f56c3449e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:36.105355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47445b8-0032-4cfb-ade4-a9f56c3449e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:36.134699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47445b8-0032-4cfb-ade4-a9f56c3449e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:36.145671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47445b8-0032-4cfb-ade4-a9f56c3449e9 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:36.163073 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1989/3973] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:36.477212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:36.730425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:36.732624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:36.738947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:36.773033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2bd06-c574-4190-a5bc-5d3f09d1dabb service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:36.798749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:36.810650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:36.811935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:36.812458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] PATH_INFO: `/v3/projects/f367fbfb49cc4645b0fdfea0739b1620` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:36.814642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f367fbfb49cc4645b0fdfea0739b1620)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:36.817034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:37.069220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f367fbfb49cc4645b0fdfea0739b1620', 'request_id': 'req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:37.092875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f367fbfb49cc4645b0fdfea0739b1620', 'request_id': 'req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:37.113965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f367fbfb49cc4645b0fdfea0739b1620', 'request_id': 'req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:37.250055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] The token cache is being invalidate because project f367fbfb49cc4645b0fdfea0739b1620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:37.254989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:37.259665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c9aac42-b568-4484-9c5b-5c0d1dfcac5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:37.265642 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1985/3974] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:36 2022] DELETE /identity/v3/projects/f367fbfb49cc4645b0fdfea0739b1620 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:37.273634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:37.274441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:37.274441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:37.352655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:37.354408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:37.478477 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1990/3975] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:37.487095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:37.487095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:37.487095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:37.567616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:37.572442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:37.729943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:37.730368 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1986/3976] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:37.760709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b54d6-5883-4fce-bf2d-df6b0792f1a8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:37.770263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:37.771598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:37.772701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:37.773374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:37.774972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:37.776552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:37.786124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:37.816311 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1991/3977] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:37.822184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:37.865158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27452be0-7bfd-4a65-9269-55b62d1a619a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:37.915480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:37.921418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:37.922094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:37.923315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:37.923871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:37.928859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:37.935282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:37.947397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:37.960283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14985a8f-dae6-4201-b678-4fccdf364d85 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:37.979099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:37.980529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:37.980815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:37.981088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] PATH_INFO: `/v3/projects/5f430d2f2eb84bdeb339a27f480c44b0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:37.982893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f430d2f2eb84bdeb339a27f480c44b0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:37.984746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:38.259841 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1987/3978] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:37 2022] POST /identity/v3/projects => generated 373 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:38.263043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f430d2f2eb84bdeb339a27f480c44b0', 'request_id': 'req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:38.267068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:38.279375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f430d2f2eb84bdeb339a27f480c44b0', 'request_id': 'req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:38.295866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f430d2f2eb84bdeb339a27f480c44b0', 'request_id': 'req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:38.406041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] The token cache is being invalidate because project 5f430d2f2eb84bdeb339a27f480c44b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:38.406349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:38.411451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8b873e33-eb26-488f-8ea4-d0b3b08dfabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:38.418653 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1992/3979] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:37 2022] DELETE /identity/v3/projects/5f430d2f2eb84bdeb339a27f480c44b0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:38.433739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82fc3-e0d9-4889-bf15-fbf459e17f4b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.434167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82fc3-e0d9-4889-bf15-fbf459e17f4b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.434450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82fc3-e0d9-4889-bf15-fbf459e17f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.452457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1d952-ad57-406f-bce2-bc558df32e28 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:38.472982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:38.473634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.474013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.476557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.478706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:38.486001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:38.497126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-71d82fc3-e0d9-4889-bf15-fbf459e17f4b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:38.498692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-71d82fc3-e0d9-4889-bf15-fbf459e17f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:38.507939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1993/3980] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:38.519445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.519749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.520023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.549442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:38.552743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:38.588092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1994/3981] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:38.592547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:38.608120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da835f-8c5a-4fed-acd8-d3d14a1329e7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:38.614096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:38.615841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.616290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.616736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.617632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:38.618281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:38.620880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:38.642570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1995/3982] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:38.653939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:38.674146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:38.683189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2423-65dc-4c67-91aa-ef3e1b75f0e4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:38.696229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:38.702318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.702318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.702318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.702318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:38.702318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:38.706429 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1988/3983] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:38 2022] POST /identity/v3/users => generated 287 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:38.710957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:38.715064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:38.764774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21d80-614a-420d-9566-c511c3e68ed7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:38.783048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:38.783775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.784057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.784322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.786120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:38.790514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:38.829734 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1989/3984] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:38.830815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:38.853899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ae404-4820-4fcd-87ac-01402a5f3a02 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:38.870651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:38.871363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.871654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.871963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.872893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:38.874719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:38.890974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1990/3985] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:38.896751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:38.910498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ebb2-404a-46e9-917c-2d8a0319cb59 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:38.917330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592a948-4a9c-4f4a-99da-74b185765c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:38.918132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592a948-4a9c-4f4a-99da-74b185765c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:38.918656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592a948-4a9c-4f4a-99da-74b185765c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:38.919223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592a948-4a9c-4f4a-99da-74b185765c3f admin admin] PATH_INFO: `/v3/projects/a5bd222d12734f97aeb316b79a1ab0e2/users/0234b719856c4f3b885895c290204d00/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:38.951034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592a948-4a9c-4f4a-99da-74b185765c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bd222d12734f97aeb316b79a1ab0e2, user_id=0234b719856c4f3b885895c290204d00, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:38.954421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592a948-4a9c-4f4a-99da-74b185765c3f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:39.022267 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1996/3986] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:38 2022] POST /identity/v3/projects => generated 373 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:39.025373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:39.138342 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1991/3987] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:38 2022] PUT /identity/v3/projects/a5bd222d12734f97aeb316b79a1ab0e2/users/0234b719856c4f3b885895c290204d00/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:39.143078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.143772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.144224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:39.204511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] MFA Rules not processed for user `0234b719856c4f3b885895c290204d00`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:39.205164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16738c-485e-4805-b46c-35f7f7816f16 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:39.205700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:39.331135 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1992/3988] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:39.364060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:39.364389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:39.365553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.368788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:39.369730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.370519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:39.372044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:39.379425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:39.470003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734790d-4b16-4b78-83ed-87f42cb28ac9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:39.478023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:39.479522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.484061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.485117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:39.502683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:39.505919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:39.520812 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1993/3989] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:39.581838 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1997/3990] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:39 2022] POST /identity/v3/users => generated 287 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:39.594152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:39.620918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f11e-bed5-4cd1-9892-533a4206e5ff service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:39.629944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:39.630641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.630926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.631204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:39.632514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:39.634542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:39.676735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1994/3991] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:07:39.682506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:39.698385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2fbf-a304-4e2a-a3b0-42dadf18428b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:39.711702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424017b-565b-40d6-a893-59bae12768e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:39.711702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424017b-565b-40d6-a893-59bae12768e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.711702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424017b-565b-40d6-a893-59bae12768e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.711702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424017b-565b-40d6-a893-59bae12768e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:39.712237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424017b-565b-40d6-a893-59bae12768e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:39.712237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424017b-565b-40d6-a893-59bae12768e0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:39.747499 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1998/3992] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:39.748650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:39.764694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ecd7-b228-46d2-96d0-266f9f5e84bf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:39.770889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:39.772152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.772683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.773298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] PATH_INFO: `/v3/projects/13ad06cca7f14206bf566168b6fe01e1/users/5dee4feee43e4d03afbf89b231a2a38b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:39.828025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ad06cca7f14206bf566168b6fe01e1, user_id=5dee4feee43e4d03afbf89b231a2a38b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:39.839793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:39.982160 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1995/3993] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:39 2022] PUT /identity/v3/projects/13ad06cca7f14206bf566168b6fe01e1/users/5dee4feee43e4d03afbf89b231a2a38b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:07:39.994855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:39.995346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:39.995632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:40.049219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] MFA Rules not processed for user `5dee4feee43e4d03afbf89b231a2a38b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:40.051196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:40.173520 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 1999/3994] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:40.509914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:40.511979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:40.612466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:40.668695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b1e26-29cb-4367-8212-288050072915 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:40.678573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:40.679387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:40.679665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:40.679938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:40.690541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:40.692817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:40.708590 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1996/3995] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:41.721423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:44.085026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:44.088140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:44.405198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce5daf-c2c0-4a4e-91cd-c9c9e6d076ad None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:44.438466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:44.441537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:44.441537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:44.442436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:44.447575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:44.479855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:44.484432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d57c-6d06-434b-816b-a835c8121a4a service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:44.515172 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2000/3996] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:07:45.628699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:46.337501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:46.608414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:46.610839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:46.825148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1aa21-af7c-4289-9b6d-33c6240259f2 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:46.830939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:46.833358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:46.833606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:46.834262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:46.841407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:46.874772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:46.876562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:46.924447 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1997/3997] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:48.064798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:48.272984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:48.273552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:48.273552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:48.311500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:48.312420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:48.447449 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2001/3998] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:49.213693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:49.376653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc72a-cdb6-4baa-b057-0ed9f939f8b8 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:49.382289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:49.383038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:49.383637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:49.384076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] PATH_INFO: `/v3/users/5dee4feee43e4d03afbf89b231a2a38b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:49.387283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dee4feee43e4d03afbf89b231a2a38b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:49.389834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:49.885446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:50.114841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dee4feee43e4d03afbf89b231a2a38b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:50.129425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dee4feee43e4d03afbf89b231a2a38b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:50.137591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:50.139226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:50.162584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dee4feee43e4d03afbf89b231a2a38b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:50.164407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dee4feee43e4d03afbf89b231a2a38b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:50.168033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-05fdae74-00fd-47ea-9c5b-f97bf223cb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dee4feee43e4d03afbf89b231a2a38b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:50.325505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1998/3999] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:49 2022] DELETE /identity/v3/users/5dee4feee43e4d03afbf89b231a2a38b => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:50.327327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:50.327713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:50.328114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:50.374571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41beb7-2cc1-44cc-80e2-f2f006a050d4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:50.378039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:50.381415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:50.500403 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 1999/4000] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:50.501523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:50.502975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:50.572031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:50.573594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:50.574222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:50.576054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:50.581021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:50.583506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951a438-6047-4b5f-afbc-78b93db09f10 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:50.590536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:50.591717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:50.592577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:50.593210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:50.603915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:50.606481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:50.606939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08bb84-2a46-4487-b9c6-9293cde5ada5 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:50.607946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:50.634169 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2002/4001] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:50.653074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:50.665826 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2000/4002] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:50.979478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a7511-4b2b-4c96-b97a-8abcf295d2c7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:50.980418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a7511-4b2b-4c96-b97a-8abcf295d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:50.980923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a7511-4b2b-4c96-b97a-8abcf295d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:51.004182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a78a7511-4b2b-4c96-b97a-8abcf295d2c7 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:51.006350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a78a7511-4b2b-4c96-b97a-8abcf295d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:51.093288 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2003/4003] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:51.578438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:51.580146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:51.601550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98f20-808d-40d3-9dbd-61e39c38d08a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:51.609215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:51.610206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:51.611192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:51.612020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] PATH_INFO: `/v3/projects/13ad06cca7f14206bf566168b6fe01e1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:51.615700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ad06cca7f14206bf566168b6fe01e1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:51.618586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:52.267328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ad06cca7f14206bf566168b6fe01e1', 'request_id': 'req-f90d3418-a91b-4447-a026-a728738f2d57'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:52.277016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ad06cca7f14206bf566168b6fe01e1', 'request_id': 'req-f90d3418-a91b-4447-a026-a728738f2d57'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:52.289611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ad06cca7f14206bf566168b6fe01e1', 'request_id': 'req-f90d3418-a91b-4447-a026-a728738f2d57'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:52.458436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] The token cache is being invalidate because project 13ad06cca7f14206bf566168b6fe01e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:52.458714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:52.459698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f90d3418-a91b-4447-a026-a728738f2d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:52.463360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2001/4004] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:51 2022] DELETE /identity/v3/projects/13ad06cca7f14206bf566168b6fe01e1 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:52.471713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:52.484737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:52.488358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:52.519350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:52.521085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:52.634345 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2004/4005] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:52.642078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:52.643119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:52.643496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:52.677629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:52.677629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:52.715868 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2002/4006] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:52.720812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:52.737706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9f179-a6d2-4cfe-b71e-a39eab6dd81b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:52.745630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:52.746406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:52.746682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:52.746950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:52.747804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:52.748194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:52.749799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:52.762828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2005/4007] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:52.767071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:52.779223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c369-d31c-40a7-8749-011a1275cdda None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:52.786287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:52.800045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:52.800045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:52.800045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:52.800045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:52.800045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:52.995026 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2003/4008] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:52 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:07:52.996486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:53.007572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d0df-477f-4d82-adb2-1a41360c5a63 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:53.076844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:53.077479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.077763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.078083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.078722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:53.080646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:53.299755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2006/4009] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:52 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:53.300165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:53.314579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b85f7-596c-4aef-b523-bdf9bc2123cb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:53.320503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:53.321383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.321949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.322750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.323711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:53.325415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:53.338540 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2004/4010] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:53.349766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:53.360549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c78b-d150-4c62-91c9-913366bd660d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:53.372144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57756a2b-d615-4f8b-aa3a-c1cbadaefaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:53.373230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756a2b-d615-4f8b-aa3a-c1cbadaefaac admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.373715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756a2b-d615-4f8b-aa3a-c1cbadaefaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.374212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756a2b-d615-4f8b-aa3a-c1cbadaefaac admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.374946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57756a2b-d615-4f8b-aa3a-c1cbadaefaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:53.376594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57756a2b-d615-4f8b-aa3a-c1cbadaefaac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:53.389874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2007/4011] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:53.394396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:53.407450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad85aa-0d08-4b69-9a01-196490dc8c2e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:53.413499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:53.421458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.422229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.422512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] PATH_INFO: `/v3/projects/2b97fe6b5a914adf979094041b1165ee/users/44a8429bca604b359ea4d23d8f04dd22/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.441372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b97fe6b5a914adf979094041b1165ee, user_id=44a8429bca604b359ea4d23d8f04dd22, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:53.443761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:53.739117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2005/4012] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:53 2022] PUT /identity/v3/projects/2b97fe6b5a914adf979094041b1165ee/users/44a8429bca604b359ea4d23d8f04dd22/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:53.752385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.752964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.753081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.819507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] MFA Rules not processed for user `44a8429bca604b359ea4d23d8f04dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:53.819507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:53.892514 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2008/4013] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:53.897431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:53.965297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed4c7-320b-4b5b-ba12-1115f5730ba0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:53.970235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:53.970851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.971161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.971434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.972069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:53.974003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:54.316666 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2006/4014] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:53 2022] POST /identity/v3/projects => generated 367 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:54.321420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:54.333056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffcfb7-bf16-4654-998d-0546f31c8411 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:54.397864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:54.398594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:54.398880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:54.401388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:54.401388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:54.402070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:54.614576 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2009/4015] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:54 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:07:54.618288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:54.631343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b6ef2-a274-427e-a480-f8510c513d85 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:54.636941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:54.637710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:54.638124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:54.638432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:54.639085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:54.640724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:54.652274 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2007/4016] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:54.659035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:54.670659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02c4cb-8447-45a5-a1ea-e4e21a39aaac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:54.678654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:54.681588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:54.681588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:54.681588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] PATH_INFO: `/v3/projects/c670d27e068b47e1825d10ab980a7d33/users/6fa8e8315e0f4b38a999ca284fc377ea/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:54.698713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c670d27e068b47e1825d10ab980a7d33, user_id=6fa8e8315e0f4b38a999ca284fc377ea, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:54.701488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:54.931130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:54.938807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2010/4017] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:54 2022] PUT /identity/v3/projects/c670d27e068b47e1825d10ab980a7d33/users/6fa8e8315e0f4b38a999ca284fc377ea/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:54.943156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:54.956132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad652-bd3f-4eaa-a667-3007680fa5c6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.024530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c176c-a2aa-40b1-a5e7-58a8074cb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.025360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c176c-a2aa-40b1-a5e7-58a8074cb2fa admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.026207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c176c-a2aa-40b1-a5e7-58a8074cb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.026484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c176c-a2aa-40b1-a5e7-58a8074cb2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.027141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c176c-a2aa-40b1-a5e7-58a8074cb2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.028807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c176c-a2aa-40b1-a5e7-58a8074cb2fa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:55.040898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2008/4018] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:55.046154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:55.056449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31def4f5-b503-419a-b2ea-bfb4abc6fff3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.062286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.063141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.063349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.063546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] PATH_INFO: `/v3/projects/c670d27e068b47e1825d10ab980a7d33/users/6fa8e8315e0f4b38a999ca284fc377ea/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.065586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c670d27e068b47e1825d10ab980a7d33, user_id=6fa8e8315e0f4b38a999ca284fc377ea, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.068288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:55.086830 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2011/4019] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:07:55 2022] PUT /identity/v3/projects/c670d27e068b47e1825d10ab980a7d33/users/6fa8e8315e0f4b38a999ca284fc377ea/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:55.097776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.098071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.098350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.129667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] MFA Rules not processed for user `6fa8e8315e0f4b38a999ca284fc377ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:55.130934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:55.203709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2009/4020] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:55.208771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:55.221131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef067e07-1667-4523-ba7a-2007bdda82b6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.226072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.226689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.227156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.227433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.228185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.230270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:55.439973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2012/4021] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:55 2022] POST /identity/v3/projects => generated 360 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:55.444102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:55.453572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7c119-7e33-4d7d-815f-7311570145da None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.521675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.522681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.523066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.523408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.524363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.526951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:55.809899 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2010/4022] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:07:55 2022] POST /identity/v3/users => generated 413 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:55.814647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:55.826311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934686-790e-4048-8353-8be1fe7a52a0 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.832314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.832314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.832644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.833313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/users/82cce65519f84b8ca03e8f9acec41f01` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.835591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:55.852998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_user(user_id=82cce65519f84b8ca03e8f9acec41f01)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.855986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:55.857873 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2013/4023] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:07:55 2022] GET /identity/v3/users/82cce65519f84b8ca03e8f9acec41f01 => generated 413 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:55.863744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:55.877061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833a28d-ddfb-4f13-bd16-ecff8a5f7541 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.882095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.883402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.883691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.883968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/users/82cce65519f84b8ca03e8f9acec41f01` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.885145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_user(user_id=82cce65519f84b8ca03e8f9acec41f01)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.887327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:56.124208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cce65519f84b8ca03e8f9acec41f01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.151127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cce65519f84b8ca03e8f9acec41f01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.171952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cce65519f84b8ca03e8f9acec41f01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.172946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cce65519f84b8ca03e8f9acec41f01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.182240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cce65519f84b8ca03e8f9acec41f01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.332182 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2011/4024] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:07:55 2022] DELETE /identity/v3/users/82cce65519f84b8ca03e8f9acec41f01 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:56.336573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:56.339307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:56.354309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684035e-eb0e-4574-9a83-f4cc52afe83b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:56.421564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:56.422874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:56.438506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:56.438506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/95a513ddad8449ac96022b2b46e84dc1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:56.438506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=95a513ddad8449ac96022b2b46e84dc1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:56.438506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:56.558254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a513ddad8449ac96022b2b46e84dc1', 'request_id': 'req-1cd4af96-c941-4f9b-9d03-97fd664ce056'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.567323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a513ddad8449ac96022b2b46e84dc1', 'request_id': 'req-1cd4af96-c941-4f9b-9d03-97fd664ce056'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.577181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a513ddad8449ac96022b2b46e84dc1', 'request_id': 'req-1cd4af96-c941-4f9b-9d03-97fd664ce056'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.793033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project 95a513ddad8449ac96022b2b46e84dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:56.793528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.794492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:56.796244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2014/4025] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:56 2022] DELETE /identity/v3/projects/95a513ddad8449ac96022b2b46e84dc1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:07:56.802047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:56.814899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c1f4-6cbf-46d1-86b9-8c02660bb6b5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:56.895516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:56.896962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:56.897266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:56.897552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:56.898438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:56.901027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:56.922409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:57.084329 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2012/4026] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:56 2022] POST /identity/v3/projects => generated 348 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:07:57.089298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:57.090606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:57.109752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4af96-c941-4f9b-9d03-97fd664ce056 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:57.260122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:57.260780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.271892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.275885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.275885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:07:57.276678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:57.280330 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:07:57.280330 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:07:57.280330 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:07:57.281935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:57.339296 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2015/4027] 10.222.0.78 () {58 vars in 1160 bytes} [Sun Aug 28 20:07:57 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:07:57.339955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:57.353408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97bcb-801f-442e-a601-9d840c191345 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:57.359533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbf383-6a04-4592-835c-68e77e0febf5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:57.360179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbf383-6a04-4592-835c-68e77e0febf5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.360406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbf383-6a04-4592-835c-68e77e0febf5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.360734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbf383-6a04-4592-835c-68e77e0febf5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.361878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbf383-6a04-4592-835c-68e77e0febf5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:57.363680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbf383-6a04-4592-835c-68e77e0febf5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:57.387682 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2013/4028] 10.222.0.78 () {58 vars in 1128 bytes} [Sun Aug 28 20:07:57 2022] GET /identity/v3/domains => generated 829 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:07:57.394284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:57.409484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa006c8-716b-431a-8ed6-b3f39e433fb5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:57.417512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:57.418477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.419712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.421251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/c959742f9e5b465b9cf7feb084c82878` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.423943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:update_project(project_id=c959742f9e5b465b9cf7feb084c82878)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:57.425307 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:07:57.425307 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:07:57.425307 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:07:57.426769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:57.445673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:57.446789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:57.531585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.538731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.538731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.573057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:57.574909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:57.665908 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2014/4029] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:07:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:57.690447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:57.690447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:57.782872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05247c4d-0b0c-42ed-a3ea-e0203910d9ca None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:57.788742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:57.790280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.790659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.791200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.813807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:57.814751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:57.818355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2016/4030] 10.222.0.78 () {60 vars in 1252 bytes} [Sun Aug 28 20:07:57 2022] PATCH /identity/v3/projects/c959742f9e5b465b9cf7feb084c82878 => generated 362 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:07:57.819087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:57.821437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:57.824886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:57.828695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:57.842052 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2015/4031] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:07:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:07:57.929659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9474b3-28fd-4915-9c1d-adc2933f2f48 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:57.945838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:57.947947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.948243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.948860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/c959742f9e5b465b9cf7feb084c82878` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.969155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c959742f9e5b465b9cf7feb084c82878)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:57.971428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:58.006035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.014390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.242507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878', 'request_id': 'req-1a98612f-8bb4-4c35-9b4c-0551fd59d981'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.260352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878', 'request_id': 'req-1a98612f-8bb4-4c35-9b4c-0551fd59d981'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.270056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878', 'request_id': 'req-1a98612f-8bb4-4c35-9b4c-0551fd59d981'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.448108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project c959742f9e5b465b9cf7feb084c82878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:58.449262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.451637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.469343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:58.520444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878', 'request_id': 'req-1a98612f-8bb4-4c35-9b4c-0551fd59d981'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.531595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878', 'request_id': 'req-1a98612f-8bb4-4c35-9b4c-0551fd59d981'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.538161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c959742f9e5b465b9cf7feb084c82878', 'request_id': 'req-1a98612f-8bb4-4c35-9b4c-0551fd59d981'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:58.554598 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2017/4032] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:57 2022] DELETE /identity/v3/projects/c959742f9e5b465b9cf7feb084c82878 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:07:58.560847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:58.562677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:58.592247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72427ed8-fb6f-4d4b-9e90-d1ad0652e02b service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:58.820913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:58.821891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:58.824862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:58.825386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:58.827189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:58.834013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:59.074379 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2016/4033] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:07:58 2022] POST /identity/v3/projects => generated 358 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:07:59.080725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:59.082458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:59.118356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98612f-8bb4-4c35-9b4c-0551fd59d981 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:59.238715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6fa84-1acf-4d58-a9f2-3fd4de4ec424 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:59.239330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6fa84-1acf-4d58-a9f2-3fd4de4ec424 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:59.239721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6fa84-1acf-4d58-a9f2-3fd4de4ec424 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:59.240100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6fa84-1acf-4d58-a9f2-3fd4de4ec424 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/b9caa0fc832c405988f7ae99b4baf6a1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:59.242256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6fa84-1acf-4d58-a9f2-3fd4de4ec424 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9caa0fc832c405988f7ae99b4baf6a1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:59.252562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6fa84-1acf-4d58-a9f2-3fd4de4ec424 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:59.255096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2018/4034] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:07:59 2022] GET /identity/v3/projects/b9caa0fc832c405988f7ae99b4baf6a1 => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:07:59.259353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:59.279419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d63f8-e7a6-4af1-bd73-84444a7cd7a1 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:59.322068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:59.323547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:59.323859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:59.324362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/b9caa0fc832c405988f7ae99b4baf6a1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:59.326769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9caa0fc832c405988f7ae99b4baf6a1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:59.330496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:59.697374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:59.698518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:59.698777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9caa0fc832c405988f7ae99b4baf6a1', 'request_id': 'req-b4268218-7440-4bc7-adab-50c3b9f6454d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:59.699510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:59.733011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9caa0fc832c405988f7ae99b4baf6a1', 'request_id': 'req-b4268218-7440-4bc7-adab-50c3b9f6454d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:59.750592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9caa0fc832c405988f7ae99b4baf6a1', 'request_id': 'req-b4268218-7440-4bc7-adab-50c3b9f6454d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:07:59.769656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:59.771740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:59.875673 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2019/4035] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:59.891522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:59.895195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:59.992823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project b9caa0fc832c405988f7ae99b4baf6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:07:59.993125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:00.001986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:00.008112 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2017/4036] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:07:59 2022] DELETE /identity/v3/projects/b9caa0fc832c405988f7ae99b4baf6a1 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:00.019501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:00.021207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:00.135127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97278b-e2c4-4542-a576-a568ec8449b0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:00.154485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:00.155525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:00.155995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:00.156435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:00.159299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:00.190815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:00.193159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:00.216146 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2020/4037] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:08:00.248303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268218-7440-4bc7-adab-50c3b9f6454d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:00.263737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:00.263737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:00.263737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:00.264725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:00.264725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:00.266674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:00.441893 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2018/4038] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:00 2022] POST /identity/v3/projects => generated 360 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:00.442000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:00.457499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6915e1-843a-4289-a344-d2c4c8a64944 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:00.576381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:00.669805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:00.670503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:00.670891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:00.671170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/06c93a11a9bd4e4f90de955136f8e61f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:00.674556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=06c93a11a9bd4e4f90de955136f8e61f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:00.679414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:00.689397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2021/4039] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:00 2022] GET /identity/v3/projects/06c93a11a9bd4e4f90de955136f8e61f => generated 360 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:00.693285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:00.724053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5207e-c324-4997-b202-132c69fa40bd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:00.740083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:00.741221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:00.742630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:00.743447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/06c93a11a9bd4e4f90de955136f8e61f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:00.750668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06c93a11a9bd4e4f90de955136f8e61f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:00.753686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:01.059797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:01.062360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:01.085516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c93a11a9bd4e4f90de955136f8e61f', 'request_id': 'req-f9c7db33-3c22-4920-bdb6-63dfca9ca723'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:01.100184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c93a11a9bd4e4f90de955136f8e61f', 'request_id': 'req-f9c7db33-3c22-4920-bdb6-63dfca9ca723'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:01.141580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c93a11a9bd4e4f90de955136f8e61f', 'request_id': 'req-f9c7db33-3c22-4920-bdb6-63dfca9ca723'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:01.272786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fa26-ce76-4a68-b62a-14b3e8bac062 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:01.409193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project 06c93a11a9bd4e4f90de955136f8e61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:01.409900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:01.413649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:01.420837 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2019/4040] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:00 2022] DELETE /identity/v3/projects/06c93a11a9bd4e4f90de955136f8e61f => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:01.429822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:01.437132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:01.467106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:01.467842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:01.468457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:01.468820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:01.471153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:01.499172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:01.501414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:01.538500 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2022/4041] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:08:01.756839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7db33-3c22-4920-bdb6-63dfca9ca723 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:01.787411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:01.792272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:01.797667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:01.799086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:01.805676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:01.828444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:02.291438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2020/4042] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:08:01 2022] POST /identity/v3/projects => generated 347 bytes in 865 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:02.292794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:02.309937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e76ac-0d75-49e5-9d88-b2d65b94d1ba service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:02.414685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:02.415674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:02.416258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:02.416858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/a865dae70aef42e1b66c5e043ca3d5b5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:02.420075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=a865dae70aef42e1b66c5e043ca3d5b5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:02.425115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:02.431507 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2023/4043] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:02 2022] GET /identity/v3/projects/a865dae70aef42e1b66c5e043ca3d5b5 => generated 347 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:08:02.434447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:02.445663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee89d4-6516-4e92-84b6-9c4b4bffcb0e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:02.452120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:02.453177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:02.453419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:02.453570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/a865dae70aef42e1b66c5e043ca3d5b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:02.454970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a865dae70aef42e1b66c5e043ca3d5b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:02.457249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:02.657224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:02.751949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a865dae70aef42e1b66c5e043ca3d5b5', 'request_id': 'req-2355ea83-3353-4d85-9e46-53caf0fca3df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:02.777060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a865dae70aef42e1b66c5e043ca3d5b5', 'request_id': 'req-2355ea83-3353-4d85-9e46-53caf0fca3df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:02.797779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a865dae70aef42e1b66c5e043ca3d5b5', 'request_id': 'req-2355ea83-3353-4d85-9e46-53caf0fca3df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:02.943135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project a865dae70aef42e1b66c5e043ca3d5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:02.943446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:02.944274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:02.958285 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2021/4044] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:02 2022] DELETE /identity/v3/projects/a865dae70aef42e1b66c5e043ca3d5b5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:02.969082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:02.971058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:02.998009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d908-8c7a-4486-ac7e-304a4e986920 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:03.156454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:03.157240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:03.157623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:03.158059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:03.158854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:03.162640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:03.382375 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2024/4045] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:08:02 2022] POST /identity/v3/domains => generated 276 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:03.383514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:03.398834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ea83-3353-4d85-9e46-53caf0fca3df tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:03.500109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:03.500753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:03.501036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:03.501316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:03.502657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:03.504604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:04.310935 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2022/4046] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:03 2022] POST /identity/v3/projects => generated 402 bytes in 928 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:04.311775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:04.322884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259f93d-ba1f-42e6-b41d-584cebde0da4 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:04.461115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:04.461115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:04.461115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:04.462085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/97f9bfa95ef749f3bf852f5bd8854091` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:04.462085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=97f9bfa95ef749f3bf852f5bd8854091)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:04.462085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:04.462085 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2025/4047] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:04 2022] GET /identity/v3/projects/97f9bfa95ef749f3bf852f5bd8854091 => generated 402 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:08:04.469021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:04.488886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea054a-41fa-485d-b90a-c64ec95f7be6 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:04.493605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:04.528245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:04.528245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:04.528245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/97f9bfa95ef749f3bf852f5bd8854091` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:04.528245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97f9bfa95ef749f3bf852f5bd8854091)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:04.528245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:04.874147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f9bfa95ef749f3bf852f5bd8854091', 'request_id': 'req-a8ec09d7-416e-40ef-9890-d141384965f7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:04.887322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f9bfa95ef749f3bf852f5bd8854091', 'request_id': 'req-a8ec09d7-416e-40ef-9890-d141384965f7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:04.897511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f9bfa95ef749f3bf852f5bd8854091', 'request_id': 'req-a8ec09d7-416e-40ef-9890-d141384965f7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.043621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project 97f9bfa95ef749f3bf852f5bd8854091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:05.044581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.045928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.061613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2023/4048] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:04 2022] DELETE /identity/v3/projects/97f9bfa95ef749f3bf852f5bd8854091 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:05.066035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:05.067876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:05.097750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9252-b13c-40c3-872c-5ec84da43914 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:05.227182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:05.227986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:05.229516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:05.229516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains/c010ba0397584090a982f5a32c6ac2c4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:05.232303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c010ba0397584090a982f5a32c6ac2c4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:05.235547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:05.281828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.287090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.293567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:05.441521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.444865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.449305 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2026/4049] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:08:05 2022] PATCH /identity/v3/domains/c010ba0397584090a982f5a32c6ac2c4 => generated 277 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:05.456266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:05.471256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec09d7-416e-40ef-9890-d141384965f7 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:05.624482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:05.624726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:05.624903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:05.625268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains/c010ba0397584090a982f5a32c6ac2c4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:05.643470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c010ba0397584090a982f5a32c6ac2c4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:05.645660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:05.688750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.698183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.897219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:05.925046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4', 'request_id': 'req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.945020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4', 'request_id': 'req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:05.983490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4', 'request_id': 'req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:06.098339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project c010ba0397584090a982f5a32c6ac2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:06.099290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:06.100359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:06.111900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4', 'request_id': 'req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:06.113523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4', 'request_id': 'req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:06.119576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c010ba0397584090a982f5a32c6ac2c4', 'request_id': 'req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:06.134608 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2024/4050] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:05 2022] DELETE /identity/v3/domains/c010ba0397584090a982f5a32c6ac2c4 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:06.141836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:06.144357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:06.195282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07a8f9-95de-46b1-abe0-7a9f820759f5 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:06.332770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:06.334160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:06.334471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:06.334802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:06.335512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:06.337196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:06.438454 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2027/4051] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:08:06 2022] POST /identity/v3/domains => generated 277 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:06.442995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:06.446188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:06.476829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7b80-e2e4-4eee-8a57-929ca2fc67fe tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:06.652393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:06.653389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:06.653389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:06.653942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:06.655050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:06.658946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:06.900981 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2025/4052] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:06 2022] POST /identity/v3/projects => generated 409 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:06.905817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:06.929870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9973266-b87c-4e1c-91d0-41bb6c43f497 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:07.062193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:07.065182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:07.065182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:07.065182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:07.066223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:07.070453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:07.246405 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2028/4053] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:06 2022] POST /identity/v3/projects => generated 404 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:07.248679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:07.288374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162725b-1833-4069-9aa6-b472f78a9f7b tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:07.476025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:07.477956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:07.479455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:07.480229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/b779a321aced4140a50df0a0e8042f91` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:07.486452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b779a321aced4140a50df0a0e8042f91)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:07.490960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:07.761627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b779a321aced4140a50df0a0e8042f91', 'request_id': 'req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:07.777818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b779a321aced4140a50df0a0e8042f91', 'request_id': 'req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:07.798598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b779a321aced4140a50df0a0e8042f91', 'request_id': 'req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:07.972954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project b779a321aced4140a50df0a0e8042f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:07.973590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:07.974710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:07.976951 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2026/4054] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:07 2022] DELETE /identity/v3/projects/b779a321aced4140a50df0a0e8042f91 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:07.983295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:07.988603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:08.017245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c1ff-cdd6-49b0-a706-3f7361f695e3 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:08.140362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:08.141401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:08.142090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:08.143535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/52e17f2dee754ff1bd3d141deac97241` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:08.145520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52e17f2dee754ff1bd3d141deac97241)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:08.148338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:08.287335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:08.393386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e17f2dee754ff1bd3d141deac97241', 'request_id': 'req-674bb341-2ce5-408b-a71e-00379d90a3fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:08.410550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e17f2dee754ff1bd3d141deac97241', 'request_id': 'req-674bb341-2ce5-408b-a71e-00379d90a3fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:08.425595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e17f2dee754ff1bd3d141deac97241', 'request_id': 'req-674bb341-2ce5-408b-a71e-00379d90a3fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:08.583986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project 52e17f2dee754ff1bd3d141deac97241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:08.586008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:08.586987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:08.589637 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2029/4055] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:07 2022] DELETE /identity/v3/projects/52e17f2dee754ff1bd3d141deac97241 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:08.596235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:08.642811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ba93-c751-4fc7-b1df-b90ae2b2ce08 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:08.820195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:08.858258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:08.858943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:08.861009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:08.861409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains/c494acb4d2174447a25906ac12038873` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:08.863061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c494acb4d2174447a25906ac12038873)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:08.865468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:08.960434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c494acb4d2174447a25906ac12038873'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:08.966436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c494acb4d2174447a25906ac12038873'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:09.482370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c494acb4d2174447a25906ac12038873'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:09.483024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c494acb4d2174447a25906ac12038873'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:09.495054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:09.496535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:09.505957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2027/4056] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:08:08 2022] PATCH /identity/v3/domains/c494acb4d2174447a25906ac12038873 => generated 278 bytes in 910 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:09.516592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb341-2ce5-408b-a71e-00379d90a3fd tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:09.605078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:09.605754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:09.606062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:09.606340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains/c494acb4d2174447a25906ac12038873` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:09.619217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c494acb4d2174447a25906ac12038873)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:09.621060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:09.665281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c494acb4d2174447a25906ac12038873'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:09.692631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c494acb4d2174447a25906ac12038873'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.224422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c494acb4d2174447a25906ac12038873', 'request_id': 'req-3bc31265-239f-407a-96c3-52721cfae2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.224422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c494acb4d2174447a25906ac12038873', 'request_id': 'req-3bc31265-239f-407a-96c3-52721cfae2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.224422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c494acb4d2174447a25906ac12038873', 'request_id': 'req-3bc31265-239f-407a-96c3-52721cfae2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.557483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project c494acb4d2174447a25906ac12038873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:10.558700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.559153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.582455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c494acb4d2174447a25906ac12038873', 'request_id': 'req-3bc31265-239f-407a-96c3-52721cfae2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.592769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c494acb4d2174447a25906ac12038873', 'request_id': 'req-3bc31265-239f-407a-96c3-52721cfae2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.593638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c494acb4d2174447a25906ac12038873', 'request_id': 'req-3bc31265-239f-407a-96c3-52721cfae2cc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:10.609989 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2030/4057] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:09 2022] DELETE /identity/v3/domains/c494acb4d2174447a25906ac12038873 => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:10.615455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:10.617326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:10.653456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435233-b883-4e0b-a890-94c79be347ad tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:10.826328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:10.834626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:10.835789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:10.836133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:10.836881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:10.840087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.089660 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2028/4058] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:10 2022] POST /identity/v3/projects => generated 377 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:11.090616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.092590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:11.112742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31265-239f-407a-96c3-52721cfae2cc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.335922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.337134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.337134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.337465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/d973fdc332164bfe822e085a7fed45b7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.341578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=d973fdc332164bfe822e085a7fed45b7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.344131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.369219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.379929 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2031/4059] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:11 2022] GET /identity/v3/projects/d973fdc332164bfe822e085a7fed45b7 => generated 377 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:11.389811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f80ff6-6f24-4684-b706-b3cf8e432741 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.402853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.405161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.405672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.406113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.408133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.411376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.458123 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2029/4060] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:08:11 2022] GET /identity/v3/projects => generated 6574 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:11.470165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.485428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08658e-ebb2-4846-a2e8-f752be93da69 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.494020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.495653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.495653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.496093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/d973fdc332164bfe822e085a7fed45b7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.497593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d973fdc332164bfe822e085a7fed45b7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.499986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.755230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd973fdc332164bfe822e085a7fed45b7', 'request_id': 'req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.768605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd973fdc332164bfe822e085a7fed45b7', 'request_id': 'req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.786453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:11.788707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd973fdc332164bfe822e085a7fed45b7', 'request_id': 'req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.953180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project d973fdc332164bfe822e085a7fed45b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:11.958096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.959581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.963231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2032/4061] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:11 2022] DELETE /identity/v3/projects/d973fdc332164bfe822e085a7fed45b7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:11.968918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.972628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:12.026689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d18a5-0615-412e-ad6a-3dd7a7b48898 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:12.191679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:12.192460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:12.192891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:12.193239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:12.194014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:12.196376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:12.520295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2030/4062] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:08:11 2022] POST /identity/v3/projects => generated 348 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:12.522206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:12.551195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03fbc-6cb5-4d6e-9bcd-d0d7fe21acf8 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:12.695528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:12.696792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:12.697294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:12.697784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/33e3049b88f446d7bfab46448ed6e104` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:12.699773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:update_project(project_id=33e3049b88f446d7bfab46448ed6e104)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:12.702082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:12.950132 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2033/4063] 10.222.0.78 () {60 vars in 1252 bytes} [Sun Aug 28 20:08:12 2022] PATCH /identity/v3/projects/33e3049b88f446d7bfab46448ed6e104 => generated 362 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:12.955633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:12.971666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61784-76f9-4396-9b65-9727aea201ed tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:12.983928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:12.985895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:12.986738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:12.987807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/33e3049b88f446d7bfab46448ed6e104` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:13.009035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=33e3049b88f446d7bfab46448ed6e104)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:13.012401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:13.014808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2031/4064] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:12 2022] GET /identity/v3/projects/33e3049b88f446d7bfab46448ed6e104 => generated 349 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:13.018784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:13.039239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb116-8c50-46f1-9cf1-eccd717bbc73 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:13.049888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:13.050445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:13.051483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:13.051483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/33e3049b88f446d7bfab46448ed6e104` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:13.052645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33e3049b88f446d7bfab46448ed6e104)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:13.054730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:13.371968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e3049b88f446d7bfab46448ed6e104', 'request_id': 'req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:13.393598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e3049b88f446d7bfab46448ed6e104', 'request_id': 'req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:13.404021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e3049b88f446d7bfab46448ed6e104', 'request_id': 'req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:13.503463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project 33e3049b88f446d7bfab46448ed6e104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:13.504108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:13.507602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:13.511352 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2034/4065] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:13 2022] DELETE /identity/v3/projects/33e3049b88f446d7bfab46448ed6e104 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:13.517539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:13.520699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:13.579906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc80d8-483a-4ce2-9a96-76be8cd2415d tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:13.843039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:13.844418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:13.844923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:13.846644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:13.849508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:13.864778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:14.055538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2032/4066] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:13 2022] POST /identity/v3/projects => generated 360 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:14.060150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:14.060426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:14.090795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbac7c1-8efd-41ee-bb99-ac7bfd4aa68e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:14.304488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:14.308492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:14.308492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:14.309134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/b00d6068b6af4e5881bd1600fa5d0e35` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:14.316417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:update_project(project_id=b00d6068b6af4e5881bd1600fa5d0e35)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:14.330118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:14.386256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:14.633041 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2035/4067] 10.222.0.78 () {60 vars in 1252 bytes} [Sun Aug 28 20:08:14 2022] PATCH /identity/v3/projects/b00d6068b6af4e5881bd1600fa5d0e35 => generated 372 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:14.635245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:14.654846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3791c-0af7-4fea-be6e-d21038e156fb tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:14.678655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:14.689693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:14.691428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:14.697917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/b00d6068b6af4e5881bd1600fa5d0e35` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:14.736378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=b00d6068b6af4e5881bd1600fa5d0e35)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:14.744613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:14.753876 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2033/4068] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:14 2022] GET /identity/v3/projects/b00d6068b6af4e5881bd1600fa5d0e35 => generated 359 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:14.759265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:14.780425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba89f1-7fa9-49fd-87f0-72b1c2ab60f9 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:14.790912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:14.794559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:14.794559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:14.794559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/b00d6068b6af4e5881bd1600fa5d0e35` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:14.799479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b00d6068b6af4e5881bd1600fa5d0e35)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:14.802269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:15.376887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00d6068b6af4e5881bd1600fa5d0e35', 'request_id': 'req-ba310110-4133-4280-8875-5ed60d0d6249'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:15.385635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00d6068b6af4e5881bd1600fa5d0e35', 'request_id': 'req-ba310110-4133-4280-8875-5ed60d0d6249'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:15.398831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00d6068b6af4e5881bd1600fa5d0e35', 'request_id': 'req-ba310110-4133-4280-8875-5ed60d0d6249'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:15.802730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project b00d6068b6af4e5881bd1600fa5d0e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:15.803229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:15.804682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:15.817455 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2036/4069] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:14 2022] DELETE /identity/v3/projects/b00d6068b6af4e5881bd1600fa5d0e35 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:15.818678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:15.822346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:15.842216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ea4e1-288f-421e-9a07-4384abeefd37 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:16.219928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:16.309576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:16.310800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:16.311191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:16.311787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:16.312775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:16.316280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:16.636563 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2034/4070] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:15 2022] POST /identity/v3/projects => generated 354 bytes in 819 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:16.641522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:16.657482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba310110-4133-4280-8875-5ed60d0d6249 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:16.769480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:16.770280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:16.770689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:16.771010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/6ff5e2977d18494bb9c4ed24fa7fbe0d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:16.774056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:update_project(project_id=6ff5e2977d18494bb9c4ed24fa7fbe0d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:16.777833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:16.958210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2037/4071] 10.222.0.78 () {60 vars in 1252 bytes} [Sun Aug 28 20:08:16 2022] PATCH /identity/v3/projects/6ff5e2977d18494bb9c4ed24fa7fbe0d => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:16.963564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:16.982656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f14f-0fbb-4743-ac8a-454314f5dd21 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:16.990302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:16.991429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:16.991923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:16.992380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/6ff5e2977d18494bb9c4ed24fa7fbe0d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:17.010088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:get_project(project_id=6ff5e2977d18494bb9c4ed24fa7fbe0d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:17.012108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:17.014199 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2035/4072] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:08:16 2022] GET /identity/v3/projects/6ff5e2977d18494bb9c4ed24fa7fbe0d => generated 355 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:17.020128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:17.033303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa979-117e-47f7-a75d-e7de1b4de827 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:17.040773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:17.041640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:17.042091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:17.042438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/projects/6ff5e2977d18494bb9c4ed24fa7fbe0d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:17.044304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6ff5e2977d18494bb9c4ed24fa7fbe0d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:17.047634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:17.279461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff5e2977d18494bb9c4ed24fa7fbe0d', 'request_id': 'req-9f0d6733-42fa-489e-abf0-061f3e50cbbc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:17.287409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff5e2977d18494bb9c4ed24fa7fbe0d', 'request_id': 'req-9f0d6733-42fa-489e-abf0-061f3e50cbbc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:17.298758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff5e2977d18494bb9c4ed24fa7fbe0d', 'request_id': 'req-9f0d6733-42fa-489e-abf0-061f3e50cbbc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:17.363503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:17.464259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] The token cache is being invalidate because project 6ff5e2977d18494bb9c4ed24fa7fbe0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:17.465082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:17.466514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:17.480474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:17.487357 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2038/4073] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:17 2022] DELETE /identity/v3/projects/6ff5e2977d18494bb9c4ed24fa7fbe0d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:17.487606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:17.513114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e309c1-27b0-4ec8-8fdb-6de16c1bb19a tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:17.595234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:17.595793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:17.596076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:17.596350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains/c494acb4d2174447a25906ac12038873` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:17.607819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Could not find domain: c494acb4d2174447a25906ac12038873.: keystone.exception.DomainNotFound: Could not find domain: c494acb4d2174447a25906ac12038873. Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c494acb4d2174447a25906ac12038873. Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:08:17.613910 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:08:17.620766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c494acb4d2174447a25906ac12038873. Aug 28 20:08:17.623135 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:08:17.625646 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2036/4074] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:08:17 2022] PATCH /identity/v3/domains/c494acb4d2174447a25906ac12038873 => generated 112 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:08:17.627390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:17.627665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:17.629812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:17.639886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188459e9-ea11-41d2-b45a-25d69f956bf2 tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:17.646512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8e8315e0f4b38a999ca284fc377ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c670d27e068b47e1825d10ab980a7d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:17.653399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:17.653399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:17.653399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] PATH_INFO: `/v3/domains/c010ba0397584090a982f5a32c6ac2c4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:17.657029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Could not find domain: c010ba0397584090a982f5a32c6ac2c4.: keystone.exception.DomainNotFound: Could not find domain: c010ba0397584090a982f5a32c6ac2c4. Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c010ba0397584090a982f5a32c6ac2c4. Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:08:17.664027 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:08:17.665465 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c010ba0397584090a982f5a32c6ac2c4. Aug 28 20:08:17.666852 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:08:17.669617 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2037/4075] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:08:17 2022] PATCH /identity/v3/domains/c010ba0397584090a982f5a32c6ac2c4 => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:08:17.673882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:17.676189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:17.762626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:17.783881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d6733-42fa-489e-abf0-061f3e50cbbc tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:17.786523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb58712-518a-4f9b-a72e-ad7ef0451a5e tempest-ProjectsTestJSON-898965681 tempest-ProjectsTestJSON-898965681-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:17.792217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:17.792952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:17.793447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:17.793932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:17.795085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:17.795968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:17.796653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:17.797178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] PATH_INFO: `/v3/users/44a8429bca604b359ea4d23d8f04dd22` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:17.797948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:17.799118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a8429bca604b359ea4d23d8f04dd22)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:17.803550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:17.815768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:17.818934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba48ab-e5ee-4ead-b941-d2387ef3c96d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:17.835898 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2039/4076] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:18.171448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a8429bca604b359ea4d23d8f04dd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:18.199492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a8429bca604b359ea4d23d8f04dd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:18.217576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a8429bca604b359ea4d23d8f04dd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:18.223934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a8429bca604b359ea4d23d8f04dd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:18.225224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e16fd97f-c26f-4012-80aa-e7dcf9401625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a8429bca604b359ea4d23d8f04dd22'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:18.413662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:18.417267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:18.418483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:18.432809 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2038/4077] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:17 2022] DELETE /identity/v3/users/44a8429bca604b359ea4d23d8f04dd22 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:18.438895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:18.441541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:18.441541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:18.441813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:18.443189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:18.483027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:18.484829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:18.559494 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2040/4078] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:08:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:18.582033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:18.585080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:18.632849 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2039/4079] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:08:18.646107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:18.648308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:18.694592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0a7ce-7008-45ea-86a7-5f12124d0de0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:18.708824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031473c-4667-4a9c-80cd-f2008cae03a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:18.710099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031473c-4667-4a9c-80cd-f2008cae03a9 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:18.710913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031473c-4667-4a9c-80cd-f2008cae03a9 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:18.715055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031473c-4667-4a9c-80cd-f2008cae03a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:18.742123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031473c-4667-4a9c-80cd-f2008cae03a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:18.748954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031473c-4667-4a9c-80cd-f2008cae03a9 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:18.777771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ebc0-1c20-442e-9bb2-5ac86f75ddfb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:18.788342 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2041/4080] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:08:18.788986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:18.791495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:18.791833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:18.792219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:18.808972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:18.811228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:18.833783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:18.834013 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2040/4081] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:18.896068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347686-526c-4d18-8b42-7189d242b318 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:18.896354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347686-526c-4d18-8b42-7189d242b318 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:18.896863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347686-526c-4d18-8b42-7189d242b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:18.920007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-14347686-526c-4d18-8b42-7189d242b318 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:18.921670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-14347686-526c-4d18-8b42-7189d242b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:18.930874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2042/4082] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:08:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:18.944555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:18.962459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd72ff-4f76-44c7-bc2d-78ebce05fd51 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:18.973972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:18.973972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:18.973972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:18.973972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:18.994892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:18.998299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:19.029098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:19.038078 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2041/4083] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:08:19.629833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:19.778529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14347686-526c-4d18-8b42-7189d242b318 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:19.780323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-14347686-526c-4d18-8b42-7189d242b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:19.801881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14347686-526c-4d18-8b42-7189d242b318 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:19.833086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:19.834243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:19.834996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:19.841318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] PATH_INFO: `/v3/projects/2b97fe6b5a914adf979094041b1165ee` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:19.848595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b97fe6b5a914adf979094041b1165ee)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:19.852975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:19.924788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:20.006238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b97fe6b5a914adf979094041b1165ee', 'request_id': 'req-21221415-68fb-4a9c-9c33-a91a724f4a18'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:20.015900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b97fe6b5a914adf979094041b1165ee', 'request_id': 'req-21221415-68fb-4a9c-9c33-a91a724f4a18'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:20.026983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b97fe6b5a914adf979094041b1165ee', 'request_id': 'req-21221415-68fb-4a9c-9c33-a91a724f4a18'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:20.203730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:20.221424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] The token cache is being invalidate because project 2b97fe6b5a914adf979094041b1165ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:20.222195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:20.223342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:20.225524 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2043/4084] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:19 2022] DELETE /identity/v3/projects/2b97fe6b5a914adf979094041b1165ee => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:20.231277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:20.246722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64f0e-b20d-475e-9e2b-91262ea7c7c6 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:20.378325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:20.379661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:20.380157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:20.380681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] PATH_INFO: `/v3/users/6fa8e8315e0f4b38a999ca284fc377ea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:20.384573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa8e8315e0f4b38a999ca284fc377ea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:20.388073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:20.537454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:20.965436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa8e8315e0f4b38a999ca284fc377ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:21.003798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa8e8315e0f4b38a999ca284fc377ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:21.036692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa8e8315e0f4b38a999ca284fc377ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:21.041505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa8e8315e0f4b38a999ca284fc377ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:21.047854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-db8c948b-6150-47a9-84ce-4e33128ae54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa8e8315e0f4b38a999ca284fc377ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:21.242192 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2042/4085] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:20 2022] DELETE /identity/v3/users/6fa8e8315e0f4b38a999ca284fc377ea => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:22.234936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:22.238053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:22.287890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221415-68fb-4a9c-9c33-a91a724f4a18 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:22.412292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:22.427253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:22.428238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:22.428971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] PATH_INFO: `/v3/projects/c670d27e068b47e1825d10ab980a7d33` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:22.432490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c670d27e068b47e1825d10ab980a7d33)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:22.437411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:22.828507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c670d27e068b47e1825d10ab980a7d33', 'request_id': 'req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:22.841100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c670d27e068b47e1825d10ab980a7d33', 'request_id': 'req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:22.885952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c670d27e068b47e1825d10ab980a7d33', 'request_id': 'req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:23.032167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] The token cache is being invalidate because project c670d27e068b47e1825d10ab980a7d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:23.032630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:23.034268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d59e724d-538b-4dc7-a86b-138b3d2cf1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:23.037918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2044/4086] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:22 2022] DELETE /identity/v3/projects/c670d27e068b47e1825d10ab980a7d33 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:23.077744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:23.078639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:23.078639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:23.124912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:23.126740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:23.224485 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2043/4087] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:23.226584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:23.226770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:23.226934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:23.250397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:23.251672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:23.260317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2045/4088] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:08:23.264980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:23.276614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216b2d7-72b3-4e76-85c3-6de7f037d8fd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:23.281546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:23.282232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:23.282579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:23.282821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:23.283654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:08:23.283996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:23.285599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:23.298737 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2044/4089] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:23.303993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:23.314617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc70eee-89ab-4280-8c8c-7f8fbd400108 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:23.319765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:23.320409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:23.320713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:23.321028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:23.321733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:23.323910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:23.710225 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2046/4090] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:23 2022] POST /identity/v3/projects => generated 371 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:23.716104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:23.727699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaba4a-155e-46b9-ba8a-4f9b5af5a589 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:23.810013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:23.810951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:23.811230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:23.812102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:23.812231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:23.814189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:23.976568 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2045/4091] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:08:23 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:23.977776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:23.994432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6db9f-3e79-4625-874e-f7869d93ae3b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:24.002264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:24.003166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:24.003611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:24.004887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:24.004887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:24.010860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:24.030008 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2047/4092] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:24.035103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:24.052994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b6ed-55da-4b75-948b-b19ccc751df6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:24.064382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497ac6e-812c-4d66-a39a-7b1804eeeb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:24.064619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ac6e-812c-4d66-a39a-7b1804eeeb42 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:24.068051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ac6e-812c-4d66-a39a-7b1804eeeb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:24.068051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ac6e-812c-4d66-a39a-7b1804eeeb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:24.068051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ac6e-812c-4d66-a39a-7b1804eeeb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:24.068051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ac6e-812c-4d66-a39a-7b1804eeeb42 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:24.083919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2046/4093] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:24.087852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:24.119151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83ccc-5744-4f77-8f77-88004cd0b558 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:24.132252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:24.133424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:24.133901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:24.134345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] PATH_INFO: `/v3/projects/9e21adcdeba24ec289dc149097e7d27c/users/aab3276ad83b4b0c9d4b84db41c09457/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:24.167582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e21adcdeba24ec289dc149097e7d27c, user_id=aab3276ad83b4b0c9d4b84db41c09457, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:24.172983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:24.385878 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2048/4094] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:08:24 2022] PUT /identity/v3/projects/9e21adcdeba24ec289dc149097e7d27c/users/aab3276ad83b4b0c9d4b84db41c09457/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:24.405073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:24.405318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:24.406692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:24.471880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] MFA Rules not processed for user `aab3276ad83b4b0c9d4b84db41c09457`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:24.474031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:24.515660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:24.621942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2047/4095] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:24.623905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:24.684257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:24.757414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7be4d-2b45-4d3e-a84b-09992047d8e0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:24.763764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:24.764481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:24.764840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:24.765333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:24.766116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:24.768104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:24.916363 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2049/4096] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:24 2022] POST /identity/v3/projects => generated 369 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:24.918456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:24.947704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88798-4727-404f-bb7a-13d6e0cc2621 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:25.109968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:25.112344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:25.112883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:25.113452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:25.114371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:25.116830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:25.325240 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2048/4097] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:08:24 2022] POST /identity/v3/users => generated 291 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:25.329520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:25.346383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc63fe-4fe2-467a-b4ea-18f5f6eb54ba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:25.365478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:25.365478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:25.365478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:25.365478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:25.365907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:25.365907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:25.401300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:25.402113 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2050/4098] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:25.424873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0260-e08f-4027-923f-01705e2cf220 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:25.438783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:25.439540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:25.439834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:25.440117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] PATH_INFO: `/v3/projects/f45ec82ca4c44195984db21c4b16e960/users/e5ca22f4061240a6a9f8c521a279a0bd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:25.480087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ec82ca4c44195984db21c4b16e960, user_id=e5ca22f4061240a6a9f8c521a279a0bd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:25.489608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:25.702281 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2049/4099] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:08:25 2022] PUT /identity/v3/projects/f45ec82ca4c44195984db21c4b16e960/users/e5ca22f4061240a6a9f8c521a279a0bd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:25.706589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:25.725218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab8d0-cad6-4f2e-80b1-d26bd02cf83f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:25.886473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf741c-16dc-4b04-8ca4-4e799c612c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:25.887183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf741c-16dc-4b04-8ca4-4e799c612c13 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:25.888267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf741c-16dc-4b04-8ca4-4e799c612c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:25.888723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf741c-16dc-4b04-8ca4-4e799c612c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:25.889597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf741c-16dc-4b04-8ca4-4e799c612c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:25.891544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf741c-16dc-4b04-8ca4-4e799c612c13 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:25.910530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:25.922275 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2051/4100] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:25.928375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a45478-280e-4a87-b7de-a1d55e129d8a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:25.936094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:25.937137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:25.937616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:25.938152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] PATH_INFO: `/v3/projects/f45ec82ca4c44195984db21c4b16e960/users/e5ca22f4061240a6a9f8c521a279a0bd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:25.940741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ec82ca4c44195984db21c4b16e960, user_id=e5ca22f4061240a6a9f8c521a279a0bd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:25.944025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:25.959198 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2050/4101] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:08:25 2022] PUT /identity/v3/projects/f45ec82ca4c44195984db21c4b16e960/users/e5ca22f4061240a6a9f8c521a279a0bd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:25.974853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:25.975500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:25.976072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:26.040507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] MFA Rules not processed for user `e5ca22f4061240a6a9f8c521a279a0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:26.042252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:26.201922 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2052/4102] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:26.207504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:26.222499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdfca-dc34-4e31-a696-7e85ecc0ec6f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:26.235105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:26.236103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:26.236595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:26.237056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:26.238218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:26.242063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:26.438308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:26.439074 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2051/4103] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:26 2022] POST /identity/v3/projects => generated 359 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:26.464854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ec031-7ed3-4a53-b7cc-3bc947b7ba00 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:26.607732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:26.608448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:26.608739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:26.609018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:26.609885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:26.611841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:26.783848 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2053/4104] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:08:26 2022] POST /identity/v3/users => generated 371 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:26.789175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:26.820493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75224b-a0bc-441e-8da4-3f84743dbf08 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:26.834028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:26.835240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:26.837044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:26.839172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:26.841453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:08:26.842942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:26.844834 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:08:26.844834 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:08:26.844834 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:08:26.848848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e73a8-50b4-4147-b0a7-df8b5ad94f4d tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:26.949187 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2052/4105] 10.222.0.78 () {58 vars in 1157 bytes} [Sun Aug 28 20:08:26 2022] GET /identity/v3/users?domain_id=default => generated 8013 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:26.951247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:26.961918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:26.978660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36dee0-11f1-454e-acd6-cbfc67b234a6 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:26.985461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:26.986496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:26.987781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:26.987781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/users/785fdad4add04a779823603b939e2d56` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:27.022159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:update_user(user_id=785fdad4add04a779823603b939e2d56)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:27.023687 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:08:27.023687 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:08:27.023687 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:08:27.026093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:27.058765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:27.233620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '785fdad4add04a779823603b939e2d56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:27.429428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invalidating the token cache because user 785fdad4add04a779823603b939e2d56 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:27.441173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:27.441173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:27.441173 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2054/4106] 10.222.0.78 () {60 vars in 1244 bytes} [Sun Aug 28 20:08:26 2022] PATCH /identity/v3/users/785fdad4add04a779823603b939e2d56 => generated 485 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:27.444035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:27.444450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:27.444996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:27.463158 n-d-854121-7 devstack@keystone.service[82299]: WARNING keystone.auth.plugins.core [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] User is disabled: 785fdad4add04a779823603b939e2d56: AssertionError: User is disabled: 785fdad4add04a779823603b939e2d56 Aug 28 20:08:27.470690 n-d-854121-7 devstack@keystone.service[82299]: WARNING keystone.server.flask.application [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 20:08:27.474656 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2053/4107] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:27 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 32 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 20:08:27.479109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:27.480179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:27.497208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8e25b-08e2-4ab6-81c4-6f8413a08123 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:27.503987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:27.504647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:27.505473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:27.505999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/users/785fdad4add04a779823603b939e2d56` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:27.524037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:delete_user(user_id=785fdad4add04a779823603b939e2d56)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:27.528610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:27.823280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785fdad4add04a779823603b939e2d56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:27.824179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785fdad4add04a779823603b939e2d56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:27.998854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785fdad4add04a779823603b939e2d56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:28.017323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785fdad4add04a779823603b939e2d56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:28.021535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2decfb8e-b667-4625-b286-fb93f92dfdd3 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785fdad4add04a779823603b939e2d56'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:28.078876 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2055/4108] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:27 2022] DELETE /identity/v3/users/785fdad4add04a779823603b939e2d56 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:28.082623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:28.085256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:28.215623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244af7d-40fb-448d-a566-58f4f5e6da86 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:28.221321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:28.222197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:28.222475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:28.223065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/projects/dae16060089545ffa9f9dead7d71bbd9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:28.224512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dae16060089545ffa9f9dead7d71bbd9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:28.227348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:28.246542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:28.246915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:28.247108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:28.281230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:28.282893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:28.285442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:28.392063 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2056/4109] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:08:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:08:28.436896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:28.438753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:28.560161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae16060089545ffa9f9dead7d71bbd9', 'request_id': 'req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:28.569174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae16060089545ffa9f9dead7d71bbd9', 'request_id': 'req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:28.594873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae16060089545ffa9f9dead7d71bbd9', 'request_id': 'req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:28.621734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786fd05-fdee-47e2-8bea-e6a2d1f3a203 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:28.800833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:28.801489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:28.801772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:28.802316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:28.913791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:28.919335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:28.933258 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2057/4110] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:08:29.086154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] The token cache is being invalidate because project dae16060089545ffa9f9dead7d71bbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:29.087082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.087972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.089840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2054/4111] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:28 2022] DELETE /identity/v3/projects/dae16060089545ffa9f9dead7d71bbd9 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:29.096628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:29.174792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52aa9f-fc43-4cc3-ac4c-674850febc2b service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:29.180759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ca22f4061240a6a9f8c521a279a0bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45ec82ca4c44195984db21c4b16e960', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:29.181587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:29.181976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:29.182365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:29.183143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:29.185454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-19e30dc5-e3e7-4654-8bcd-62266c638643 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Could not find domain: f5116eab1c1a496fb71ee67db16a7f4f.: keystone.exception.DomainNotFound: Could not find domain: f5116eab1c1a496fb71ee67db16a7f4f. Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f5116eab1c1a496fb71ee67db16a7f4f. Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:08:29.202734 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 28 20:08:29.204110 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:08:29.205456 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:08:29.206744 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:08:29.206744 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f5116eab1c1a496fb71ee67db16a7f4f. Aug 28 20:08:29.206744 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:08:29.206744 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2058/4112] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:08:29 2022] POST /identity/v3/users => generated 112 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:08:29.212923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:29.214462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:29.302999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8dbeb-08f3-4964-9db7-85f3bb096ac5 tempest-UsersNegativeTest-296703465 tempest-UsersNegativeTest-296703465-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:29.309899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:29.310721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:29.311061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:29.311347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] PATH_INFO: `/v3/users/aab3276ad83b4b0c9d4b84db41c09457` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:29.312733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab3276ad83b4b0c9d4b84db41c09457)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:29.314850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:29.817336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab3276ad83b4b0c9d4b84db41c09457'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.849893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab3276ad83b4b0c9d4b84db41c09457'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.869183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab3276ad83b4b0c9d4b84db41c09457'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.871012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab3276ad83b4b0c9d4b84db41c09457'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.873533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab3276ad83b4b0c9d4b84db41c09457'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:29.990631 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2055/4113] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:29 2022] DELETE /identity/v3/users/aab3276ad83b4b0c9d4b84db41c09457 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:29.997527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:29.997527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:29.997527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:30.057200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:30.061513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:30.212979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:30.353980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2059/4114] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:30.430762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:30.432736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:30.595105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71fb50-c322-4f41-b511-5bd3a83dc53e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:30.614714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:30.622135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:30.622135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:30.622135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:30.654147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:30.657385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:30.689937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2056/4115] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:32.182291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:32.184517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:32.222284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d8b33-1c87-48b6-a7c3-ea8339317b21 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:32.340838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:32.355265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:32.356896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:32.364403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] PATH_INFO: `/v3/projects/9e21adcdeba24ec289dc149097e7d27c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:32.382249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e21adcdeba24ec289dc149097e7d27c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:32.382249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:32.753686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e21adcdeba24ec289dc149097e7d27c', 'request_id': 'req-72d34af4-e511-45bb-af1e-389dc000c1fc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:32.777085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e21adcdeba24ec289dc149097e7d27c', 'request_id': 'req-72d34af4-e511-45bb-af1e-389dc000c1fc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:32.795076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e21adcdeba24ec289dc149097e7d27c', 'request_id': 'req-72d34af4-e511-45bb-af1e-389dc000c1fc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:32.938882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] The token cache is being invalidate because project 9e21adcdeba24ec289dc149097e7d27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:32.939378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:32.939992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:32.941818 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2060/4116] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:32 2022] DELETE /identity/v3/projects/9e21adcdeba24ec289dc149097e7d27c => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:32.949071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:32.968514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22086e-e63a-461d-9046-e24b49ae869a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:33.174814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:33.177224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:33.177665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:33.178681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] PATH_INFO: `/v3/users/e5ca22f4061240a6a9f8c521a279a0bd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:33.182649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ca22f4061240a6a9f8c521a279a0bd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:33.192643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:33.577366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:33.578323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ca22f4061240a6a9f8c521a279a0bd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:33.631927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ca22f4061240a6a9f8c521a279a0bd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:33.662746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ca22f4061240a6a9f8c521a279a0bd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:33.666350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ca22f4061240a6a9f8c521a279a0bd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:33.668708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5b6e5ab-01b6-4c00-8796-1cd17338b888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ca22f4061240a6a9f8c521a279a0bd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:33.854418 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2057/4117] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:32 2022] DELETE /identity/v3/users/e5ca22f4061240a6a9f8c521a279a0bd => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:08:35.057444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:35.059372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:35.105957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d34af4-e511-45bb-af1e-389dc000c1fc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:35.241448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:35.242238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:35.242536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:35.242819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] PATH_INFO: `/v3/projects/f45ec82ca4c44195984db21c4b16e960` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:35.244199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45ec82ca4c44195984db21c4b16e960)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:35.248919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:35.540842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45ec82ca4c44195984db21c4b16e960', 'request_id': 'req-43f02bdd-cbf0-4097-a72d-79b1b6056a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:35.557717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45ec82ca4c44195984db21c4b16e960', 'request_id': 'req-43f02bdd-cbf0-4097-a72d-79b1b6056a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:35.573843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45ec82ca4c44195984db21c4b16e960', 'request_id': 'req-43f02bdd-cbf0-4097-a72d-79b1b6056a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:35.646108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:35.802208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] The token cache is being invalidate because project f45ec82ca4c44195984db21c4b16e960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:35.802208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:35.802208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43f02bdd-cbf0-4097-a72d-79b1b6056a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:35.816420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2061/4118] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:35 2022] DELETE /identity/v3/projects/f45ec82ca4c44195984db21c4b16e960 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:35.818566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:35.818854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:35.819134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:35.866442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:35.868303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:35.993201 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2058/4119] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:36.011373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.011867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.012802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.051138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:36.053378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:36.068495 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2062/4120] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:36.074669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.099520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf174-f9c7-4341-bb6c-5e968ae5c599 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.105208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.106490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.107881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.108442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.109592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:08:36.110123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:36.112763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:36.136212 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2059/4121] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:36.136515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.153963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcf4f-88d2-45d5-93f2-be6e1cecc437 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.161705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.162683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.163281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.163811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.164713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:36.168821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:36.174409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:36.330114 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2063/4122] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:36 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:08:36.330381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.339264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b132c81-972d-4029-ad84-223a513a1e71 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.485649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.487124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.487847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.488560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.489902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:36.493835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:36.693435 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2060/4123] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:08:36 2022] POST /identity/v3/users => generated 287 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:08:36.701705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.726241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96dc6-8998-407c-a5f2-41ffaa043e21 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.736608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.737987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.738720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.739410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.740776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:36.745095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:36.747347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.749483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:36.773162 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2064/4124] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:36.783522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.799887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509184-ae15-4e71-b28e-915faed2ab69 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.806969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.807921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.809227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.809737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.810481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:36.812693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:36.836931 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2065/4125] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:08:36.856613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:36.885971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ee22-5505-400c-9f4b-3c81623af2ca admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.899995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b52e7e-0dbd-432c-abed-f210108f0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.900690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b52e7e-0dbd-432c-abed-f210108f0f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.900972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b52e7e-0dbd-432c-abed-f210108f0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.901248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b52e7e-0dbd-432c-abed-f210108f0f7e admin admin] PATH_INFO: `/v3/projects/4f5faecbc08f4cbd852fe844a3815781/users/53e192ae07d040c2bafb8fab39292c7a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.935940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b52e7e-0dbd-432c-abed-f210108f0f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5faecbc08f4cbd852fe844a3815781, user_id=53e192ae07d040c2bafb8fab39292c7a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:36.939099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b52e7e-0dbd-432c-abed-f210108f0f7e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:36.953546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29724ea1-5305-464d-afcc-3ce02780932d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:36.970995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:36.971645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:36.971928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:36.972203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:36.974325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:36.997471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:37.000317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717b11-d9e3-4dae-957c-dfd9fa0b8d06 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:37.032527 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2061/4126] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:08:37.105230 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2066/4127] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:08:36 2022] PUT /identity/v3/projects/4f5faecbc08f4cbd852fe844a3815781/users/53e192ae07d040c2bafb8fab39292c7a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:37.237748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219e09a-6d99-4180-b4c6-11a850077a2f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:37.237748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219e09a-6d99-4180-b4c6-11a850077a2f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:37.237748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219e09a-6d99-4180-b4c6-11a850077a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:37.298117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0219e09a-6d99-4180-b4c6-11a850077a2f None None] MFA Rules not processed for user `53e192ae07d040c2bafb8fab39292c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:37.299997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0219e09a-6d99-4180-b4c6-11a850077a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:37.498025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:37.514680 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2062/4128] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:37.649776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:37.650150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:37.650978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:37.667467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:37.667792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:37.668037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:37.685985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:37.688197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:37.703886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:37.707113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:37.729741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:37.830279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2067/4129] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:37.857269 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2063/4130] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:08:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:08:37.882105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:37.884392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:37.995199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e9c90-bd4c-4c5b-b795-f91afcdf1df8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:38.005990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:38.006718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:38.007004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:38.007330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:38.020316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:38.022117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:38.035390 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2068/4131] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:08:38.328468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:38.328468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:38.508031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13248-7579-4e6f-abbb-347f1a71060b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:38.518156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:38.518806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:38.519091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:38.519357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:38.525260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:38.555789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:38.565104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:38.585573 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2064/4132] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:39.076931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:40.101174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:41.448609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:41.560772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:42.340875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:42.751763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:43.501612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:44.564491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:44.892326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:45.937244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:46.634898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:47.387610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:49.053535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:49.057532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:49.248001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a1ca-9b6f-43c0-be1e-e6a9baab8ac2 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:49.256149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962c746-4891-4acc-989b-3a8c492cc6dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:49.256969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962c746-4891-4acc-989b-3a8c492cc6dd service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:49.257492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962c746-4891-4acc-989b-3a8c492cc6dd service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:49.257825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962c746-4891-4acc-989b-3a8c492cc6dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:49.282787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962c746-4891-4acc-989b-3a8c492cc6dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:49.284843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962c746-4891-4acc-989b-3a8c492cc6dd service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:49.301582 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2069/4133] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:49.422109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:49.668451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:51.243205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:51.245747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:51.388169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:51.389137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:51.389605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:51.435880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:51.438017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:51.455138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:51.455138 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2070/4134] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:08:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:51.493349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf477-70ed-49af-9b50-bb79d54efcaf service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:51.505557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:51.507474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:51.508091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:51.509073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:51.510112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:51.518627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:51.536782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b05fc-dcd1-427c-a07f-8eeffbe5f10a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:51.542546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:51.544673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:51.560398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e898dce-569a-4d94-b817-0d298eb17a9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:51.561290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e898dce-569a-4d94-b817-0d298eb17a9e service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:51.561680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e898dce-569a-4d94-b817-0d298eb17a9e service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:51.562071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e898dce-569a-4d94-b817-0d298eb17a9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:51.574995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2065/4135] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:51.586795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e898dce-569a-4d94-b817-0d298eb17a9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:51.588623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e898dce-569a-4d94-b817-0d298eb17a9e service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:51.621891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2071/4136] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:08:51.884211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:55.821016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:55.972586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd87a3-3a1b-459c-9731-0c3d36ba8740 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:55.978928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:55.979894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:55.980181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:55.980460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] PATH_INFO: `/v3/users/53e192ae07d040c2bafb8fab39292c7a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:55.982122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e192ae07d040c2bafb8fab39292c7a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:55.985267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:56.182637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:56.311850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e192ae07d040c2bafb8fab39292c7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:56.332271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e192ae07d040c2bafb8fab39292c7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:56.353680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e192ae07d040c2bafb8fab39292c7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:56.355687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e192ae07d040c2bafb8fab39292c7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:56.356657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e192ae07d040c2bafb8fab39292c7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:56.528109 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2066/4137] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:55 2022] DELETE /identity/v3/users/53e192ae07d040c2bafb8fab39292c7a => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:56.532963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e55e4-d007-49fa-942e-a7322b930c8d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:56.533681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e55e4-d007-49fa-942e-a7322b930c8d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:56.534061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e55e4-d007-49fa-942e-a7322b930c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:56.556152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8c8e55e4-d007-49fa-942e-a7322b930c8d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:56.557403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c8e55e4-d007-49fa-942e-a7322b930c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:56.604708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:56.678956 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2072/4138] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:56.757362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:56.760956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:56.907857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79452831-a7cb-433e-9ed7-92f4d041eb62 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:56.920282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:56.924997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:56.925308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:56.926258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:56.948004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:56.949972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:56.973219 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2067/4139] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:08:57.026596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0df4-c899-40c8-aa5e-3f69d724e715 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:57.027277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0df4-c899-40c8-aa5e-3f69d724e715 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:57.028391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0df4-c899-40c8-aa5e-3f69d724e715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:57.103970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4e1b0df4-c899-40c8-aa5e-3f69d724e715 None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:57.104348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4e1b0df4-c899-40c8-aa5e-3f69d724e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:57.270096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2073/4140] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:59.036540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:59.037896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:59.065815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a71f-cbdb-46af-8799-fe6c41fa8d55 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:59.072977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:59.073728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.074847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.075236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] PATH_INFO: `/v3/projects/4f5faecbc08f4cbd852fe844a3815781` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.076598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5faecbc08f4cbd852fe844a3815781)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:59.079159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:59.360600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5faecbc08f4cbd852fe844a3815781', 'request_id': 'req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:59.372593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5faecbc08f4cbd852fe844a3815781', 'request_id': 'req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:59.388889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5faecbc08f4cbd852fe844a3815781', 'request_id': 'req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:59.399227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.400164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.400396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.451793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:59.453158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:59.544699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] The token cache is being invalidate because project 4f5faecbc08f4cbd852fe844a3815781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:59.548671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:59.549184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a45d55f-46ef-4e5c-b36a-c39afc7ff293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:59.554920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2068/4141] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:59 2022] DELETE /identity/v3/projects/4f5faecbc08f4cbd852fe844a3815781 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:59.557175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccbf95-317c-4084-9d84-b5162d2a4d73 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.557578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccbf95-317c-4084-9d84-b5162d2a4d73 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.558067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccbf95-317c-4084-9d84-b5162d2a4d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.599855 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2074/4142] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:08:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:08:59.600438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-38ccbf95-317c-4084-9d84-b5162d2a4d73 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:59.614299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-38ccbf95-317c-4084-9d84-b5162d2a4d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:59.616813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:59.618101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:59.681295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2069/4143] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:08:59.702338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.702627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.703792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.767711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e5b11-6443-465b-88d1-eadd136c8c37 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:59.771145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:59.774176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:59.774354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:59.775294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.775576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.775852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.790834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:59.792541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:59.801843 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2070/4144] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:59.803330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:59.812960 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2075/4145] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:08:59.865770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4097d-7140-4e94-83b7-69b7f1f1cb88 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:59.879783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:59.880596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.880967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.881393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.883096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:08:59.883482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:59.885051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:59.901904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2071/4146] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:08:59.906931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:59.923687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a07bd-2a3e-4dd2-b72e-8e666221ed7b service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:59.930243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:59.931087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:59.931370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:59.931662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:59.932426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:59.935963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:00.085944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:00.098048 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2076/4147] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:08:59 2022] POST /identity/v3/projects => generated 411 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:00.098662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:00.110751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca535e-34a8-409e-aa4b-828e3b5afe35 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:00.208909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:00.210144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:00.210509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:00.210971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:00.211989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:00.214644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:00.454736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:00.455722 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2072/4148] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:00 2022] POST /identity/v3/users => generated 306 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:09:00.467048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4a92c-54d9-4a8a-b9db-95701727bb94 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:00.473215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:00.474298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:00.474641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:00.474964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:00.476563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:00.478485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:00.492564 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2077/4149] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:00.499855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:00.513783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eeef1-a291-43e6-ac4d-dbd07ea2b6cc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:00.519541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:00.524976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3677e-b7ab-49e8-b9d5-a8bc562e907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:00.525822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3677e-b7ab-49e8-b9d5-a8bc562e907b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:00.526320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3677e-b7ab-49e8-b9d5-a8bc562e907b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:00.526778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3677e-b7ab-49e8-b9d5-a8bc562e907b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:00.527618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3677e-b7ab-49e8-b9d5-a8bc562e907b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:00.529714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3677e-b7ab-49e8-b9d5-a8bc562e907b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:00.549162 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2073/4150] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:00.550808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:00.563577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6d1a-d915-4be6-8090-6e33c1698164 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:00.569959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:00.570788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:00.571156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:00.571344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] PATH_INFO: `/v3/projects/74cef9eacbf14889acf8f3c4f2f315cf/users/e3ae3c64fafb4e8388c96471360e0cd8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:00.589592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cef9eacbf14889acf8f3c4f2f315cf, user_id=e3ae3c64fafb4e8388c96471360e0cd8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:00.594220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:00.853582 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2078/4151] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:00 2022] PUT /identity/v3/projects/74cef9eacbf14889acf8f3c4f2f315cf/users/e3ae3c64fafb4e8388c96471360e0cd8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:00.871149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:00.871881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:00.873159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:00.915381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] MFA Rules not processed for user `e3ae3c64fafb4e8388c96471360e0cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:00.916893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:01.126073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2074/4152] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:00 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:01.132137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:01.288786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae749429-7d6c-4548-8fce-e4f55b075429 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:01.319065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824417-5c3a-45c6-a694-7f9927695f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:01.320317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824417-5c3a-45c6-a694-7f9927695f03 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:01.320718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824417-5c3a-45c6-a694-7f9927695f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:01.320902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824417-5c3a-45c6-a694-7f9927695f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:01.321573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3824417-5c3a-45c6-a694-7f9927695f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:01.324067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3824417-5c3a-45c6-a694-7f9927695f03 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:01.512830 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2079/4153] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:01 2022] POST /identity/v3/projects => generated 411 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:01.519364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:01.574061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d2d8-bb56-473b-8c5b-3861bbc0ab4e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:01.708390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:01.709244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:01.711458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:01.711855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:01.713429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:01.716047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:01.800833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:01.805117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:01.805117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:01.837270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:01.838599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:01.874875 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2075/4154] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:01 2022] POST /identity/v3/users => generated 312 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:01.875772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:01.890989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd752-2e32-4ccc-811a-41ad011e59c6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:01.903716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:01.904519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:01.904902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:01.905628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:01.906242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:01.908500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:01.925531 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2076/4155] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:09:01.931150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:01.943197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2080/4156] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:01.953656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7547-5217-4f7d-a535-ebabd1844e83 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:01.959458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:01.961894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:01.962684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:01.964059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:01.964432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] PATH_INFO: `/v3/projects/131f6e01af7047a0afa53fbd916ca0f6/users/970a4728261049cf965d3f8b987aa3e2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:01.992079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131f6e01af7047a0afa53fbd916ca0f6, user_id=970a4728261049cf965d3f8b987aa3e2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:01.996360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:02.068653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b806be-e734-46bd-bd72-87cd8b0e5112 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:02.074843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:02.076763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:02.077231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:02.077504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:02.088034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:02.090740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:02.106171 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2081/4157] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:09:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:09:02.124961 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2077/4158] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:01 2022] PUT /identity/v3/projects/131f6e01af7047a0afa53fbd916ca0f6/users/970a4728261049cf965d3f8b987aa3e2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:02.131177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:02.150020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b186-63a5-4c52-bdfb-3382c3def23b service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:02.222417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e71622-4772-43fa-bdba-ef75120e752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:02.223034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e71622-4772-43fa-bdba-ef75120e752b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:02.223319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e71622-4772-43fa-bdba-ef75120e752b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:02.223596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e71622-4772-43fa-bdba-ef75120e752b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:02.224267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e71622-4772-43fa-bdba-ef75120e752b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:02.226490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e71622-4772-43fa-bdba-ef75120e752b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:02.242308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2082/4159] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:02.243555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:02.265587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821d991-5ebb-4b6d-a0c8-659e911cc155 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:02.273250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:02.274023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:02.274296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:02.274805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] PATH_INFO: `/v3/projects/131f6e01af7047a0afa53fbd916ca0f6/users/970a4728261049cf965d3f8b987aa3e2/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:02.277608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131f6e01af7047a0afa53fbd916ca0f6, user_id=970a4728261049cf965d3f8b987aa3e2, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:02.283316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:02.299337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2078/4160] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:02 2022] PUT /identity/v3/projects/131f6e01af7047a0afa53fbd916ca0f6/users/970a4728261049cf965d3f8b987aa3e2/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:02.311857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:02.315722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:02.315722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:02.360190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] MFA Rules not processed for user `970a4728261049cf965d3f8b987aa3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:02.362029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:02.457629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2083/4161] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:02.472066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:02.474287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:02.593427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e72a6-ce50-4c8a-b04e-6fcb2d8d8e16 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:02.598361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067150-0a8a-4df9-911c-ce64b804bf79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:02.599091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067150-0a8a-4df9-911c-ce64b804bf79 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:02.599427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067150-0a8a-4df9-911c-ce64b804bf79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:02.599919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067150-0a8a-4df9-911c-ce64b804bf79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:02.615089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067150-0a8a-4df9-911c-ce64b804bf79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:02.616917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067150-0a8a-4df9-911c-ce64b804bf79 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:02.629571 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2079/4162] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:02 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:02.633342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:03.606202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:03.608134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:03.744055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5d280-4dda-4ed1-9e46-3f775eb4af9d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:03.753004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:03.755159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:03.755159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:03.755159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:03.759464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:03.794389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:03.796377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:03.823040 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2084/4163] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:04.153724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:04.422745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:04.497659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6398ed-724a-47c6-b629-1f3b0ce64423 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:04.498301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6398ed-724a-47c6-b629-1f3b0ce64423 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:04.499061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6398ed-724a-47c6-b629-1f3b0ce64423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:04.530328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fd6398ed-724a-47c6-b629-1f3b0ce64423 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:04.530328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd6398ed-724a-47c6-b629-1f3b0ce64423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:04.628166 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2080/4164] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:09:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:04.648175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:04.766149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895e78-f839-4da8-af17-f17291b1c0da service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:04.772121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:04.774234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:04.774578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:04.774849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:04.787382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:04.793182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:04.805704 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2085/4165] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:09:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:09:05.228122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:06.057712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:07.050099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:07.051059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:07.051620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:07.096046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:07.098239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:07.121319 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2081/4166] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:09:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:07.132185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:07.155494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102772de-6baf-48cd-9909-73230c25ba05 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:07.166694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:07.175562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeff39-936d-423d-b223-66476b04356a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:07.176395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeff39-936d-423d-b223-66476b04356a service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:07.176864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeff39-936d-423d-b223-66476b04356a service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:07.177189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeff39-936d-423d-b223-66476b04356a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:07.194700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeff39-936d-423d-b223-66476b04356a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:07.202532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeff39-936d-423d-b223-66476b04356a service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:07.231780 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2086/4167] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:09:07.394386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:09.294284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:09.405226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:09.474086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e630e5-41e2-4264-9cc9-44cc852bc1be None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:09.504769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:09.505429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:09.505710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:09.506034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] PATH_INFO: `/v3/users/e3ae3c64fafb4e8388c96471360e0cd8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:09.512460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ae3c64fafb4e8388c96471360e0cd8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:09.514689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:09.799879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ae3c64fafb4e8388c96471360e0cd8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:09.836343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ae3c64fafb4e8388c96471360e0cd8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:09.849932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ae3c64fafb4e8388c96471360e0cd8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:09.851522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ae3c64fafb4e8388c96471360e0cd8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:09.852320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ae3c64fafb4e8388c96471360e0cd8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:09.985533 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2082/4168] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:09 2022] DELETE /identity/v3/users/e3ae3c64fafb4e8388c96471360e0cd8 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:09.992765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:09.993978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:09.994400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:10.052439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:10.057407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:10.239755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2087/4169] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:10.257381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:10.260915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:10.441137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfc2cc-d47a-436a-ad2d-bab0a6bdd0cd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:10.454633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:10.458230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:10.458702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:10.459154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:10.475741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:10.480153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:10.522053 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2083/4170] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:10.894476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:11.428133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:11.431255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:11.462080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab019e8d-dd45-4037-9413-68c886231fc0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:11.479423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:11.480093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:11.480383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:11.480657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] PATH_INFO: `/v3/users/f88456d9616643598fcb8444ca9bac26` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:11.482001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88456d9616643598fcb8444ca9bac26)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:11.484221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:11.715444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88456d9616643598fcb8444ca9bac26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:11.716391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88456d9616643598fcb8444ca9bac26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:11.772416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:11.773896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:11.794774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9822e-1b6f-49f8-9363-7e6273e83524 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:11.806041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:11.807033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:11.807480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:11.808175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] PATH_INFO: `/v3/projects/74cef9eacbf14889acf8f3c4f2f315cf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:11.809689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cef9eacbf14889acf8f3c4f2f315cf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:11.811955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:11.823210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88456d9616643598fcb8444ca9bac26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:11.832457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88456d9616643598fcb8444ca9bac26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:11.835688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0e2b69b7-b616-4d96-af08-452ae42da3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88456d9616643598fcb8444ca9bac26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:11.889802 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2088/4171] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:11 2022] DELETE /identity/v3/users/f88456d9616643598fcb8444ca9bac26 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:11.903728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:11.904295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:11.904759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:11.953654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:11.954923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:11.979305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cef9eacbf14889acf8f3c4f2f315cf', 'request_id': 'req-0df444fa-0127-49b7-86f3-b38f79450224'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:11.996869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cef9eacbf14889acf8f3c4f2f315cf', 'request_id': 'req-0df444fa-0127-49b7-86f3-b38f79450224'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.010848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cef9eacbf14889acf8f3c4f2f315cf', 'request_id': 'req-0df444fa-0127-49b7-86f3-b38f79450224'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.061691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2089/4172] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:12.076710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:12.079195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] The token cache is being invalidate because project 74cef9eacbf14889acf8f3c4f2f315cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:12.079495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.086011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:12.090621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.092623 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2084/4173] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:11 2022] DELETE /identity/v3/projects/74cef9eacbf14889acf8f3c4f2f315cf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:12.097113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:12.098680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:12.120946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df444fa-0127-49b7-86f3-b38f79450224 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:12.138924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:12.139582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:12.140065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:12.140330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] PATH_INFO: `/v3/users/970a4728261049cf965d3f8b987aa3e2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:12.141795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=970a4728261049cf965d3f8b987aa3e2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:12.143880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:12.218942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b5987-8b16-4419-bd70-879c1dd51324 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:12.230110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:12.231552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:12.233061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:12.234143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:12.237499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:12.267851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:12.267851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:12.281122 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2090/4174] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:12.440222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970a4728261049cf965d3f8b987aa3e2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.461223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970a4728261049cf965d3f8b987aa3e2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.478305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970a4728261049cf965d3f8b987aa3e2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.479101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970a4728261049cf965d3f8b987aa3e2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.479761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b496230d-a6f5-4210-9300-22f29b708c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970a4728261049cf965d3f8b987aa3e2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:12.585147 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2085/4175] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:12 2022] DELETE /identity/v3/users/970a4728261049cf965d3f8b987aa3e2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:12.947636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:13.325283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:13.333232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:13.367002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bb9f-0dc7-451d-8890-2c7d417a9035 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:13.539367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:13.540406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:13.540864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:13.541322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] PATH_INFO: `/v3/projects/203692bd2bae4a1aabf78de445be8fe2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:13.543404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=203692bd2bae4a1aabf78de445be8fe2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:13.546826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:13.774762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203692bd2bae4a1aabf78de445be8fe2', 'request_id': 'req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:13.795307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203692bd2bae4a1aabf78de445be8fe2', 'request_id': 'req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:13.806148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203692bd2bae4a1aabf78de445be8fe2', 'request_id': 'req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:13.902223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] The token cache is being invalidate because project 203692bd2bae4a1aabf78de445be8fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:13.902223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:13.903248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:13.908718 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2091/4176] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:13 2022] DELETE /identity/v3/projects/203692bd2bae4a1aabf78de445be8fe2 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:13.913329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931607e0-2edc-45c4-b912-a164187f809f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:13.915342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931607e0-2edc-45c4-b912-a164187f809f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:13.917137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931607e0-2edc-45c4-b912-a164187f809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:13.955944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-931607e0-2edc-45c4-b912-a164187f809f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:13.964773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-931607e0-2edc-45c4-b912-a164187f809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:14.008074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:14.011353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:14.111596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2086/4177] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:14.120334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:14.122348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:14.122348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:14.202389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:14.209920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:14.229646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8c2a-6174-4ca1-8f0c-bb65b5dcb36b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:14.252436 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2087/4178] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:14.253169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:14.253868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:14.254983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:14.255277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] PATH_INFO: `/v3/projects/131f6e01af7047a0afa53fbd916ca0f6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:14.257786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:14.263168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=131f6e01af7047a0afa53fbd916ca0f6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:14.265139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:14.298539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728513c-e520-4fe8-8cb4-61c54b3da0d8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:14.314596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:14.315226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:14.315503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:14.315773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:14.316425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:14.316997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:14.319189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:14.352817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:14.362891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2088/4179] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:09:14.366043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:14.401393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bfada-07e8-4d0e-a7a0-68b4e16d9999 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:14.448555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131f6e01af7047a0afa53fbd916ca0f6', 'request_id': 'req-d63fdf6f-cf7a-48ba-b236-4737277088b8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:14.464715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131f6e01af7047a0afa53fbd916ca0f6', 'request_id': 'req-d63fdf6f-cf7a-48ba-b236-4737277088b8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:14.487358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131f6e01af7047a0afa53fbd916ca0f6', 'request_id': 'req-d63fdf6f-cf7a-48ba-b236-4737277088b8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:14.649131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:14.650522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:14.650725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:14.650926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:14.651552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:14.653417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:14.661983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] The token cache is being invalidate because project 131f6e01af7047a0afa53fbd916ca0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:14.663129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:14.666417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d63fdf6f-cf7a-48ba-b236-4737277088b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:14.668156 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2092/4180] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:14 2022] DELETE /identity/v3/projects/131f6e01af7047a0afa53fbd916ca0f6 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:14.673052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06231bf2-f16f-4b20-9cc6-c89f3cd3ad7f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:14.673662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06231bf2-f16f-4b20-9cc6-c89f3cd3ad7f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:14.674159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06231bf2-f16f-4b20-9cc6-c89f3cd3ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:14.740020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-06231bf2-f16f-4b20-9cc6-c89f3cd3ad7f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:14.745188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-06231bf2-f16f-4b20-9cc6-c89f3cd3ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:14.769374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2093/4181] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:14.777841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:14.778358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:14.778803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:14.826041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:14.830667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:14.863023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:14.866898 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2094/4182] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:14.870030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:14.871460 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2089/4183] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:14 2022] POST /identity/v3/projects => generated 397 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:14.875864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:14.883108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:14.897883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ece41-cdaa-49fb-8077-800b6d69d1df None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.052392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a282745-ccd9-4a3b-8854-db36dc36240d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.056283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.056930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.057215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.057496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.058473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:15.058784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.060533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.075234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.075870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.076157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.076432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.077518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.082334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.089144 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2095/4184] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:09:15.094391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.111248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57d2fb-2ff7-40fa-88fc-5b693277f961 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.120048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.121034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.121444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.121730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.122593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.126771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.283584 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2090/4185] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:14 2022] POST /identity/v3/users => generated 299 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:09:15.284653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.306752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd464-52d7-45f7-b2a9-561ececafb13 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.322470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:15.343385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.348962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2096/4186] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:15 2022] POST /identity/v3/projects => generated 399 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:15.350609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.351360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.356891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.357628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.357628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.364465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.420067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2091/4187] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:15.421182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.474479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae990-82d2-4764-8921-528b1fbaf390 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.537185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7878b10-0075-4da7-93e8-44ebc0d6baa5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.551616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.558274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.559505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.570481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.576806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.589601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.653445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.654662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.655159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.655799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.656784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.659380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.690682 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2092/4188] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:15.693652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.744796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d603-9868-47f1-9b3d-54a2968dde37 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.765967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a558c-1c46-4ce6-bb75-470c3f029669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.767368 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2097/4189] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:15 2022] POST /identity/v3/users => generated 300 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:15.772585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a558c-1c46-4ce6-bb75-470c3f029669 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.773364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a558c-1c46-4ce6-bb75-470c3f029669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.773726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a558c-1c46-4ce6-bb75-470c3f029669 admin admin] PATH_INFO: `/v3/projects/5afef5a6b2e74b02a0459ebbe0bb0843/users/b623d81bb3794beaabfba5ed7f7ee574/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.774136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.804795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ce167-f4e7-4866-9a16-04ed9f4ff788 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.821239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.822817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.823123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.823395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.827708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.827708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.848321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a558c-1c46-4ce6-bb75-470c3f029669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afef5a6b2e74b02a0459ebbe0bb0843, user_id=b623d81bb3794beaabfba5ed7f7ee574, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.863385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a558c-1c46-4ce6-bb75-470c3f029669 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:15.874714 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2098/4190] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:09:15.879801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:15.908502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bd57e-3465-4368-b233-c88fb82e3c23 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:15.932143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:15.936445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:15.937097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:15.937679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:15.939248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:15.944619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:16.009579 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2093/4191] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:15 2022] PUT /identity/v3/projects/5afef5a6b2e74b02a0459ebbe0bb0843/users/b623d81bb3794beaabfba5ed7f7ee574/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:16.013225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:16.018415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:16.018415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:16.028070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2099/4192] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:09:16.031091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:16.065377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca899-cc6d-452f-a3e9-5b786cedb5c5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:16.077309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:16.078796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:16.202842 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2094/4193] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:16.235019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729403-e16f-4f18-bc4b-3bf44cf96d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:16.241044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729403-e16f-4f18-bc4b-3bf44cf96d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:16.241044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729403-e16f-4f18-bc4b-3bf44cf96d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:16.241044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729403-e16f-4f18-bc4b-3bf44cf96d2c admin admin] PATH_INFO: `/v3/projects/44d8907c151b471b902932c5eb730aff/users/b6ecaeadc42646d2a4c5e7a4644f7f9b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:16.277489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1729403-e16f-4f18-bc4b-3bf44cf96d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d8907c151b471b902932c5eb730aff, user_id=b6ecaeadc42646d2a4c5e7a4644f7f9b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:16.280665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1729403-e16f-4f18-bc4b-3bf44cf96d2c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:16.345312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:16.347211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:16.405971 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2100/4194] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:16 2022] PUT /identity/v3/projects/44d8907c151b471b902932c5eb730aff/users/b6ecaeadc42646d2a4c5e7a4644f7f9b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:16.425726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:16.426171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:16.426550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:16.522870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] MFA Rules not processed for user `b6ecaeadc42646d2a4c5e7a4644f7f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:16.526550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:16.590899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1b801-80cb-4066-b163-daeaf4fde044 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:16.723518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:16.724375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:16.724802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:16.725181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:16.807465 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2101/4195] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:16.820720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:16.858447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:16.860341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:16.886427 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2095/4196] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:09:16.955170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d301-1920-4958-b3e0-fb67d79b71e6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:16.974670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:16.976536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:16.977220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:16.978017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:16.978969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:16.981509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:17.192257 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2102/4197] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:16 2022] POST /identity/v3/projects => generated 399 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:09:17.196180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:17.208301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f53c8-b8d0-496e-a72d-20b05a294844 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:17.362176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:17.362808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:17.363092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:17.363375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:17.364027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:17.366045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:17.495786 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2096/4198] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:17 2022] POST /identity/v3/users => generated 306 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:17.500710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:17.519320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da173c5-2770-44bf-ad6e-4cb0dfb48880 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:17.524857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:17.533780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:17.535866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:17.535866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:17.535866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:17.536342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:17.538198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:17.550420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2103/4199] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:17.554869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:17.573404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f74554-0fca-4fa8-bf65-f947ca7a19d7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:17.587774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:17.588746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:17.589742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:17.590257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] PATH_INFO: `/v3/projects/54e4891c779b466388567d4ae2c56fcc/users/fe110ee2441e40cfaf87e7a636a5067e/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:17.629772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e4891c779b466388567d4ae2c56fcc, user_id=fe110ee2441e40cfaf87e7a636a5067e, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:17.638516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:17.834510 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2097/4200] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:17 2022] PUT /identity/v3/projects/54e4891c779b466388567d4ae2c56fcc/users/fe110ee2441e40cfaf87e7a636a5067e/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:17.838885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:17.851312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1ec25-b7b1-410c-a7d6-50a4abed4e22 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:17.964246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57314-5f41-4260-86ce-e6815cd2a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:17.964888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57314-5f41-4260-86ce-e6815cd2a60d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:17.965174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57314-5f41-4260-86ce-e6815cd2a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:17.965658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57314-5f41-4260-86ce-e6815cd2a60d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:17.966694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e57314-5f41-4260-86ce-e6815cd2a60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:17.974228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e57314-5f41-4260-86ce-e6815cd2a60d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:17.996819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2104/4201] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:18.003257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:18.022867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f1957-dfe2-4e13-996d-795b89db7528 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:18.036342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:18.037891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:18.038343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:18.038780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] PATH_INFO: `/v3/projects/54e4891c779b466388567d4ae2c56fcc/users/fe110ee2441e40cfaf87e7a636a5067e/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:18.046073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e4891c779b466388567d4ae2c56fcc, user_id=fe110ee2441e40cfaf87e7a636a5067e, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:18.049425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:18.079153 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2098/4202] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:17 2022] PUT /identity/v3/projects/54e4891c779b466388567d4ae2c56fcc/users/fe110ee2441e40cfaf87e7a636a5067e/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:18.090543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b61d-9c87-4f55-a60e-b89a306ee603 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:18.091218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b61d-9c87-4f55-a60e-b89a306ee603 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:18.091839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b61d-9c87-4f55-a60e-b89a306ee603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:18.138447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9e79b61d-9c87-4f55-a60e-b89a306ee603 None None] MFA Rules not processed for user `fe110ee2441e40cfaf87e7a636a5067e`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:18.153007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9e79b61d-9c87-4f55-a60e-b89a306ee603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:18.203183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:18.331545 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2105/4203] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:18.370456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:18.501663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a706-316b-4888-b57b-c643ea44b122 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:18.507678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:18.508830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:18.509339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:18.509920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:18.583749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:18.585842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:18.597072 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2099/4204] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:19.622059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:19.622989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:19.624643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:19.651134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:19.652703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:19.774864 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2106/4205] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:20.404607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:20.604720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:21.063370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:21.074896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25261839-33e4-4c0b-9730-87443b197219 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:21.081195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:21.085344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:21.085928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:21.086351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:21.088799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:21.101154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:21.103456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f42b3-d916-498e-b0a8-6c6500983a38 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:21.117169 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2100/4206] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:21.422278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:21.430057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:21.643937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069cbd1-ed55-4441-8dfb-5317cb392761 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:21.657502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:21.658185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:21.658474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:21.658756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:21.679465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:21.681516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:21.705807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2107/4207] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:21.899524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:22.536128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:24.726593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81886-7b87-4b02-b857-9a9597bb5348 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:24.727374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81886-7b87-4b02-b857-9a9597bb5348 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:24.727374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81886-7b87-4b02-b857-9a9597bb5348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:24.766343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7bd81886-7b87-4b02-b857-9a9597bb5348 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:24.767859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7bd81886-7b87-4b02-b857-9a9597bb5348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:24.900637 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2101/4208] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:09:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:24.915313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:24.916876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:25.134475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81309c-b7d7-426c-bdc0-35c7881282ec service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:25.141814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:25.142834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:25.143290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:25.143722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:25.155643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:25.157875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:25.191943 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2108/4209] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:09:25.296232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:25.972924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1c8ba-caa6-4a30-8246-cdba964c174f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:25.973781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1c8ba-caa6-4a30-8246-cdba964c174f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:25.973781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1c8ba-caa6-4a30-8246-cdba964c174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:26.009555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-aba1c8ba-caa6-4a30-8246-cdba964c174f None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:26.011269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aba1c8ba-caa6-4a30-8246-cdba964c174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:26.028974 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2102/4210] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:09:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:26.043741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:26.057510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe5dfa-43fd-46f9-96e7-8beaf1d32a31 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:26.067278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:26.075353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:26.076686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:26.077153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:26.077648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:26.092692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:26.095353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:26.112200 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2109/4211] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:09:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:09:27.330232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:27.331695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:27.331971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:27.354268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:27.355955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:27.372817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2103/4212] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:09:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:27.381587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:27.396950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8313c-3eff-427e-a170-b388cb0bb640 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:27.403401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73629ad-bd3f-4d63-849d-b2111e2d14d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:27.404119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73629ad-bd3f-4d63-849d-b2111e2d14d4 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:27.404520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73629ad-bd3f-4d63-849d-b2111e2d14d4 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:27.404860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73629ad-bd3f-4d63-849d-b2111e2d14d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:27.422589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73629ad-bd3f-4d63-849d-b2111e2d14d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:27.427302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73629ad-bd3f-4d63-849d-b2111e2d14d4 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:27.448545 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2110/4213] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:09:27.485988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:28.042272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:28.044885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:28.156508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159764-eef8-4847-87c9-36d66d3b3ff5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:28.162508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:28.163522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:28.164058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:28.164507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] PATH_INFO: `/v3/users/0d4ee7b208bb436baa43f80e53276c5c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:28.166322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4ee7b208bb436baa43f80e53276c5c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:28.169238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:28.511065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4ee7b208bb436baa43f80e53276c5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:28.546628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4ee7b208bb436baa43f80e53276c5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:28.573768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4ee7b208bb436baa43f80e53276c5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:28.575448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4ee7b208bb436baa43f80e53276c5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:28.576565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4ee7b208bb436baa43f80e53276c5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:28.714544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2104/4214] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:28 2022] DELETE /identity/v3/users/0d4ee7b208bb436baa43f80e53276c5c => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:28.719417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:28.719978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:28.719978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:28.755104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:28.757413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:28.835292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2111/4215] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:28.875222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:28.877770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:28.964620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0538547-95ed-42a5-b28a-22603dad84bd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:28.970649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71ba2c-d57d-420f-af9c-7510058a128c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:28.972189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ba2c-d57d-420f-af9c-7510058a128c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:28.972558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ba2c-d57d-420f-af9c-7510058a128c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:28.973077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ba2c-d57d-420f-af9c-7510058a128c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:28.984366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71ba2c-d57d-420f-af9c-7510058a128c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:28.986060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71ba2c-d57d-420f-af9c-7510058a128c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:28.998305 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2105/4216] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:29.452066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:29.453520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:29.473532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206391f-72a7-4a58-9606-94bdb7089624 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:29.484809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:29.485778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:29.486360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:29.486542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] PATH_INFO: `/v3/projects/de7e762a0aa94cb9a0b1741de3a41470` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:29.488072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7e762a0aa94cb9a0b1741de3a41470)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:29.490649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:29.532898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:29.711435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7e762a0aa94cb9a0b1741de3a41470', 'request_id': 'req-72b2172d-abaa-4f5f-baa7-843913f207bd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:29.721033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7e762a0aa94cb9a0b1741de3a41470', 'request_id': 'req-72b2172d-abaa-4f5f-baa7-843913f207bd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:29.730868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7e762a0aa94cb9a0b1741de3a41470', 'request_id': 'req-72b2172d-abaa-4f5f-baa7-843913f207bd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:30.000362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] The token cache is being invalidate because project de7e762a0aa94cb9a0b1741de3a41470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:30.005212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:30.009438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72b2172d-abaa-4f5f-baa7-843913f207bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:30.016144 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2112/4217] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:29 2022] DELETE /identity/v3/projects/de7e762a0aa94cb9a0b1741de3a41470 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:30.024428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:30.025097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:30.025239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:30.067688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:30.071960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:30.101891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:30.258769 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2106/4218] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:30.277607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:30.278405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:30.279109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:30.324898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:30.326596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:30.358657 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2113/4219] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:30.362605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:30.385483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6066f-792b-4735-9716-fc1a24bea4fd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:30.403830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:30.404752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:30.405179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:30.407942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:30.411551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:30.412253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:30.423013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:30.444524 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2107/4220] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:09:30.449184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:30.462007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224f4f-57cc-488c-ae7a-b84bf128932f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:30.469417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:30.474295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:30.474295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:30.474295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:30.474295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:30.475273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:30.644952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:30.666835 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2114/4221] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:30 2022] POST /identity/v3/projects => generated 399 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:30.681665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97730b-b219-4f5f-9eec-bf42af11c472 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:30.834272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:30.835294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:30.835776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:30.837674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:30.838595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:30.841322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:30.956192 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2108/4222] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:30 2022] POST /identity/v3/users => generated 300 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:30.960763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:30.981452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cf9db-bb68-4a63-9938-31c15b2dd769 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:30.994599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:30.996978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:30.998227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:31.000197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:31.002008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:31.005733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:31.066930 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2115/4223] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:31.071049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:31.090325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6172-9f54-4884-b91d-7b085109a4cb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:31.133056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2409f-5ed1-4139-b711-9af18b7e9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:31.134632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2409f-5ed1-4139-b711-9af18b7e9b71 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:31.135001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2409f-5ed1-4139-b711-9af18b7e9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:31.136422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2409f-5ed1-4139-b711-9af18b7e9b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:31.137740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2409f-5ed1-4139-b711-9af18b7e9b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:31.143188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2409f-5ed1-4139-b711-9af18b7e9b71 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:31.185564 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2109/4224] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:09:31.190242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:31.207876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba349db-de81-46d2-a301-ae682901fe9e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:31.220673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:31.221756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:31.222073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:31.222356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] PATH_INFO: `/v3/projects/66e021e57f5942848473fdf106e860b6/users/3ab35c0571ee4194a6dd3f017c5f179f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:31.275100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e021e57f5942848473fdf106e860b6, user_id=3ab35c0571ee4194a6dd3f017c5f179f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:31.280554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:31.438166 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2116/4225] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:31 2022] PUT /identity/v3/projects/66e021e57f5942848473fdf106e860b6/users/3ab35c0571ee4194a6dd3f017c5f179f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:31.449027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:31.449436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:31.449779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:31.455590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:31.529690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] MFA Rules not processed for user `3ab35c0571ee4194a6dd3f017c5f179f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:31.529690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:31.587869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:31.652962 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2110/4226] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:31.668412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:31.672103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:31.762167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:31.765947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:31.840343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd01d-ce4d-4faf-998d-d1e3b7b0d43e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:31.852975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:31.853818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:31.854145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:31.854491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] PATH_INFO: `/v3/users/0234b719856c4f3b885895c290204d00` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:31.855864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0234b719856c4f3b885895c290204d00)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:31.857843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:31.967880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e39cf-3cb5-4a64-a7b5-25b95d1eb253 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:31.978655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912908-075d-4d36-8a04-312527ae18af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:31.979701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912908-075d-4d36-8a04-312527ae18af service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:31.979987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912908-075d-4d36-8a04-312527ae18af service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:31.980251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912908-075d-4d36-8a04-312527ae18af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:31.991804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912908-075d-4d36-8a04-312527ae18af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:31.994382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912908-075d-4d36-8a04-312527ae18af service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:32.008309 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2111/4227] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:09:32.061449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912908-075d-4d36-8a04-312527ae18af service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:32.087490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0234b719856c4f3b885895c290204d00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.095361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0234b719856c4f3b885895c290204d00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.096018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912908-075d-4d36-8a04-312527ae18af service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:32.100849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:32.101686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:32.102194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:32.102726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] PATH_INFO: `/v3/users/3ab35c0571ee4194a6dd3f017c5f179f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:32.104796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab35c0571ee4194a6dd3f017c5f179f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:32.108165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:32.181006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0234b719856c4f3b885895c290204d00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.193544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0234b719856c4f3b885895c290204d00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.194319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94fabf65-4537-48de-9e14-c3e7f900e98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0234b719856c4f3b885895c290204d00'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.237881 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2117/4228] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:31 2022] DELETE /identity/v3/users/0234b719856c4f3b885895c290204d00 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:32.240649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:32.241016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:32.241304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:32.325290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:32.326642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:32.411393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab35c0571ee4194a6dd3f017c5f179f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.443893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab35c0571ee4194a6dd3f017c5f179f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.453510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab35c0571ee4194a6dd3f017c5f179f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.454638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab35c0571ee4194a6dd3f017c5f179f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.460780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bd2f68c0-a5df-4870-9063-b013f31b20ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab35c0571ee4194a6dd3f017c5f179f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:32.493162 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2118/4229] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:32.508666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:32.510552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:32.581570 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2112/4230] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:32 2022] DELETE /identity/v3/users/3ab35c0571ee4194a6dd3f017c5f179f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:32.585492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:32.585805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:32.586100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:32.643131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:32.644407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:32.658636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8557608-d8b2-49aa-8990-9a89adb903a0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:32.773134 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2113/4231] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:09:32.787930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:32.788694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:32.788988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:32.789381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:32.829446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:32.834421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:32.850181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:32.891779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:32.892267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:32.901612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2119/4232] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:09:32.912597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7f8bd-a4f9-40d7-976d-5d7318ed7dc3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:32.924876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:32.925695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:32.928177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:32.932478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:32.932972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:32.959409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:32.966428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:33.015623 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2114/4233] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:33.733746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:33.735339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:33.762381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9993-71be-4e43-998a-3493e68564e3 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:33.790811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:33.791463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:33.791938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:33.792526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] PATH_INFO: `/v3/users/daad1d169d0f420eb03b5a33f2a4e0a1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:33.796042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daad1d169d0f420eb03b5a33f2a4e0a1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:33.800184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:34.322860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daad1d169d0f420eb03b5a33f2a4e0a1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:34.326977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daad1d169d0f420eb03b5a33f2a4e0a1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:34.850023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daad1d169d0f420eb03b5a33f2a4e0a1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:34.872128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daad1d169d0f420eb03b5a33f2a4e0a1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:34.873208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daad1d169d0f420eb03b5a33f2a4e0a1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:34.903853 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2120/4234] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:33 2022] DELETE /identity/v3/users/daad1d169d0f420eb03b5a33f2a4e0a1 => generated 0 bytes in 1170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:35.002181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:35.004777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:35.022693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0d10-835f-42af-8e3a-29b87a8def53 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:35.024865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:35.026772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:35.198629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:35.199314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:35.199550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:35.199824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] PATH_INFO: `/v3/projects/66e021e57f5942848473fdf106e860b6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:35.201597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e021e57f5942848473fdf106e860b6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:35.205271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:35.232608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc83806-31e2-41ea-961a-6ac56e1d30c5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:35.250392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:35.251057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:35.251342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:35.251691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] PATH_INFO: `/v3/projects/a5bd222d12734f97aeb316b79a1ab0e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:35.255205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5bd222d12734f97aeb316b79a1ab0e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:35.264188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:35.467927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5bd222d12734f97aeb316b79a1ab0e2', 'request_id': 'req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.468834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e021e57f5942848473fdf106e860b6', 'request_id': 'req-16a38166-db17-44b7-bdfc-faafe7f53e28'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.486879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5bd222d12734f97aeb316b79a1ab0e2', 'request_id': 'req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.488549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e021e57f5942848473fdf106e860b6', 'request_id': 'req-16a38166-db17-44b7-bdfc-faafe7f53e28'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.514359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e021e57f5942848473fdf106e860b6', 'request_id': 'req-16a38166-db17-44b7-bdfc-faafe7f53e28'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.514479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5bd222d12734f97aeb316b79a1ab0e2', 'request_id': 'req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.690133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] The token cache is being invalidate because project 66e021e57f5942848473fdf106e860b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:35.690419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.691079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16a38166-db17-44b7-bdfc-faafe7f53e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.693762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2115/4235] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:35 2022] DELETE /identity/v3/projects/66e021e57f5942848473fdf106e860b6 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:35.700605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:35.704180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:35.704514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:35.774020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] The token cache is being invalidate because project a5bd222d12734f97aeb316b79a1ab0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:35.778851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.778851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d4ee39d-922b-4fab-9c5f-a2001edb3b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:35.780365 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2121/4236] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:35 2022] DELETE /identity/v3/projects/a5bd222d12734f97aeb316b79a1ab0e2 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:35.785167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd16e6-c739-4709-8077-b52e3706f8fc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:35.785462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd16e6-c739-4709-8077-b52e3706f8fc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:35.785765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd16e6-c739-4709-8077-b52e3706f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:35.793665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:35.795060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:35.802032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:35.830023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a6bd16e6-c739-4709-8077-b52e3706f8fc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:35.830921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6bd16e6-c739-4709-8077-b52e3706f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:35.880208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:35.962490 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2116/4237] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:35.963449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:35.970826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:35.980526 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2122/4238] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:35.982297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b8682-4eec-4a07-903a-a1b5103bc9e8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:35.982757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b8682-4eec-4a07-903a-a1b5103bc9e8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:35.983362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b8682-4eec-4a07-903a-a1b5103bc9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.002166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00458781-8e3b-4d7c-bd44-9469b28e4ae9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.010028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7b5b8682-4eec-4a07-903a-a1b5103bc9e8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:36.011884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7b5b8682-4eec-4a07-903a-a1b5103bc9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:36.022846 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2123/4239] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:36.023945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.024618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.024885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.025164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] PATH_INFO: `/v3/projects/2e3c425de2174a18963458a3dd7d23e5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.026153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.026518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3c425de2174a18963458a3dd7d23e5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.026818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.027434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.028441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.087252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:36.089475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:36.106974 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2124/4240] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:36.107957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:36.134920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90ec4b-4e9f-43eb-b655-fd5ffbe4423f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.142119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.143722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.144234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.145372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.146849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:36.147347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.149658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.185154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2125/4241] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:09:36.185154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:36.197801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcd8a-af7f-44b4-b7a5-042a76ec0c4b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.204658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.219972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.219972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.219972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.219972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:36.219972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.219972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.232404 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2126/4242] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:09:36.233373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:36.272709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3c425de2174a18963458a3dd7d23e5', 'request_id': 'req-81d8cf5b-ac67-413d-a8c9-d23177791b89'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:36.276323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4157-d967-4a56-95db-9d8f44a29358 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.285027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3c425de2174a18963458a3dd7d23e5', 'request_id': 'req-81d8cf5b-ac67-413d-a8c9-d23177791b89'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:36.297901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3c425de2174a18963458a3dd7d23e5', 'request_id': 'req-81d8cf5b-ac67-413d-a8c9-d23177791b89'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:36.393730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] The token cache is being invalidate because project 2e3c425de2174a18963458a3dd7d23e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:36.394060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:36.396507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:36.398988 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2117/4243] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:35 2022] DELETE /identity/v3/projects/2e3c425de2174a18963458a3dd7d23e5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:36.399796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:36.405545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:36.438900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af2a71-b821-4315-9e19-3e334de6beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.440266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af2a71-b821-4315-9e19-3e334de6beb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.440621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af2a71-b821-4315-9e19-3e334de6beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.441112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af2a71-b821-4315-9e19-3e334de6beb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.441881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af2a71-b821-4315-9e19-3e334de6beb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.444305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af2a71-b821-4315-9e19-3e334de6beb9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.563998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8cf5b-ac67-413d-a8c9-d23177791b89 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.571848 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2127/4244] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:36.576830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.577092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c8686-20aa-42bf-82a4-14f571d11fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.577281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.577600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.577734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c8686-20aa-42bf-82a4-14f571d11fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.578039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c8686-20aa-42bf-82a4-14f571d11fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.578363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c8686-20aa-42bf-82a4-14f571d11fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.579004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c8686-20aa-42bf-82a4-14f571d11fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.581328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c8686-20aa-42bf-82a4-14f571d11fc5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.626026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] MFA Rules not processed for user `b623d81bb3794beaabfba5ed7f7ee574`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:36.627196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:36.703024 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2118/4245] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/projects => generated 367 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:36.707960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.709911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.711249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.722329 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2128/4246] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:36.723307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:36.740126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:36.748994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:36.750586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:36.831302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74f07e-1395-4a71-85ba-c54d2ede10c7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.836820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2119/4247] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:36.838105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:36.847461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e308-ae84-4f79-be15-47dde0622789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.849786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e308-ae84-4f79-be15-47dde0622789 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.849786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e308-ae84-4f79-be15-47dde0622789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.849786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e308-ae84-4f79-be15-47dde0622789 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.849786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e308-ae84-4f79-be15-47dde0622789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.850310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b4a8-6edc-4aa6-a7e3-31c95ad2759d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:36.851628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e308-ae84-4f79-be15-47dde0622789 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.856353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95abd8c-5c28-48fc-936f-88572ca176a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:36.857184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95abd8c-5c28-48fc-936f-88572ca176a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.857634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95abd8c-5c28-48fc-936f-88572ca176a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.858107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95abd8c-5c28-48fc-936f-88572ca176a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:36.859009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95abd8c-5c28-48fc-936f-88572ca176a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:36.861154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95abd8c-5c28-48fc-936f-88572ca176a0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:36.976273 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2129/4248] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:36.978882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:36.980403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:36.982152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.002462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2120/4249] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:37.004184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.004938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.007572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.026408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] MFA Rules not processed for user `b623d81bb3794beaabfba5ed7f7ee574`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:37.027700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:37.048365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:37.049597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:37.061066 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2121/4250] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:37.062330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.079213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd8c1-7e97-4d9e-a7dd-9af9090eec3a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.111678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.112418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.112827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.113194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.113978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.116801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.148242 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2130/4251] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:37.154778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.157633 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2122/4252] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:37.158668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.180387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512218c-5d59-4b3e-88d5-eca8b0fc48b4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.193566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714fec6-8691-451c-a164-3b4fc0cc2318 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.196079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.196727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.197007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.197276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.198108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:37.198258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.199943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.211130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.211755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.212031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.212299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.213062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.214709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.228850 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2131/4253] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:37.230188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.233354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2123/4254] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:09:37.235265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.236346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:37.250634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3f19-2bc2-4f26-a1da-c241ab78bca6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.256291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.256934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.257421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.257908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.258645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.260276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.274467 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2124/4255] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:37.275372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.302609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4385b-9366-41d6-a17d-0bbc6a6365dc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.314767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.314767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.314767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.314767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.315189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.315189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.327144 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2125/4256] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:37.328462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.331058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da19f-3826-4cfb-9d7f-f1ae7fcac5f2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.337707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.338461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.338743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.339016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.342341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa25e9-11b3-4c10-8781-271641117a3f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.348681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.349697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.350235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.355916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.355916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.355916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.356227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.356334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.366025 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2132/4257] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:37.378288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.404605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190450f-844a-4f8f-87b0-c110ac43e8aa service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.418848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.418987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.419191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.419509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] PATH_INFO: `/v3/projects/b3df3258c2e849bc8b2fc6fdf5ce4640/users/2106de7fa0e648108cbf3bf7766ba238/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.457841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3df3258c2e849bc8b2fc6fdf5ce4640, user_id=2106de7fa0e648108cbf3bf7766ba238, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.477620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.574042 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2126/4258] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:37 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:37.576561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.670628 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2133/4259] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:37 2022] PUT /identity/v3/projects/b3df3258c2e849bc8b2fc6fdf5ce4640/users/2106de7fa0e648108cbf3bf7766ba238/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:37.671827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:37.685340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37641eda-74d3-4132-9a10-c20c581d9c45 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.813995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0529ee-b745-4e10-bdc4-0164265123ae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:37.824017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5957-ae2c-4708-8c00-669e97816bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.824650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5957-ae2c-4708-8c00-669e97816bcd admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.824927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5957-ae2c-4708-8c00-669e97816bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.825200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5957-ae2c-4708-8c00-669e97816bcd admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.825864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab5957-ae2c-4708-8c00-669e97816bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.827834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab5957-ae2c-4708-8c00-669e97816bcd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.875622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:37.876334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.876617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.876894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] PATH_INFO: `/v3/projects/f3e41557617148b7bb6ed544f75297ff/users/27fc2373031b489dae1789cedc102cf2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.895247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e41557617148b7bb6ed544f75297ff, user_id=27fc2373031b489dae1789cedc102cf2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:37.898555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:37.951955 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2134/4260] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:37 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:37.954714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:37.955249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:37.956411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:37.990610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:37.993295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:38.005931 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2135/4261] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:38.007954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:38.025046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23861e-3d05-4644-8955-ea56db6ff26a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:38.031723 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2127/4262] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:37 2022] PUT /identity/v3/projects/f3e41557617148b7bb6ed544f75297ff/users/27fc2373031b489dae1789cedc102cf2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:38.033045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:38.048404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:38.151581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40781c-432a-4e2a-8bf0-c31c370562c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:38.151581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40781c-432a-4e2a-8bf0-c31c370562c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.151581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40781c-432a-4e2a-8bf0-c31c370562c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.151581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40781c-432a-4e2a-8bf0-c31c370562c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.152111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40781c-432a-4e2a-8bf0-c31c370562c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:38.152316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40781c-432a-4e2a-8bf0-c31c370562c9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:38.184224 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2136/4263] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:38.184224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.184224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.187749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.192273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600bc22-7243-4372-aa3b-dd9d03859424 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:38.202446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:38.203083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.203356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.204632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.228922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:38.233156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:38.256662 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2128/4264] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:38.257548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:38.258909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] MFA Rules not processed for user `27fc2373031b489dae1789cedc102cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:38.261264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:38.292401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8694c-f7c4-4e85-9671-b0497ab4dac1 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:38.310668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:38.310668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.310668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.310668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.311055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:38.311647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:38.334558 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2129/4265] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:38.339299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:38.358234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b0aa5-b57a-4395-96b8-cbeefa796c3d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:38.372174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:38.373185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.373634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.374120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] PATH_INFO: `/v3/projects/1d6a161784e44d36acdc6f32ef9e7423/users/87f5252f4fb8448196213da1e4f07bcd/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.400124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6a161784e44d36acdc6f32ef9e7423, user_id=87f5252f4fb8448196213da1e4f07bcd, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:38.403725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:38.444414 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2137/4266] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:38.454467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:38.466392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2fda-1011-4b9a-865a-e6155298dcf6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:38.471908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa837bef-d2c5-4d48-8025-e58f49347670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:38.472981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837bef-d2c5-4d48-8025-e58f49347670 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.472981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837bef-d2c5-4d48-8025-e58f49347670 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.473276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837bef-d2c5-4d48-8025-e58f49347670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.488195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa837bef-d2c5-4d48-8025-e58f49347670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:38.490811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa837bef-d2c5-4d48-8025-e58f49347670 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:38.507478 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2138/4267] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:09:38.606042 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2130/4268] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:38 2022] PUT /identity/v3/projects/1d6a161784e44d36acdc6f32ef9e7423/users/87f5252f4fb8448196213da1e4f07bcd/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:38.611139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0660-0003-44ad-be31-d9cd6b5ea0d9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:38.611566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0660-0003-44ad-be31-d9cd6b5ea0d9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:38.611935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0660-0003-44ad-be31-d9cd6b5ea0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:38.703408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-352f0660-0003-44ad-be31-d9cd6b5ea0d9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:38.715648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-352f0660-0003-44ad-be31-d9cd6b5ea0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:38.896456 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2139/4269] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:38.951780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:38.953871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:39.119619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e30b7-70b5-4e1c-b08f-b3dc4b21dbc0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:39.129716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:39.130548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:39.133041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:39.133562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:39.145595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:39.147547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:39.162290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2131/4270] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:40.196966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:41.421116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:41.422721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:41.423199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:41.469462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:41.471532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:41.561891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2140/4271] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:41.802364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:42.503011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:42.515296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6278f-a84d-4c52-8a0e-40f577e043ed service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:42.532342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:42.532342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:42.532342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:42.532342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:42.532820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:42.540285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:42.542427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47531735-f2f6-4813-84dc-2f682a9c1e95 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:42.572320 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2132/4272] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:43.867282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:43.868832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:43.912840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0641-7cb7-417c-860f-763a3bbb9a79 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:43.943578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:43.944936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:43.948618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:43.949758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] PATH_INFO: `/v3/users/b6ecaeadc42646d2a4c5e7a4644f7f9b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:43.956158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ecaeadc42646d2a4c5e7a4644f7f9b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:43.964162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:44.046443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:44.387208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ecaeadc42646d2a4c5e7a4644f7f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:44.392909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ecaeadc42646d2a4c5e7a4644f7f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:44.500929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ecaeadc42646d2a4c5e7a4644f7f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:44.515452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ecaeadc42646d2a4c5e7a4644f7f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:44.517272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ecaeadc42646d2a4c5e7a4644f7f9b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:44.619821 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2141/4273] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:43 2022] DELETE /identity/v3/users/b6ecaeadc42646d2a4c5e7a4644f7f9b => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:44.622525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:44.622977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:44.623280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:44.683419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:44.684672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:44.894871 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2133/4274] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:44.982394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:44.985723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:45.042632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:45.106713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963b7fe-a2c8-4be4-89bb-d2be6119f715 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:45.111474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:45.112170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:45.112457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:45.112739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:45.125614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:45.127532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:45.142090 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2142/4275] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:46.478235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:46.480697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:46.496365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:46.502681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3851056-41c9-47b9-b3bd-4ef9a36ee998 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:46.532068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:46.542801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:46.557239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:46.557239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] PATH_INFO: `/v3/projects/44d8907c151b471b902932c5eb730aff` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:46.557239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d8907c151b471b902932c5eb730aff)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:46.569734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:46.945273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d8907c151b471b902932c5eb730aff', 'request_id': 'req-0dc1d54a-d193-40ed-ab90-e685e158b6d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:46.975344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d8907c151b471b902932c5eb730aff', 'request_id': 'req-0dc1d54a-d193-40ed-ab90-e685e158b6d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.000444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d8907c151b471b902932c5eb730aff', 'request_id': 'req-0dc1d54a-d193-40ed-ab90-e685e158b6d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.120284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] The token cache is being invalidate because project 44d8907c151b471b902932c5eb730aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:47.121166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.122743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.127430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2134/4276] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:46 2022] DELETE /identity/v3/projects/44d8907c151b471b902932c5eb730aff => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:47.133369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:47.166408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c868a8-ee1c-45e3-813c-a5265c8807c5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:47.324502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:47.335077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:47.335077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:47.335077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:47.335077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] PATH_INFO: `/v3/users/fe110ee2441e40cfaf87e7a636a5067e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:47.335548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe110ee2441e40cfaf87e7a636a5067e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:47.336679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:47.823019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe110ee2441e40cfaf87e7a636a5067e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.824970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe110ee2441e40cfaf87e7a636a5067e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.969881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:47.971430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe110ee2441e40cfaf87e7a636a5067e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:47.996272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe110ee2441e40cfaf87e7a636a5067e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:48.000932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43362c3c-dbcc-41e4-bb1d-e7a2d7f6e537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe110ee2441e40cfaf87e7a636a5067e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:48.112739 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2143/4277] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:09:47 2022] DELETE /identity/v3/users/fe110ee2441e40cfaf87e7a636a5067e => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:09:48.324112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:49.283284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:49.502258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:50.380918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:50.439219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:50.441378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:50.493091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d54a-d193-40ed-ab90-e685e158b6d7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:50.691755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:50.693834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:50.694318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:50.694777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] PATH_INFO: `/v3/projects/54e4891c779b466388567d4ae2c56fcc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:50.697440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e4891c779b466388567d4ae2c56fcc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:50.700484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:50.930603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e4891c779b466388567d4ae2c56fcc', 'request_id': 'req-b0fea988-41cf-4cf7-8eae-3e8036703f79'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:50.966704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e4891c779b466388567d4ae2c56fcc', 'request_id': 'req-b0fea988-41cf-4cf7-8eae-3e8036703f79'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:50.979874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e4891c779b466388567d4ae2c56fcc', 'request_id': 'req-b0fea988-41cf-4cf7-8eae-3e8036703f79'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:51.144528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] The token cache is being invalidate because project 54e4891c779b466388567d4ae2c56fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:09:51.145619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:51.146935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0fea988-41cf-4cf7-8eae-3e8036703f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:09:51.151167 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2135/4278] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:09:50 2022] DELETE /identity/v3/projects/54e4891c779b466388567d4ae2c56fcc => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:51.157666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:51.158325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:51.158779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:51.214599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:51.216372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:51.381683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2144/4279] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:51.390480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:51.391331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:51.392088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:51.417441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:51.419813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:51.432995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:51.436977 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2136/4280] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:51.448128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:51.470443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f963b-9a2d-4f91-b611-d0268373fb85 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:51.477714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:51.486243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:51.493811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:51.493811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:51.493811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:09:51.493811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:51.496156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:51.518796 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2145/4281] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:09:51.524803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:51.541302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418534a-b022-4f08-9ebe-1bdacf826dcd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:51.546599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:51.547521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:51.547897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:51.548268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:51.549019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:51.552766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:51.616640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:51.725252 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2137/4282] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:09:51 2022] POST /identity/v3/projects => generated 395 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:51.729633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:51.744049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a456524-a3de-47ab-9ea8-e93c886b9221 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:51.899951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:51.899951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:51.900458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:51.900622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:51.901204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:51.903269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:52.069687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:52.070385 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2146/4283] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:09:51 2022] POST /identity/v3/users => generated 298 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:09:52.083815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128065a3-a624-41c2-beb0-ff8201b44b79 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:52.101953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:52.102871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:52.103667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:52.104121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:52.104967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:52.107754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:52.172876 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2138/4284] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:52.177122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:52.197297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113bc6-44b3-4169-9277-848941c4f790 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:52.205427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c86236-d04d-487e-bca2-992083efabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:52.209408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86236-d04d-487e-bca2-992083efabcb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:52.209408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86236-d04d-487e-bca2-992083efabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:52.209408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86236-d04d-487e-bca2-992083efabcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:52.209408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86236-d04d-487e-bca2-992083efabcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:52.211004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86236-d04d-487e-bca2-992083efabcb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:52.240872 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2147/4285] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:09:52.241479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:52.260480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ddb36-5ceb-4ac5-8cd7-93cfd9ae1b1f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:52.274312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:52.275373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:52.275990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:52.278301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] PATH_INFO: `/v3/projects/93fe880ec3da49d0a99767ed89731402/users/afcf20ceeb74481b86e2b985e732ee40/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:52.319110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fe880ec3da49d0a99767ed89731402, user_id=afcf20ceeb74481b86e2b985e732ee40, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:52.340150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:52.513223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:52.516551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:52.516955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:52.520968 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2139/4286] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:09:52 2022] PUT /identity/v3/projects/93fe880ec3da49d0a99767ed89731402/users/afcf20ceeb74481b86e2b985e732ee40/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:09:52.618268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] MFA Rules not processed for user `afcf20ceeb74481b86e2b985e732ee40`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:52.620386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:52.795847 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2148/4287] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:52.840032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:52.842959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:53.073829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d63714-3660-4e3a-b5f1-fc93fc2d4963 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:53.107507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607112-7b46-4aff-88b5-9d9747d0cfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:53.108248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607112-7b46-4aff-88b5-9d9747d0cfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:53.108537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607112-7b46-4aff-88b5-9d9747d0cfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:53.108799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607112-7b46-4aff-88b5-9d9747d0cfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:53.149262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607112-7b46-4aff-88b5-9d9747d0cfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:53.169110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607112-7b46-4aff-88b5-9d9747d0cfb7 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:53.250579 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2140/4288] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:54.250270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:55.175836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:55.603359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:56.884890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:56.892874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:57.026119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00031-a332-4f07-b6fd-c5e832e336a0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:57.042818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:57.043813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:57.044260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:57.046941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:57.048515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:57.266005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:57.272304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80680f6-efa4-4c95-bde9-db056ae24e7a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:57.321869 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2149/4289] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:57.323139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:09:58.736081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:58.736541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:58.736633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:58.795133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] MFA Rules not processed for user `05e2ae4eec754ac5bbeeeed56018614b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:58.796422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:58.830089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2141/4290] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:58.900519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb6708-8687-4e2a-9f31-ff45d414c442 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:58.901067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb6708-8687-4e2a-9f31-ff45d414c442 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:58.901067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb6708-8687-4e2a-9f31-ff45d414c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:58.950833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-46eb6708-8687-4e2a-9f31-ff45d414c442 None None] MFA Rules not processed for user `87f5252f4fb8448196213da1e4f07bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:09:58.952478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-46eb6708-8687-4e2a-9f31-ff45d414c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:09:59.097941 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2150/4291] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:09:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:09:59.299675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:09:59.327605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01da2e-4669-4fd8-8958-a2fbd146df1b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:09:59.343384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:09:59.344856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:09:59.346884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:09:59.347428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:09:59.375920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:09:59.377978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:09:59.396402 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2142/4292] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:09:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:00.483411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:02.423481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:03.085974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99268-af78-4804-ae04-be2d08a065c0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:03.086806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99268-af78-4804-ae04-be2d08a065c0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:03.087827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99268-af78-4804-ae04-be2d08a065c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:03.135648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9fb99268-af78-4804-ae04-be2d08a065c0 None None] MFA Rules not processed for user `2106de7fa0e648108cbf3bf7766ba238`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:03.138683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9fb99268-af78-4804-ae04-be2d08a065c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:03.240426 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2151/4293] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:03.464149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:03.467700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:03.524781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b66a-eba9-4049-8a4e-395ea3f038a8 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:03.527235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:03.543402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c96897-74e6-43ef-b836-50d8953b7816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:03.544832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c96897-74e6-43ef-b836-50d8953b7816 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:03.545434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c96897-74e6-43ef-b836-50d8953b7816 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:03.546030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c96897-74e6-43ef-b836-50d8953b7816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:03.558672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c96897-74e6-43ef-b836-50d8953b7816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:03.561519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c96897-74e6-43ef-b836-50d8953b7816 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:03.575799 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2143/4294] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:10:04.615044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:05.518507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23547982-3abf-4de3-8bd4-7bdc5407de3e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:05.521328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23547982-3abf-4de3-8bd4-7bdc5407de3e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:05.521878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23547982-3abf-4de3-8bd4-7bdc5407de3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:05.547757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-23547982-3abf-4de3-8bd4-7bdc5407de3e None None] MFA Rules not processed for user `87f5252f4fb8448196213da1e4f07bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:05.549245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-23547982-3abf-4de3-8bd4-7bdc5407de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:05.560974 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2152/4295] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:05.843398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:07.551606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:09.968040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:11.403552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:11.751130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:12.807993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:13.168680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:13.540849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:14.640264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:14.641175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:14.641649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:14.664427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] MFA Rules not processed for user `2106de7fa0e648108cbf3bf7766ba238`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:14.666033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:14.685678 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2144/4296] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:15.139234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:16.107850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:16.882039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:18.499126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:20.047800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:22.844463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:23.178775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:24.304721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:25.157187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:26.464678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:27.842244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:29.032117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:29.033171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:29.033674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:29.079618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:29.082116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:29.189786 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2153/4297] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:30.127936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:30.351052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:31.987035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:31.989423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:32.174436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9115c-d380-4e99-b185-c86a3d3cb46d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:32.229824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:32.231876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:32.232166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:32.233784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:32.242115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:32.295561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:32.303442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:32.345009 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2145/4298] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:32.738819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:33.518813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:33.536414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e129df-6288-423d-98c5-35ae9761741e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:33.542358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:33.543229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:33.543690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:33.544129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:33.547300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:33.693253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:33.695083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8b86d-bde7-4712-bc9b-2942dc970469 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:33.723365 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2154/4299] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:33.744302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:33.942651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:33.993389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfb093-556c-460a-8d48-6301d916be6d service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:34.023339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:34.024005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:34.037246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:34.037533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] PATH_INFO: `/v3/users/afcf20ceeb74481b86e2b985e732ee40` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:34.045689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afcf20ceeb74481b86e2b985e732ee40)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:34.048743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:34.532887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afcf20ceeb74481b86e2b985e732ee40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:34.584643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afcf20ceeb74481b86e2b985e732ee40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:34.618170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afcf20ceeb74481b86e2b985e732ee40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:34.619967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afcf20ceeb74481b86e2b985e732ee40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:34.622487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afcf20ceeb74481b86e2b985e732ee40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:34.826973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2146/4300] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:10:33 2022] DELETE /identity/v3/users/afcf20ceeb74481b86e2b985e732ee40 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:10:34.831891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2685-7b2a-4545-aca9-090cd1f47f67 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:34.832434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2685-7b2a-4545-aca9-090cd1f47f67 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:34.832816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2685-7b2a-4545-aca9-090cd1f47f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:34.904303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-92ae2685-7b2a-4545-aca9-090cd1f47f67 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:34.905749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-92ae2685-7b2a-4545-aca9-090cd1f47f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:35.070722 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2155/4301] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:35.116936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:35.118508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:35.253252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d2b3-4494-4edd-a7e9-457b189325c2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:35.266577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:35.267208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:35.267520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:35.268535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:35.283312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:35.286463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:35.300317 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2147/4302] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:36.782631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53758f46-6e97-42a0-8ad8-3797142f25a4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:36.782631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53758f46-6e97-42a0-8ad8-3797142f25a4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:36.782631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53758f46-6e97-42a0-8ad8-3797142f25a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:36.821334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-53758f46-6e97-42a0-8ad8-3797142f25a4 None None] MFA Rules not processed for user `b623d81bb3794beaabfba5ed7f7ee574`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:36.821334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53758f46-6e97-42a0-8ad8-3797142f25a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:36.932614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:36.933500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:36.946894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2156/4303] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:36.963429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0005e-7ae3-47ff-aeef-fad94358d3fe service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:36.974829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:36.975488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:36.975814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:36.976332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] PATH_INFO: `/v3/projects/93fe880ec3da49d0a99767ed89731402` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:36.983097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fe880ec3da49d0a99767ed89731402)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:36.984967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:37.233265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fe880ec3da49d0a99767ed89731402', 'request_id': 'req-c4478969-4752-47eb-ba87-dd81e94f49bb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:37.250459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fe880ec3da49d0a99767ed89731402', 'request_id': 'req-c4478969-4752-47eb-ba87-dd81e94f49bb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:37.269267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fe880ec3da49d0a99767ed89731402', 'request_id': 'req-c4478969-4752-47eb-ba87-dd81e94f49bb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:37.458705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] The token cache is being invalidate because project 93fe880ec3da49d0a99767ed89731402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:10:37.459012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:37.464211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4478969-4752-47eb-ba87-dd81e94f49bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:37.466291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2148/4304] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:10:36 2022] DELETE /identity/v3/projects/93fe880ec3da49d0a99767ed89731402 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:10:37.471290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:37.472364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:37.472831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:37.475684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:37.517583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:37.519593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:37.657827 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2157/4305] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:37.665560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:37.666171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:37.666718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:37.696218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:37.698827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:37.725094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:37.725874 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2149/4306] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:37.742464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e41e5e-4b49-495d-9199-d85953d5e723 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:37.751819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:37.753817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:37.754798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:37.755291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:37.756472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:10:37.757002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:37.759591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:37.787222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:37.799580 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2158/4307] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:10:37.803470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2987a9-705e-4b9d-a29d-b718f29c96d8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:37.832706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:37.845586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:37.845586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:37.845586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:37.845586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:37.845586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:38.034544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2150/4308] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:10:37 2022] POST /identity/v3/projects => generated 363 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:10:38.038423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:38.052236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c30b8c-4667-4d17-914d-d7aed4bb0f87 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:38.201008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:38.202543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:38.204025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:38.204846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:38.207457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:38.209812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:38.410076 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2159/4309] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:10:38 2022] POST /identity/v3/users => generated 282 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:10:38.415087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:38.442403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511801f-fda7-40ac-acc8-c3a153629568 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:38.453419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:38.455628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:38.457099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:38.459449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:38.474917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:38.474917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:38.492636 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2151/4310] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:10:38.496949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:38.513103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb9ee-011b-4730-bd33-4ef50f04e316 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:38.522845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0a8b-31ec-4faa-bf9c-545a534b2e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:38.523482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0a8b-31ec-4faa-bf9c-545a534b2e6c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:38.523766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0a8b-31ec-4faa-bf9c-545a534b2e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:38.524046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0a8b-31ec-4faa-bf9c-545a534b2e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:38.524773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0a8b-31ec-4faa-bf9c-545a534b2e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:38.526554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0a8b-31ec-4faa-bf9c-545a534b2e6c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:38.546416 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2160/4311] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:10:38.547334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:38.563390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81835cd5-9795-405e-9774-9cd34f6203bf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:38.579442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:38.580932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:38.601316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:38.601316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] PATH_INFO: `/v3/projects/97dc423079494a9cb8264d083bd9d228/users/d43c3a2d11fd43ce93fdee6339c27eb2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:38.626151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dc423079494a9cb8264d083bd9d228, user_id=d43c3a2d11fd43ce93fdee6339c27eb2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:38.629584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:38.795088 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2152/4312] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:10:38 2022] PUT /identity/v3/projects/97dc423079494a9cb8264d083bd9d228/users/d43c3a2d11fd43ce93fdee6339c27eb2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:10:38.796518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:38.797043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:38.797620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:38.846866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] MFA Rules not processed for user `d43c3a2d11fd43ce93fdee6339c27eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:38.849056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:38.956031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:39.037005 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2161/4313] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:10:39.077027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:39.079018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:39.245838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff88a-e88b-4d3d-91b7-044f0fd4c18d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:39.271800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:39.272444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:39.272730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:39.273009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:39.303841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:39.308867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:39.345126 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2153/4314] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:41.193588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:41.196440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:41.223575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9c46-9cd1-453e-912b-e8a0997fbac6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:41.228218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:41.229652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:41.234491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:41.234491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:41.234491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:41.415960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:41.417610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:41.444927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2162/4315] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:41.509479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:41.853807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:42.509117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:43.392263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:44.638782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:44.640458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:44.758676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d2c6-b784-45fc-8e40-7caae1e2f672 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:44.782508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:44.783141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:44.783998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:44.784273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:44.789211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:44.836087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:44.838359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:44.864715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2154/4316] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:45.303855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:46.590096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:48.292049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:49.749981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:52.081390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:54.401657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:54.403003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:54.419240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f565c-4860-4354-8287-d46d948d84ba service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:54.424898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:54.425795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:54.428246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:54.428246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] PATH_INFO: `/v3/users/05e2ae4eec754ac5bbeeeed56018614b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:54.428246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e2ae4eec754ac5bbeeeed56018614b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:54.431287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:54.706121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e2ae4eec754ac5bbeeeed56018614b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:54.709951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e2ae4eec754ac5bbeeeed56018614b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:54.806677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e2ae4eec754ac5bbeeeed56018614b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:54.818303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e2ae4eec754ac5bbeeeed56018614b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:54.821356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e2ae4eec754ac5bbeeeed56018614b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:54.836059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:54.854957 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2163/4317] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:10:54 2022] DELETE /identity/v3/users/05e2ae4eec754ac5bbeeeed56018614b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:10:55.188988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:55.435069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:55.437015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:55.452847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9cbd-3efb-440c-8faf-3ab8be00acf2 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:55.527200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:55.527200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:55.527200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:55.527200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] PATH_INFO: `/v3/users/8dcc80a057c04b39b55bafd45fc95e20` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:55.549044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcc80a057c04b39b55bafd45fc95e20)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:55.551194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:55.565617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:55.568163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:55.594833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5001a-9479-432a-9dbe-2c17cf8eaa2b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:55.609271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:55.618799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:55.619526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:55.620862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] PATH_INFO: `/v3/projects/1e780e72454849a9adf5c45a7783c014` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:55.622741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e780e72454849a9adf5c45a7783c014)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:55.625416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:55.987816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e780e72454849a9adf5c45a7783c014', 'request_id': 'req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:55.991195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcc80a057c04b39b55bafd45fc95e20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.000795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e780e72454849a9adf5c45a7783c014', 'request_id': 'req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.016847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcc80a057c04b39b55bafd45fc95e20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.017087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e780e72454849a9adf5c45a7783c014', 'request_id': 'req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.027158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcc80a057c04b39b55bafd45fc95e20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.028388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcc80a057c04b39b55bafd45fc95e20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.029214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7fe943-625f-4ffd-989a-4b21db8cb05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcc80a057c04b39b55bafd45fc95e20'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.168232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] The token cache is being invalidate because project 1e780e72454849a9adf5c45a7783c014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:10:56.169369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.170090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9adb95f5-0d88-449d-8583-e0dd2eefc1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:56.177686 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2164/4318] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:10:55 2022] DELETE /identity/v3/projects/1e780e72454849a9adf5c45a7783c014 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:10:56.186262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:56.186708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:56.186902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:56.235122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:56.237118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:56.305884 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2155/4319] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:10:55 2022] DELETE /identity/v3/users/8dcc80a057c04b39b55bafd45fc95e20 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:10:56.359861 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2165/4320] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:56.373506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:56.373506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:56.373506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:56.417567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:56.420820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:56.520580 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2156/4321] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:56.525392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:56.545109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532ef3-9856-4148-b5b0-f01e06d995f3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:56.549735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:56.550647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:56.551047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:56.551423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:56.552164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:10:56.552545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:56.554694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:56.577430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:56.584744 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2166/4322] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:10:56.588959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bbddf-e75d-4ef8-8d15-fae5c8710f49 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:56.596800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:56.597421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:56.597699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:56.598007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:56.598846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:56.601790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:56.779812 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2157/4323] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:10:56 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:10:56.787092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:56.842947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e7c4d-f6db-4fee-b78d-dbce5d288c9f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:56.877192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:56.883291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:56.976095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:56.977034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:56.977494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:56.977979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:56.978799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:56.981241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.041629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70568396-47e1-49b7-a1aa-f6e08108394c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:57.049546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:57.050563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.051007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.051510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] PATH_INFO: `/v3/projects/31cbbf3c56794fbc85d1da77afc6c03f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.066368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cbbf3c56794fbc85d1da77afc6c03f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:57.069146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.226579 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2167/4324] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:10:56 2022] POST /identity/v3/users => generated 290 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:10:57.230961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:57.243405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946204f2-2390-4b5a-ad4c-34f862ace4be admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:57.275837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:57.276471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.276755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.277029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.277691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:57.281790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.293359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cbbf3c56794fbc85d1da77afc6c03f', 'request_id': 'req-94b5c0b0-37a4-452f-8bd2-be4f48602c97'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.302987 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2168/4325] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:10:57.306570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cbbf3c56794fbc85d1da77afc6c03f', 'request_id': 'req-94b5c0b0-37a4-452f-8bd2-be4f48602c97'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.308137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:57.322443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cbbf3c56794fbc85d1da77afc6c03f', 'request_id': 'req-94b5c0b0-37a4-452f-8bd2-be4f48602c97'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.329016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b936-fc2c-47a3-abcb-b6f353ff1a22 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:57.398890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:57.399510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.399790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.400065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.400714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:57.404005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.422437 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2169/4326] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:10:57.424712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:57.436471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ad01-b1c9-42f9-bf8b-117006109d11 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:57.442352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ecdf-2407-44b8-a437-c1f3e8db50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:57.443080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ecdf-2407-44b8-a437-c1f3e8db50c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.445804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ecdf-2407-44b8-a437-c1f3e8db50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.445804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ecdf-2407-44b8-a437-c1f3e8db50c5 admin admin] PATH_INFO: `/v3/projects/c26696ea658340348c4ef1bd81bf60d2/users/df46ce1cbcc44a47b7d6bd88c230cb0c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.462993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98ecdf-2407-44b8-a437-c1f3e8db50c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26696ea658340348c4ef1bd81bf60d2, user_id=df46ce1cbcc44a47b7d6bd88c230cb0c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:57.465927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98ecdf-2407-44b8-a437-c1f3e8db50c5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.491713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] The token cache is being invalidate because project 31cbbf3c56794fbc85d1da77afc6c03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:10:57.492195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.492848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.495185 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2158/4327] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:10:56 2022] DELETE /identity/v3/projects/31cbbf3c56794fbc85d1da77afc6c03f => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:10:57.499074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:57.501325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:57.517887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c0b0-37a4-452f-8bd2-be4f48602c97 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:57.525227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:57.542758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.542758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.542758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] PATH_INFO: `/v3/users/fcc8c171b6924b6db1dae66f78cc39e4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.542758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc8c171b6924b6db1dae66f78cc39e4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:57.542758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.610796 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2170/4328] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:10:57 2022] PUT /identity/v3/projects/c26696ea658340348c4ef1bd81bf60d2/users/df46ce1cbcc44a47b7d6bd88c230cb0c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:10:57.612285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.612675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.612997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.635295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:57.636793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:57.713071 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2171/4329] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:57.725106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:57.726555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:57.809100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc8c171b6924b6db1dae66f78cc39e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.809509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d092-d59e-4a7f-bb2b-cfb3d698775a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:57.814444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a52cab-459d-49ec-9821-b4541d043230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:57.815154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52cab-459d-49ec-9821-b4541d043230 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:57.815697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52cab-459d-49ec-9821-b4541d043230 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:57.816101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52cab-459d-49ec-9821-b4541d043230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:57.830351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52cab-459d-49ec-9821-b4541d043230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:57.832269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52cab-459d-49ec-9821-b4541d043230 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:57.837665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc8c171b6924b6db1dae66f78cc39e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.864694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc8c171b6924b6db1dae66f78cc39e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.866444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc8c171b6924b6db1dae66f78cc39e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.869180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc8c171b6924b6db1dae66f78cc39e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:57.874826 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2172/4330] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:10:57.957647 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2159/4331] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:10:57 2022] DELETE /identity/v3/users/fcc8c171b6924b6db1dae66f78cc39e4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:10:58.059698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:58.302651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1631814-151c-4e5c-9847-6a1264013cc6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:58.303328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1631814-151c-4e5c-9847-6a1264013cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:58.303804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1631814-151c-4e5c-9847-6a1264013cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:58.341615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a1631814-151c-4e5c-9847-6a1264013cc6 None None] MFA Rules not processed for user `af4c64fac1e74e8aa06cc7483b12cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:58.342998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1631814-151c-4e5c-9847-6a1264013cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:58.378171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:58.479605 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2173/4332] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:10:58.645213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:58.645213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:58.772653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73552e7f-e42a-45d9-a102-ded17d32f5df admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:58.778918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:58.780237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:58.780715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:58.781789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] PATH_INFO: `/v3/projects/b3d963f0a9494415a7028b031cf7078d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:58.784109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d963f0a9494415a7028b031cf7078d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:58.787239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:59.005414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d963f0a9494415a7028b031cf7078d', 'request_id': 'req-450708ac-1208-439b-b560-8937e1b8d4a6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:59.012542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d963f0a9494415a7028b031cf7078d', 'request_id': 'req-450708ac-1208-439b-b560-8937e1b8d4a6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:59.022043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d963f0a9494415a7028b031cf7078d', 'request_id': 'req-450708ac-1208-439b-b560-8937e1b8d4a6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:59.200989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] The token cache is being invalidate because project b3d963f0a9494415a7028b031cf7078d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:10:59.200989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:59.201422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-450708ac-1208-439b-b560-8937e1b8d4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:10:59.209898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2160/4333] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:10:58 2022] DELETE /identity/v3/projects/b3d963f0a9494415a7028b031cf7078d => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:10:59.213656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:59.214870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:59.215378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:59.247057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:59.248710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:59.434461 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2174/4334] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:10:59.442070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:59.442659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:59.442659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:59.479212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:59.481217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:59.503671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2161/4335] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:59.510900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:59.557002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9016c-4535-41b8-98ec-f6bf397ef463 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:59.557002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:59.557002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:59.557002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:59.558353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:59.558353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:10:59.558353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:59.558353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:59.578721 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2175/4336] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:10:59.579220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:59.593834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b3ad-1332-4105-a298-9037e17fdc9c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:59.608303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:59.608303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:59.608674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:59.608902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:59.609571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:59.611609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:59.783264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2162/4337] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:10:59 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:10:59.787727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:59.801271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180e2c-da06-41d6-b85a-e9ee3fa3854e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:59.920553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:59.921344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:59.921628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:59.922026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:59.922692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:59.925987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:00.047534 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2176/4338] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:10:59 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:11:00.048696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:00.069739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbf5fb-a870-449a-a096-1a86950ef737 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:00.078973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:00.082637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:00.082637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:00.083286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:00.084292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:00.087197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:00.101175 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2163/4339] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:11:00.105046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:00.136064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56c38-ed55-4e83-853a-dc268f0fd856 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:00.145069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54fbb1-c483-4623-a403-1100a77b46f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:00.145913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54fbb1-c483-4623-a403-1100a77b46f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:00.146280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54fbb1-c483-4623-a403-1100a77b46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:00.146660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54fbb1-c483-4623-a403-1100a77b46f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:00.147614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54fbb1-c483-4623-a403-1100a77b46f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:00.149338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54fbb1-c483-4623-a403-1100a77b46f0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:00.171850 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2177/4340] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:11:00.177082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:00.193477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a4cf-f357-4d11-ac15-a5f6c614312e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:00.202346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:00.203945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:00.204213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:00.204535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] PATH_INFO: `/v3/projects/a45fbbfd04b6436aa1448d0bbcbb5785/users/407049cbddff41a0839de47141b00c6d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:00.246792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45fbbfd04b6436aa1448d0bbcbb5785, user_id=407049cbddff41a0839de47141b00c6d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:00.249788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:00.313927 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2164/4341] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:11:00 2022] PUT /identity/v3/projects/a45fbbfd04b6436aa1448d0bbcbb5785/users/407049cbddff41a0839de47141b00c6d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:00.318642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:00.322238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:00.322238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:00.341944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:00.350244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:00.352182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:00.451962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2178/4342] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:11:00.473791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:00.477066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:00.609167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8fd37-ab47-484d-8ac9-92f057acbd84 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:00.615030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:00.616920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:00.616920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:00.616920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:00.628626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:00.630217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:00.664987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2165/4343] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:00.707620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:00.709612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:00.828384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee052-ed9c-4e30-9bd6-7cf7724ac159 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:00.835422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:00.836131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:00.836531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:00.836887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:00.839238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:00.854343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:00.856879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a5ac-84a6-48e2-a8cb-97e2c1d25ee5 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:00.886004 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2179/4344] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:00.898389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:02.484733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:04.223443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:10.621563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:10.624056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:10.652310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03db9e-6f1a-4cd3-979b-7950ffdfceb5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:10.662795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:10.663765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:10.664215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:10.664747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] PATH_INFO: `/v3/users/27fc2373031b489dae1789cedc102cf2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:10.676691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fc2373031b489dae1789cedc102cf2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:10.679194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:10.976901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fc2373031b489dae1789cedc102cf2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:10.994583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fc2373031b489dae1789cedc102cf2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:11.004119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fc2373031b489dae1789cedc102cf2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:11.008074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fc2373031b489dae1789cedc102cf2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:11.008074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fc2373031b489dae1789cedc102cf2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:11.135295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2166/4345] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:11:10 2022] DELETE /identity/v3/users/27fc2373031b489dae1789cedc102cf2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:11.140376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:11.141797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:11.141797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:11.162552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:11.164094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:11.294522 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2180/4346] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:11.326844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:11.334937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:11.560157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d3c97-cb65-4d75-9c0f-7c57905a89ec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:11.566174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaab21-b570-47ef-bb3e-125a78c45155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:11.566554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaab21-b570-47ef-bb3e-125a78c45155 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:11.566830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaab21-b570-47ef-bb3e-125a78c45155 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:11.567100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaab21-b570-47ef-bb3e-125a78c45155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:11.599068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaab21-b570-47ef-bb3e-125a78c45155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:11.600946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaab21-b570-47ef-bb3e-125a78c45155 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:11.628851 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2167/4347] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:11.990423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:11.994714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:12.030631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ae3e-8179-4ad8-9574-ee30c2c6020f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:12.063271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:12.073835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.076324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.078472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] PATH_INFO: `/v3/projects/f3e41557617148b7bb6ed544f75297ff` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:12.083963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e41557617148b7bb6ed544f75297ff)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:12.100764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:12.275070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:12.311698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e41557617148b7bb6ed544f75297ff', 'request_id': 'req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:12.328608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e41557617148b7bb6ed544f75297ff', 'request_id': 'req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:12.361636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e41557617148b7bb6ed544f75297ff', 'request_id': 'req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:12.546374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] The token cache is being invalidate because project f3e41557617148b7bb6ed544f75297ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:11:12.546374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:12.547839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-43138a06-0c11-45c1-bf2d-ad22a4ccfbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:12.552830 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2181/4348] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:11:11 2022] DELETE /identity/v3/projects/f3e41557617148b7bb6ed544f75297ff => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:12.558105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43f2f-3067-48f1-be35-76598c2e5c1f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.558608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43f2f-3067-48f1-be35-76598c2e5c1f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.558948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43f2f-3067-48f1-be35-76598c2e5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:12.599101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-57a43f2f-3067-48f1-be35-76598c2e5c1f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:12.603336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-57a43f2f-3067-48f1-be35-76598c2e5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:12.617746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:12.721478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d198f-81df-478d-b333-f094500d398e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.721761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d198f-81df-478d-b333-f094500d398e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.722055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d198f-81df-478d-b333-f094500d398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:12.728109 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2168/4349] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:12.734219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.734532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.734908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:12.759211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:12.760948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:12.772882 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2169/4350] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:11:12.773210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-652d198f-81df-478d-b333-f094500d398e None None] MFA Rules not processed for user `b623d81bb3794beaabfba5ed7f7ee574`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:12.774284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-652d198f-81df-478d-b333-f094500d398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:12.783827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:12.794988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13a9c-591b-468e-8887-c333c18e2341 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:12.803783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:12.813089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.813089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.813089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:12.813089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:11:12.813089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:12.813089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:12.827117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2170/4351] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:11:12.834920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:12.847839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2cbc0-05c2-4173-9a12-7d50ab8b07d4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:12.857250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:12.858228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.858690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.859137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:12.859947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:12.862669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:12.902718 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2182/4352] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:12.995041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:12.995531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:12.996016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.007587 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2171/4353] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:11:12 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:11:13.011200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.064702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] MFA Rules not processed for user `df46ce1cbcc44a47b7d6bd88c230cb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:13.068664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:13.153405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd817-ef49-4dcf-ac92-69679ede0c65 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.165416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.172329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.172329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.172329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.172329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.173949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.238779 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2183/4354] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:11:13.240424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.242164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:13.264977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0553e-e816-4819-96c7-9a99c2b1e0b9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.271196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.272502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.273021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.273572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.274866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.277925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.284154 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2172/4355] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:11:13 2022] POST /identity/v3/users => generated 280 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:11:13.285360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.312352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445116c8-e1c5-4b40-828a-98a897466f09 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.325585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.326265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.326529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.326836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.327445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.329706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.371386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2173/4356] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:13.372345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.385623 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2184/4357] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:11:13 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:11:13.397335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.401219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be43e8-643d-4cb0-ada6-5435830cccda admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.498294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:13.545606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.546291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.546585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.546905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.547552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.549390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.552707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97758-126f-4d54-a066-515e9a86997e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.568521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.569374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.569647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.571827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.574452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.581013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.583707 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2174/4358] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:13.584865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.606173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05bbf-d537-4770-a37c-b69ad13b612a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.621722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fefb8d-8bef-4098-bb26-f2fd860d9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.623295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fefb8d-8bef-4098-bb26-f2fd860d9836 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.623683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fefb8d-8bef-4098-bb26-f2fd860d9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.624072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fefb8d-8bef-4098-bb26-f2fd860d9836 admin admin] PATH_INFO: `/v3/projects/45d9f13ac11d4222aef33731aa3ca83f/users/355ca7d004c142c4925c2fd3af669821/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.655463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fefb8d-8bef-4098-bb26-f2fd860d9836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d9f13ac11d4222aef33731aa3ca83f, user_id=355ca7d004c142c4925c2fd3af669821, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.662664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fefb8d-8bef-4098-bb26-f2fd860d9836 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.720636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2185/4359] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:11:13 2022] POST /identity/v3/users => generated 296 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:11:13.725703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.749555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd09c-4605-47a5-a85f-2a8cf6c3cf7c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.759277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:13.760069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.760356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.760683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.761432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:13.764615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:13.774685 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2175/4360] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:11:13 2022] PUT /identity/v3/projects/45d9f13ac11d4222aef33731aa3ca83f/users/355ca7d004c142c4925c2fd3af669821/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:13.786553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:13.787352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:13.787890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:13.797248 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2186/4361] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:13.799560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:13.840167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabb7f1-9780-436f-8acc-e5e3061cf0c9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:13.855875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] MFA Rules not processed for user `355ca7d004c142c4925c2fd3af669821`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:13.860861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:13.984927 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2176/4362] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:14.025516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:14.026916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:14.030355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:14.030355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] PATH_INFO: `/v3/projects/74a32fc9524046aba63be664576bb28a/users/696b6bdc2ea64aa693e24e830a896795/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:14.038472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:14.046561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:14.109522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a32fc9524046aba63be664576bb28a, user_id=696b6bdc2ea64aa693e24e830a896795, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:14.116472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:14.218970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66b775-67a6-4817-a280-a98044abf412 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:14.228458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:14.229099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:14.229380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:14.229653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:14.245343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:14.247983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:14.262117 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2187/4363] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:11:13 2022] PUT /identity/v3/projects/74a32fc9524046aba63be664576bb28a/users/696b6bdc2ea64aa693e24e830a896795/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:14.264334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:14.272609 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2177/4364] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:11:14.274615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:14.466590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298c6c6-c6cf-49f7-b1a2-de3b08d7d514 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:14.472093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046915-1483-4920-99db-fb9ceaaf944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:14.473082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046915-1483-4920-99db-fb9ceaaf944d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:14.473374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046915-1483-4920-99db-fb9ceaaf944d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:14.473658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046915-1483-4920-99db-fb9ceaaf944d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:14.474380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046915-1483-4920-99db-fb9ceaaf944d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:14.481636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046915-1483-4920-99db-fb9ceaaf944d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:14.499501 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2188/4365] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:14.500160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:14.515981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea6e4d-952f-4580-a19d-6d72f5aceb9e service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:14.522005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:14.522688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:14.522975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:14.523299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] PATH_INFO: `/v3/projects/74a32fc9524046aba63be664576bb28a/users/696b6bdc2ea64aa693e24e830a896795/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:14.543250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a32fc9524046aba63be664576bb28a, user_id=696b6bdc2ea64aa693e24e830a896795, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:14.550655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:14.580037 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2178/4366] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:11:14 2022] PUT /identity/v3/projects/74a32fc9524046aba63be664576bb28a/users/696b6bdc2ea64aa693e24e830a896795/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:11:16.551658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46991215-e91b-45e5-bf70-79d03f16f868 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:16.552420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46991215-e91b-45e5-bf70-79d03f16f868 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:16.552420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46991215-e91b-45e5-bf70-79d03f16f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:16.611288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-46991215-e91b-45e5-bf70-79d03f16f868 None None] MFA Rules not processed for user `407049cbddff41a0839de47141b00c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:16.613041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-46991215-e91b-45e5-bf70-79d03f16f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:16.687366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:16.868247 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2189/4367] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:16.902196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:16.904888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:16.994348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:17.114009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a010-cab4-40d3-b473-bdce112077c9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:17.116686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729e44-34eb-470a-9760-69f454952eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:17.121280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729e44-34eb-470a-9760-69f454952eb8 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:17.121820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729e44-34eb-470a-9760-69f454952eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:17.122366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729e44-34eb-470a-9760-69f454952eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:17.194480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8729e44-34eb-470a-9760-69f454952eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:17.230644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8729e44-34eb-470a-9760-69f454952eb8 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:17.264253 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2179/4368] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:21.509047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:21.509541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:21.509651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:21.597931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] MFA Rules not processed for user `407049cbddff41a0839de47141b00c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:21.604875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:21.638264 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2190/4369] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:28.869039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=17 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:31.576506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=22 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:33.856389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:33.857488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:33.858264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:33.969688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] MFA Rules not processed for user `696b6bdc2ea64aa693e24e830a896795`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:33.971892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:34.129323 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2180/4370] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:34.139451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:34.142569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:34.345290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a22cb-4f1f-494c-ab2e-d5c0c12f001b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:34.352157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:34.353722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:34.353722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:34.353722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:34.516336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:34.522621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:34.564016 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2191/4371] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:38.700752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:38.700752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:38.857799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c3cb2-6e3a-41e7-98cc-8f0c1ffaae99 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:38.865194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:38.869193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:38.869193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:38.869193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] PATH_INFO: `/v3/users/87f5252f4fb8448196213da1e4f07bcd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:38.869193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f5252f4fb8448196213da1e4f07bcd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:38.871214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:39.151046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f5252f4fb8448196213da1e4f07bcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:39.191875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f5252f4fb8448196213da1e4f07bcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:39.205449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f5252f4fb8448196213da1e4f07bcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:39.207910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f5252f4fb8448196213da1e4f07bcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:39.209488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f5a7ed06-1c4f-4736-ac8d-db36bed8a6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f5252f4fb8448196213da1e4f07bcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:39.333456 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2181/4372] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:11:38 2022] DELETE /identity/v3/users/87f5252f4fb8448196213da1e4f07bcd => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:40.308486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:40.332214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bf84f-8677-48a6-a410-94eb99e5547a service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:40.499130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:40.500920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:40.502222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:40.502510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] PATH_INFO: `/v3/projects/1d6a161784e44d36acdc6f32ef9e7423` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:40.504158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6a161784e44d36acdc6f32ef9e7423)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:40.507465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:40.719564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:40.747490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6a161784e44d36acdc6f32ef9e7423', 'request_id': 'req-680bebb4-eac1-4244-9836-e607862be195'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:40.775936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6a161784e44d36acdc6f32ef9e7423', 'request_id': 'req-680bebb4-eac1-4244-9836-e607862be195'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:40.794685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6a161784e44d36acdc6f32ef9e7423', 'request_id': 'req-680bebb4-eac1-4244-9836-e607862be195'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:40.892405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] The token cache is being invalidate because project 1d6a161784e44d36acdc6f32ef9e7423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:11:40.892807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:40.893617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-680bebb4-eac1-4244-9836-e607862be195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:40.898613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2192/4373] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:11:40 2022] DELETE /identity/v3/projects/1d6a161784e44d36acdc6f32ef9e7423 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:40.900647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:40.901210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:40.901210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:40.913245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:40.937474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:40.938749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:41.126845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2182/4374] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:41.135562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:41.135869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:41.136060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:41.193658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:41.194939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:41.219772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2193/4375] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:41.231033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:41.268687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1c066-dd1a-435f-988a-2680e5599dc2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:41.285445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:41.286892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:41.289170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:41.289457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:41.290183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:11:41.301823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:41.306682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:41.348276 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2183/4376] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:11:41.352745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:41.370152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc357d-107d-4c69-bfe0-068b7a4c2efd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:41.410296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:41.411148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:41.411647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:41.413069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:41.415525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:41.419912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:42.149130 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2194/4377] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:11:41 2022] POST /identity/v3/projects => generated 399 bytes in 797 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:11:42.149636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:42.167636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1db3a-7c83-4161-828e-f3d87d72f364 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:42.365689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:42.366743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:42.367029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:42.367510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:42.368168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:42.371604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:42.523393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2184/4378] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:11:42 2022] POST /identity/v3/users => generated 300 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:11:42.534637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:42.551236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf635-b45d-41e7-a4b9-c14485309914 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:42.556563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:42.557525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:42.558036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:42.558816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:42.559671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:42.561490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:42.592938 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2195/4379] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:42.597923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:42.621801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849717d9-cee8-4376-879a-579b740f1268 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:42.629730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5e11e-9ab4-41ff-a153-8e29369e993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:42.630484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e11e-9ab4-41ff-a153-8e29369e993e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:42.630838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e11e-9ab4-41ff-a153-8e29369e993e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:42.631189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e11e-9ab4-41ff-a153-8e29369e993e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:42.631986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e11e-9ab4-41ff-a153-8e29369e993e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:42.633706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e11e-9ab4-41ff-a153-8e29369e993e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:42.666197 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2185/4380] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:42.672516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:42.688612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0bc45-9427-4f8b-a08c-067366a0a87a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:42.703973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:42.705180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:42.705655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:42.706141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] PATH_INFO: `/v3/projects/5267391a5c11415a90b0ce48613c0668/users/8ddf256d1034424e9422b9d275c251e4/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:42.731279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5267391a5c11415a90b0ce48613c0668, user_id=8ddf256d1034424e9422b9d275c251e4, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:42.735129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:42.829504 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2196/4381] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:11:42 2022] PUT /identity/v3/projects/5267391a5c11415a90b0ce48613c0668/users/8ddf256d1034424e9422b9d275c251e4/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:42.835337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:42.835891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:42.836344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:42.895068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:42.895969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:43.065237 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2186/4382] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:43.163900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:43.175744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:43.404931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ef723-46cd-4920-bc13-c2c8e2008078 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:43.422542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:43.423284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:43.423639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:43.423986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:43.437675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:43.438782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:43.453572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2197/4383] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:45.965188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:45.967566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:46.003604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6357ad-33aa-42aa-aa89-4ed3d344332d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:46.032853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:46.034372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:46.035650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:46.036427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] PATH_INFO: `/v3/users/2106de7fa0e648108cbf3bf7766ba238` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:46.040441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2106de7fa0e648108cbf3bf7766ba238)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:46.043434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:46.063582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:46.330373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2106de7fa0e648108cbf3bf7766ba238'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:46.369645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2106de7fa0e648108cbf3bf7766ba238'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:46.390757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2106de7fa0e648108cbf3bf7766ba238'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:46.390757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2106de7fa0e648108cbf3bf7766ba238'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:46.398433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-73366ef5-8970-4222-96a3-1d26c06ae17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2106de7fa0e648108cbf3bf7766ba238'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:46.519080 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2187/4384] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:11:45 2022] DELETE /identity/v3/users/2106de7fa0e648108cbf3bf7766ba238 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:47.826545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:47.843861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659fd0c-0837-4376-ba21-5c4d59cdc8a8 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:48.020574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:48.022374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:48.022856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:48.023578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] PATH_INFO: `/v3/projects/b3df3258c2e849bc8b2fc6fdf5ce4640` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:48.026432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3df3258c2e849bc8b2fc6fdf5ce4640)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:48.029094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:48.075104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:48.385836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3df3258c2e849bc8b2fc6fdf5ce4640', 'request_id': 'req-0743dd3f-65d5-4c7a-af96-6ede5e385599'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:48.404599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3df3258c2e849bc8b2fc6fdf5ce4640', 'request_id': 'req-0743dd3f-65d5-4c7a-af96-6ede5e385599'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:48.430666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3df3258c2e849bc8b2fc6fdf5ce4640', 'request_id': 'req-0743dd3f-65d5-4c7a-af96-6ede5e385599'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:48.535910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] The token cache is being invalidate because project b3df3258c2e849bc8b2fc6fdf5ce4640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:11:48.536426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:48.537322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0743dd3f-65d5-4c7a-af96-6ede5e385599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:11:48.541882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2198/4385] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:11:47 2022] DELETE /identity/v3/projects/b3df3258c2e849bc8b2fc6fdf5ce4640 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:48.546935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:48.547588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:48.547588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:48.608392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:48.610028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:48.705882 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2188/4386] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:48.714532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0555c-3918-48b0-8861-ada425987078 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:48.714963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0555c-3918-48b0-8861-ada425987078 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:48.716923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0555c-3918-48b0-8861-ada425987078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:48.750714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-59c0555c-3918-48b0-8861-ada425987078 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:48.752476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-59c0555c-3918-48b0-8861-ada425987078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:48.762012 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2199/4387] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:48.767012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:48.778143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369d53-f498-4da4-b108-28d383254e3c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:48.785593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:48.786645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:48.787124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:48.787621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:48.789128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:11:48.789686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:48.792157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:48.822613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2189/4388] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:11:48.827023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0555c-3918-48b0-8861-ada425987078 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:48.850960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0555c-3918-48b0-8861-ada425987078 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:48.868457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:48.869527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:48.870992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:48.871822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:48.877685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:48.877685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:48.996982 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2200/4389] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:11:48 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:11:49.001470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:49.036016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a18877-5234-483f-92f1-6aa03ef6a7ab admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:49.195455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:49.195949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:49.196233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:49.197335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:49.199024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:49.204406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:49.338330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:49.346144 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2190/4390] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:11:49 2022] POST /identity/v3/users => generated 288 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:11:49.349762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:49.367269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59518c-1039-41b1-bf1a-63995df04c57 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:49.372239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:49.372974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:49.373349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:49.375247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:49.376201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:49.377843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:49.390265 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2201/4391] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:49.394552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:49.407313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9773c-eccc-4fa2-a769-db9dda77f16a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:49.415023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef568-5aa0-48c2-8036-74d1e61b2134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:49.416226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef568-5aa0-48c2-8036-74d1e61b2134 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:49.416709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef568-5aa0-48c2-8036-74d1e61b2134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:49.417179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef568-5aa0-48c2-8036-74d1e61b2134 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:49.418063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ef568-5aa0-48c2-8036-74d1e61b2134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:49.419912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ef568-5aa0-48c2-8036-74d1e61b2134 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:49.432879 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2191/4392] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:11:49.437320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:49.450520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66c9c7-438e-4f81-94e6-a5aa74ac0c0a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:49.465889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:49.468278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:49.469568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:49.470828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] PATH_INFO: `/v3/projects/92dac742c70b4d3c93fa3d6707136cd2/users/3a7700aca8a14e1bae6e45e5d52e439c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:49.500758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92dac742c70b4d3c93fa3d6707136cd2, user_id=3a7700aca8a14e1bae6e45e5d52e439c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:49.504622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:49.633679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2202/4393] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:11:49 2022] PUT /identity/v3/projects/92dac742c70b4d3c93fa3d6707136cd2/users/3a7700aca8a14e1bae6e45e5d52e439c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:11:49.644990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:49.644990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:49.644990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:49.668492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:11:49.669746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:49.790270 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2192/4394] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:11:49.825550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:49.828479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:49.925198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603086-40cf-435d-a6ee-2db320affd0c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:49.960808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942893c6-33a9-415a-829f-5e79be606552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:49.964454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942893c6-33a9-415a-829f-5e79be606552 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:49.965069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942893c6-33a9-415a-829f-5e79be606552 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:49.966209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942893c6-33a9-415a-829f-5e79be606552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:50.003474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942893c6-33a9-415a-829f-5e79be606552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:50.006732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942893c6-33a9-415a-829f-5e79be606552 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:50.048696 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2203/4395] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:57.622832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:57.625130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:57.835262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299974f-ee1b-4d3f-a3dc-66f32700a253 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:57.854280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:57.855382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:57.855802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:57.856272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:57.860667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:57.883487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:57.885835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8812d-d6b2-422a-bc80-6888e1c18710 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:57.922252 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2193/4396] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:01.011066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:01.760954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:01.761246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:01.761523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:01.810852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] MFA Rules not processed for user `8ddf256d1034424e9422b9d275c251e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:01.812136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:01.928548 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2204/4397] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:02.041117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12f74-f5ad-4664-9b7a-da01fd2a14d4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:02.042043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12f74-f5ad-4664-9b7a-da01fd2a14d4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:02.042505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12f74-f5ad-4664-9b7a-da01fd2a14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:02.066977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-40c12f74-f5ad-4664-9b7a-da01fd2a14d4 None None] MFA Rules not processed for user `8ddf256d1034424e9422b9d275c251e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:02.077938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40c12f74-f5ad-4664-9b7a-da01fd2a14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:02.084242 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2194/4398] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:02.091630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:02.093680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:02.367451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016397-4252-4217-b10a-2a5b6c7ebf1d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:02.380032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:02.380842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:02.381226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:02.381602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:02.403569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:02.409768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:02.434775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2205/4399] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:10.479414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:10.480348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:10.480814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:10.612003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] MFA Rules not processed for user `3a7700aca8a14e1bae6e45e5d52e439c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:10.616799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:10.912812 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2195/4400] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:11.043251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:11.070120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe286e4-1a3a-4dd4-b12f-5269683a34e0 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:11.085696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:11.089005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:11.092555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:11.097706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:11.119873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:11.122659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:11.155925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2206/4401] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:12.999324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:13.002613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:13.013341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:13.027471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d824d0-5717-45b3-9cbb-2f71b4085976 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:13.035548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:13.037199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:13.038276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:13.041007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:13.043536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:13.082624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:13.082624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:13.104926 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2196/4402] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:13.199206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:13.200671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:13.232181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b60bc-d89e-4689-9750-1bd8af59eda5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:13.249635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:13.250254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:13.250549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:13.250820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] PATH_INFO: `/v3/users/407049cbddff41a0839de47141b00c6d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:13.253902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407049cbddff41a0839de47141b00c6d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:13.257289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:13.657905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:13.674711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407049cbddff41a0839de47141b00c6d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.675847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407049cbddff41a0839de47141b00c6d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.813881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407049cbddff41a0839de47141b00c6d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.824624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407049cbddff41a0839de47141b00c6d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.825744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407049cbddff41a0839de47141b00c6d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.883987 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2207/4403] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:13 2022] DELETE /identity/v3/users/407049cbddff41a0839de47141b00c6d => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:14.238113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:14.239602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:14.253280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12d588-97c3-4ad6-bc37-d30c82d43eae service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:14.361393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:14.364762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:14.365311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:14.365745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] PATH_INFO: `/v3/users/b623d81bb3794beaabfba5ed7f7ee574` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:14.367471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=b623d81bb3794beaabfba5ed7f7ee574)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:14.371883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:14.765172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b623d81bb3794beaabfba5ed7f7ee574'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.842711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b623d81bb3794beaabfba5ed7f7ee574'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.861017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b623d81bb3794beaabfba5ed7f7ee574'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.861785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b623d81bb3794beaabfba5ed7f7ee574'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.862479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b623d81bb3794beaabfba5ed7f7ee574'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:15.052942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2197/4404] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:14 2022] DELETE /identity/v3/users/b623d81bb3794beaabfba5ed7f7ee574 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:16.043697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:16.046319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:16.069338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88839f0e-c3fb-4c08-8795-54d558dd9a85 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:16.199392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:16.200810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:16.202145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:16.203052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] PATH_INFO: `/v3/projects/a45fbbfd04b6436aa1448d0bbcbb5785` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:16.205352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45fbbfd04b6436aa1448d0bbcbb5785)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:16.210106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:16.297713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:16.299281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:16.328957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51fc34-0810-4229-866f-f1b0f348fbde admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:16.364708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45fbbfd04b6436aa1448d0bbcbb5785', 'request_id': 'req-0977649c-cc99-4021-b0c6-cbb31a2c529f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.382529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45fbbfd04b6436aa1448d0bbcbb5785', 'request_id': 'req-0977649c-cc99-4021-b0c6-cbb31a2c529f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.395725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45fbbfd04b6436aa1448d0bbcbb5785', 'request_id': 'req-0977649c-cc99-4021-b0c6-cbb31a2c529f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.520021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] The token cache is being invalidate because project a45fbbfd04b6436aa1448d0bbcbb5785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:16.521685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:16.521821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.521929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:16.521929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:16.522598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] PATH_INFO: `/v3/projects/5afef5a6b2e74b02a0459ebbe0bb0843` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:16.525345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0977649c-cc99-4021-b0c6-cbb31a2c529f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.527051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afef5a6b2e74b02a0459ebbe0bb0843)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:16.529294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:16.532122 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2208/4405] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:16 2022] DELETE /identity/v3/projects/a45fbbfd04b6436aa1448d0bbcbb5785 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:16.540534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e5ae5-57ff-4361-a3ad-cd65aee70d80 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:16.540718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e5ae5-57ff-4361-a3ad-cd65aee70d80 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:16.541406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e5ae5-57ff-4361-a3ad-cd65aee70d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:16.556097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:16.599723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9e9e5ae5-57ff-4361-a3ad-cd65aee70d80 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:16.601448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9e9e5ae5-57ff-4361-a3ad-cd65aee70d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:16.612769 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2209/4406] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:16.624912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:16.625375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:16.625841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:16.659465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:16.664613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:16.676685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2210/4407] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:16.687336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:16.706699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd73cd-3671-43ac-a8c2-e4c474005e6a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:16.727609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:16.729116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:16.731096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:16.732028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:16.734974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:16.739752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:16.739752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:16.752321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afef5a6b2e74b02a0459ebbe0bb0843', 'request_id': 'req-506b5990-497a-43ac-a793-d68bf15a6bfa'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.766328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afef5a6b2e74b02a0459ebbe0bb0843', 'request_id': 'req-506b5990-497a-43ac-a793-d68bf15a6bfa'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.774788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2211/4408] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:16.777063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afef5a6b2e74b02a0459ebbe0bb0843', 'request_id': 'req-506b5990-497a-43ac-a793-d68bf15a6bfa'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.781000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:16.808814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c411ba-b508-4fa0-bdef-b7461c42076b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:16.817196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:16.951385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] The token cache is being invalidate because project 5afef5a6b2e74b02a0459ebbe0bb0843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:16.951846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.952642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-506b5990-497a-43ac-a793-d68bf15a6bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:16.961015 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2198/4409] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:16 2022] DELETE /identity/v3/projects/5afef5a6b2e74b02a0459ebbe0bb0843 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:16.962974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94c10-5294-459b-84ab-3cda9deb44c5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:16.963481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94c10-5294-459b-84ab-3cda9deb44c5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:16.964781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94c10-5294-459b-84ab-3cda9deb44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.035164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:17.036544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.038628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.039338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.041803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-76b94c10-5294-459b-84ab-3cda9deb44c5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:17.043091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:17.052803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-76b94c10-5294-459b-84ab-3cda9deb44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:17.054933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:17.090011 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2199/4410] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:17.110293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.111694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.114292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.224444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:17.226511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:17.284488 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2200/4411] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:17.292656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:17.298012 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2212/4412] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:17.299612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:17.304654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:17.312704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e2b51-9024-4ddc-9639-ee8ebefd8964 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:17.423977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:17.424607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.424889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.425165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.429474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:17.429474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:17.429474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:17.479805 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2201/4413] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:17.483545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:17.508449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752b184-8712-48cc-86f5-ac43b47023dd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:17.522944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:17.525208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.526920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.528007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.530525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:17.535765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:17.538345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7158d4-b696-4c5d-a3f2-40b9e196c776 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:17.554160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:17.555436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.557751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.559963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.560902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:17.581000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:17.787914 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2202/4414] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:17 2022] POST /identity/v3/projects => generated 401 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:17.788063 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2213/4415] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:17 2022] POST /identity/v3/users => generated 287 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:17.791561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:17.792444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:17.819315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48241a48-f5a5-4bd8-abd5-6d555db80a08 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:17.947569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b25b-214c-486b-bcb2-d20ee7c1633a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:17.969199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:17.970100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.970487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.970858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.971626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:17.973399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:17.984099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:17.985185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:17.986192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:17.986677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:17.987466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:17.994882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2214/4416] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:17.995159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:17.996469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:18.008231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe766-c59e-449f-89b8-2faba1d9a600 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:18.014260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:18.015074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.015465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.015858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.016757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:18.018561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:18.034440 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2215/4417] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:18.039066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:18.060969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87514473-532e-4bc7-8a22-d670a6e5a4af admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:18.066859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd6bf7-a0a9-4165-ae8c-b9b42a272d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:18.067939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6bf7-a0a9-4165-ae8c-b9b42a272d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.068589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6bf7-a0a9-4165-ae8c-b9b42a272d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.069003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6bf7-a0a9-4165-ae8c-b9b42a272d08 admin admin] PATH_INFO: `/v3/projects/35151ebaac5a4f48b613100d7f9f8812/users/423c7314f08c46d1b410a0af4db23f42/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.095670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd6bf7-a0a9-4165-ae8c-b9b42a272d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35151ebaac5a4f48b613100d7f9f8812, user_id=423c7314f08c46d1b410a0af4db23f42, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:18.101452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd6bf7-a0a9-4165-ae8c-b9b42a272d08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:18.217172 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2203/4418] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:17 2022] POST /identity/v3/users => generated 301 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:18.222272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:18.237179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fd64f-a5ac-4d1a-9d3f-c6b6c9bf2ca2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:18.243016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:18.243822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.244162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.244553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.245359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:18.247135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:18.264717 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2204/4419] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:18.280897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:18.297602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412b740-6aed-4919-8b53-844114e20e0b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:18.312573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:18.313416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.314469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.314972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.316486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:18.321316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:18.361511 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2205/4420] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:12:18.364977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:18.370877 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2216/4421] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:18 2022] PUT /identity/v3/projects/35151ebaac5a4f48b613100d7f9f8812/users/423c7314f08c46d1b410a0af4db23f42/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:18.381380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628518-7e4e-468d-8b10-47d11f7a58da None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.382133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628518-7e4e-468d-8b10-47d11f7a58da None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.382667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628518-7e4e-468d-8b10-47d11f7a58da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.385090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c32f6-1a31-4d80-936b-7f70341224c5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:18.448381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a5628518-7e4e-468d-8b10-47d11f7a58da None None] MFA Rules not processed for user `423c7314f08c46d1b410a0af4db23f42`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:18.449920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5628518-7e4e-468d-8b10-47d11f7a58da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:18.475053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0278-dad3-47f1-b20c-2f0fe88eb7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:18.475795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0278-dad3-47f1-b20c-2f0fe88eb7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.476088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0278-dad3-47f1-b20c-2f0fe88eb7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.476375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0278-dad3-47f1-b20c-2f0fe88eb7a5 admin admin] PATH_INFO: `/v3/projects/2bee8b21a44a4a5a8c69b75fb809d473/users/6d9eb7d7e13548ff868314dd9b90e342/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.509563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e0278-dad3-47f1-b20c-2f0fe88eb7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bee8b21a44a4a5a8c69b75fb809d473, user_id=6d9eb7d7e13548ff868314dd9b90e342, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:18.514978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e0278-dad3-47f1-b20c-2f0fe88eb7a5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:18.584302 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2217/4422] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:18.587039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.587420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.587853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.631227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] MFA Rules not processed for user `423c7314f08c46d1b410a0af4db23f42`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:18.632924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:18.678001 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2218/4423] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:18.691080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:18.693590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:18.770710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2206/4424] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:18 2022] PUT /identity/v3/projects/2bee8b21a44a4a5a8c69b75fb809d473/users/6d9eb7d7e13548ff868314dd9b90e342/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:18.781372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:18.798646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:18.798646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:18.833702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] MFA Rules not processed for user `6d9eb7d7e13548ff868314dd9b90e342`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:18.835534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:18.865448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153098b5-97f4-4170-a4bf-02a8ca039c8b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:18.928005 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2207/4425] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:18.949379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:19.020834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf71b8-a4c0-4f6f-b96d-b5c9aa3d24f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:19.021518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf71b8-a4c0-4f6f-b96d-b5c9aa3d24f9 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:19.024770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf71b8-a4c0-4f6f-b96d-b5c9aa3d24f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:19.024991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf71b8-a4c0-4f6f-b96d-b5c9aa3d24f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:19.082204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2294-bc8a-4510-abac-63b7a9c45af7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:19.088428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:19.089835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:19.090644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:19.091147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] PATH_INFO: `/v3/users/6d9eb7d7e13548ff868314dd9b90e342` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:19.093034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9eb7d7e13548ff868314dd9b90e342)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:19.096257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:19.151995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf71b8-a4c0-4f6f-b96d-b5c9aa3d24f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:19.167825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf71b8-a4c0-4f6f-b96d-b5c9aa3d24f9 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:19.206386 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2219/4426] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:12:19.554786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9eb7d7e13548ff868314dd9b90e342'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:19.571723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9eb7d7e13548ff868314dd9b90e342'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:19.582431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9eb7d7e13548ff868314dd9b90e342'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:19.583319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9eb7d7e13548ff868314dd9b90e342'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:19.583949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9eb7d7e13548ff868314dd9b90e342'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:19.725208 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2208/4427] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:18 2022] DELETE /identity/v3/users/6d9eb7d7e13548ff868314dd9b90e342 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:12:19.730841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:19.731224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:19.731578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:19.803944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:19.808727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:20.018407 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2220/4428] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:20.077626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.079223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:20.191091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef6835-799f-4f89-9604-125ba8aca5c9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.199588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.200421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.200875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.201317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.212681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.214620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.232850 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2209/4429] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:20.824699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.827460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:20.846212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94482e8-9cc8-478c-9ba7-81d8cec28940 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.852360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.853330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.853773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.856178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] PATH_INFO: `/v3/users/af4c64fac1e74e8aa06cc7483b12cf02` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.858725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4c64fac1e74e8aa06cc7483b12cf02)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.863402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:21.308674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4c64fac1e74e8aa06cc7483b12cf02'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:21.312517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4c64fac1e74e8aa06cc7483b12cf02'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:21.407102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4c64fac1e74e8aa06cc7483b12cf02'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:21.437407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4c64fac1e74e8aa06cc7483b12cf02'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:21.439373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f302d1b-57c8-4796-9407-93954c31cc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4c64fac1e74e8aa06cc7483b12cf02'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:21.501708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2221/4430] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:20 2022] DELETE /identity/v3/users/af4c64fac1e74e8aa06cc7483b12cf02 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:21.574823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:21.576982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:21.598291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7b58-4e69-466a-8d6b-09804d7bcf28 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:21.818310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:21.820198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:21.822896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:21.823204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] PATH_INFO: `/v3/projects/2bee8b21a44a4a5a8c69b75fb809d473` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:21.826771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bee8b21a44a4a5a8c69b75fb809d473)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:21.828813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:22.078764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:22.101356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bee8b21a44a4a5a8c69b75fb809d473', 'request_id': 'req-fc530e8b-4c27-41dc-bb13-9b4233e2176f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.127504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bee8b21a44a4a5a8c69b75fb809d473', 'request_id': 'req-fc530e8b-4c27-41dc-bb13-9b4233e2176f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.142743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bee8b21a44a4a5a8c69b75fb809d473', 'request_id': 'req-fc530e8b-4c27-41dc-bb13-9b4233e2176f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.223279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] The token cache is being invalidate because project 2bee8b21a44a4a5a8c69b75fb809d473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:22.223770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.225091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.226966 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2210/4431] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:21 2022] DELETE /identity/v3/projects/2bee8b21a44a4a5a8c69b75fb809d473 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:22.234404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64b2d3-5cc2-47f5-a341-baaf92020a50 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:22.235570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64b2d3-5cc2-47f5-a341-baaf92020a50 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:22.236150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64b2d3-5cc2-47f5-a341-baaf92020a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:22.281174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3f64b2d3-5cc2-47f5-a341-baaf92020a50 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:22.282469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3f64b2d3-5cc2-47f5-a341-baaf92020a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:22.462276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2222/4432] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:22.476036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:22.477590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:22.510693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a3a2-8f98-4f15-8f25-b448b834d5fb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:22.510973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a3a2-8f98-4f15-8f25-b448b834d5fb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:22.511480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a3a2-8f98-4f15-8f25-b448b834d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:22.548229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc530e8b-4c27-41dc-bb13-9b4233e2176f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:22.599299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:22.600633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:22.604149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:22.608638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-be83a3a2-8f98-4f15-8f25-b448b834d5fb None None] MFA Rules not processed for user `3a7700aca8a14e1bae6e45e5d52e439c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:22.609226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-be83a3a2-8f98-4f15-8f25-b448b834d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:22.614577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] PATH_INFO: `/v3/projects/28d057c8fdf747988db165403edc2593` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:22.616254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d057c8fdf747988db165403edc2593)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:22.618584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:22.637462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:22.800607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d057c8fdf747988db165403edc2593', 'request_id': 'req-07948a80-f6c4-4f5c-9789-a8333d11d507'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.827373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d057c8fdf747988db165403edc2593', 'request_id': 'req-07948a80-f6c4-4f5c-9789-a8333d11d507'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.853796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d057c8fdf747988db165403edc2593', 'request_id': 'req-07948a80-f6c4-4f5c-9789-a8333d11d507'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.909988 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2223/4433] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:22.914048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:22.925660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:22.926298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:22.989387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] The token cache is being invalidate because project 28d057c8fdf747988db165403edc2593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:22.990027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.991149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-07948a80-f6c4-4f5c-9789-a8333d11d507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:22.994727 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2211/4434] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:22 2022] DELETE /identity/v3/projects/28d057c8fdf747988db165403edc2593 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:22.999948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de376a39-7e62-434b-bc66-8ffe36fa733c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.001131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de376a39-7e62-434b-bc66-8ffe36fa733c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.002064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de376a39-7e62-434b-bc66-8ffe36fa733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.013889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:23.020401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:23.070042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-de376a39-7e62-434b-bc66-8ffe36fa733c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:23.074895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-de376a39-7e62-434b-bc66-8ffe36fa733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:23.248251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2224/4435] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:23.251822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:23.267119 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2212/4436] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:23.270368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.270897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.271181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.284544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afab96f-7532-4880-b4f9-4369d1dab37a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:23.319563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:23.323003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.323334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.323594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.332570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:23.332570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:23.332570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:23.353886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:23.354397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:23.384960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2213/4437] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:23.393159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:23.394170 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2225/4438] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:23.394413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:23.417747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00cbbc-c3ca-47c2-9e5c-dfa273f15ec3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:23.430924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570ce24-d2f2-4abd-902d-1b72d8cf88d4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:23.435572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:23.437095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.437095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.437095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.442729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:23.442729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:23.452622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:23.453018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:23.453767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.454176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.454707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.455372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:23.460957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:23.478648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2214/4439] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:23.484618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:23.502085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608525b3-96bf-4ddd-a107-3eaf3d6ea442 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:23.508294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:23.508972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.509265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.509533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.510280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:23.513479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:23.659802 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2226/4440] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:23 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:23.664354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:23.730960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2215/4441] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:23 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:23.736213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:23.799555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c465c-a332-4564-961e-208e90cbf8d9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:23.934038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:23.934750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.935160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.935871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.936861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:23.940005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:23.943642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed9418-1e86-40f1-aea1-e91bbb04d338 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:23.956880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:23.957724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:23.958170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:23.958589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:23.959377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:23.961569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.083287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2216/4442] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:23 2022] POST /identity/v3/users => generated 286 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:24.091918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.092058 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2227/4443] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:23 2022] POST /identity/v3/users => generated 293 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:12:24.095544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.108812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288130-e070-42b5-8a51-70ecbc95ee38 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.112073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bca7-fbbb-4dc4-844f-75b75a11da43 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.122607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.138798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.138798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.138798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.138798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.138798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.139524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.139524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.139524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.139524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.139773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.139773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.148428 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2217/4444] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:12:24.152362 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2228/4445] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:12:24.152859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.153365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.178943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e71f8-244e-42d3-a437-ec745ac8be56 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.190622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643cde-d0a8-44c7-a6cc-8697dd9bb2eb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.198914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.199622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.199968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.200233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.201878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.207407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.207784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.208575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.209102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.209964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.210892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.213132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.227814 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2218/4446] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:24.232143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.237127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2229/4447] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:24.241633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.250801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fd908-0910-44f8-9af2-ff0fb01db647 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.256691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b52c0c-0e4a-4dd9-a03f-474afa33c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.257508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52c0c-0e4a-4dd9-a03f-474afa33c9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.257792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52c0c-0e4a-4dd9-a03f-474afa33c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.258487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52c0c-0e4a-4dd9-a03f-474afa33c9ee admin admin] PATH_INFO: `/v3/projects/7fb6d3fee805460ba9e4264839b6d703/users/3fcbe2a53a6a495c8624e13fcd5ddaad/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.266552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0829371-948e-4363-9ecd-fedf04417e4e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.276300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb44de3-e8f8-4f36-b803-3bea5726bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.277099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb44de3-e8f8-4f36-b803-3bea5726bd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.277455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb44de3-e8f8-4f36-b803-3bea5726bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.278150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb44de3-e8f8-4f36-b803-3bea5726bd54 admin admin] PATH_INFO: `/v3/projects/66aacf11fed743cc923e6bb613ec14b2/users/7b7f1378bdc64f5fb8ddc1c8c1e4389a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.289809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52c0c-0e4a-4dd9-a03f-474afa33c9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb6d3fee805460ba9e4264839b6d703, user_id=3fcbe2a53a6a495c8624e13fcd5ddaad, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.297786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52c0c-0e4a-4dd9-a03f-474afa33c9ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.300983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb44de3-e8f8-4f36-b803-3bea5726bd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66aacf11fed743cc923e6bb613ec14b2, user_id=7b7f1378bdc64f5fb8ddc1c8c1e4389a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.304384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb44de3-e8f8-4f36-b803-3bea5726bd54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.424548 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2219/4448] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:24 2022] PUT /identity/v3/projects/7fb6d3fee805460ba9e4264839b6d703/users/3fcbe2a53a6a495c8624e13fcd5ddaad/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:24.430396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.430396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.430601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.456056 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2230/4449] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:24 2022] PUT /identity/v3/projects/66aacf11fed743cc923e6bb613ec14b2/users/7b7f1378bdc64f5fb8ddc1c8c1e4389a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:24.476526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:24.478504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:24.498316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:24.544253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.545368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.545887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.610961 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2220/4450] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:24.625141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.627980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:24.640451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] MFA Rules not processed for user `7b7f1378bdc64f5fb8ddc1c8c1e4389a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:24.642783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:24.749142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbd6a4-5a2a-47ac-80c4-c59a185662be None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:24.758645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81383db-5851-4386-a9ad-fc7e2f2cc1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:24.759327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81383db-5851-4386-a9ad-fc7e2f2cc1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.761071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81383db-5851-4386-a9ad-fc7e2f2cc1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.761562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81383db-5851-4386-a9ad-fc7e2f2cc1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.775033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81383db-5851-4386-a9ad-fc7e2f2cc1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:24.776574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81383db-5851-4386-a9ad-fc7e2f2cc1c4 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:24.790497 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2221/4451] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:24.832979 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2231/4452] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:24.848217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132aa9-5f61-4715-8160-c14fef9558f5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.849756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132aa9-5f61-4715-8160-c14fef9558f5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.851885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132aa9-5f61-4715-8160-c14fef9558f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.885276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-76132aa9-5f61-4715-8160-c14fef9558f5 None None] MFA Rules not processed for user `7b7f1378bdc64f5fb8ddc1c8c1e4389a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:24.889141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-76132aa9-5f61-4715-8160-c14fef9558f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:24.898351 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2222/4453] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:24.910183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:24.911687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:25.059634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0341-61b1-4159-8ec1-bd4b6afd22d5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:25.075980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3bace-482a-4f0d-9b74-8d4ac6373d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:25.078180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3bace-482a-4f0d-9b74-8d4ac6373d5c service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:25.080568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3bace-482a-4f0d-9b74-8d4ac6373d5c service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:25.081152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3bace-482a-4f0d-9b74-8d4ac6373d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:25.095511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:25.100373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3bace-482a-4f0d-9b74-8d4ac6373d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:25.102710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3bace-482a-4f0d-9b74-8d4ac6373d5c service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:25.138629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2232/4454] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:25.992502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:25.993482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:25.993950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:26.047850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] MFA Rules not processed for user `3fcbe2a53a6a495c8624e13fcd5ddaad`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:26.049835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:26.220642 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2223/4455] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:26.231511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:26.232460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:26.233127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:26.269490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] MFA Rules not processed for user `3fcbe2a53a6a495c8624e13fcd5ddaad`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:26.272028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:26.282121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2233/4456] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:26.543677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:26.546353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:26.608222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6161a-4a1b-4e3b-95b7-6f420ab22508 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:26.640628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:26.642267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:26.643530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:26.644606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:26.644886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:26.668864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:26.672060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:26.697328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2224/4457] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:27.225098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:28.608235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:28.642051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7103-617b-4965-a041-5758bbc7ad22 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:28.679742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:28.682083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:28.682367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:28.683115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] PATH_INFO: `/v3/users/3fcbe2a53a6a495c8624e13fcd5ddaad` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:28.689313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcbe2a53a6a495c8624e13fcd5ddaad)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:28.694390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:28.949575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcbe2a53a6a495c8624e13fcd5ddaad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:28.950794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcbe2a53a6a495c8624e13fcd5ddaad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:29.045176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcbe2a53a6a495c8624e13fcd5ddaad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:29.062896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcbe2a53a6a495c8624e13fcd5ddaad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:29.064021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e94193b1-ffd9-41e0-9db7-484ecb25108c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcbe2a53a6a495c8624e13fcd5ddaad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:29.145703 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2234/4458] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:28 2022] DELETE /identity/v3/users/3fcbe2a53a6a495c8624e13fcd5ddaad => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:30.030359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:30.191225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:30.205065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99b4f-0e39-4175-932b-b0aa072df8e5 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:30.339237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:30.342643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:30.342643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:30.342643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] PATH_INFO: `/v3/projects/7fb6d3fee805460ba9e4264839b6d703` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:30.342916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb6d3fee805460ba9e4264839b6d703)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:30.345375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:30.519451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb6d3fee805460ba9e4264839b6d703', 'request_id': 'req-6ce110cc-46c0-4628-b2e6-9ff6d556762f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:30.549311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb6d3fee805460ba9e4264839b6d703', 'request_id': 'req-6ce110cc-46c0-4628-b2e6-9ff6d556762f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:30.571663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb6d3fee805460ba9e4264839b6d703', 'request_id': 'req-6ce110cc-46c0-4628-b2e6-9ff6d556762f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:30.775937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] The token cache is being invalidate because project 7fb6d3fee805460ba9e4264839b6d703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:30.776382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:30.782399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ce110cc-46c0-4628-b2e6-9ff6d556762f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:30.789315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2225/4459] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:30 2022] DELETE /identity/v3/projects/7fb6d3fee805460ba9e4264839b6d703 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:30.795277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:30.795564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:30.796047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:30.798141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:30.844908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:30.848497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:30.999312 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2235/4460] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:31.007929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.008312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.008671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.038994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:31.042241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:31.062518 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2226/4461] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:31.067037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:31.088477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b842-fc51-4871-88bb-47591a563d3d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:31.095129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:31.096180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.096666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.097141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.098209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:31.098726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:31.100821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:31.129929 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2236/4462] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:31.131795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:31.147596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce31342-7f69-470c-a13c-f230293a0260 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:31.157356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:31.158003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.158292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.158567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.159475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:31.161436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:31.357397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2227/4463] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:31 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:31.361215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:31.383267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677cf7-2308-458f-a496-7dcae540657f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:31.496250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:31.496941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.497379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.497785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.499098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:31.503367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:31.634422 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2237/4464] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:31 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:31.635815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:31.661103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507d487-aedc-43de-968c-78c11ea5b2a4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:31.668737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:31.670290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.670801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.671282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.672187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:31.674523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:31.692987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2228/4465] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:31.696839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:31.711961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cd3f-5f8f-47df-b154-44debd3ff489 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:31.720500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51465c8d-7ed3-4576-b0cc-4c307f87db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:31.721551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465c8d-7ed3-4576-b0cc-4c307f87db7b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.722068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465c8d-7ed3-4576-b0cc-4c307f87db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.722567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465c8d-7ed3-4576-b0cc-4c307f87db7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.723835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51465c8d-7ed3-4576-b0cc-4c307f87db7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:31.726051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51465c8d-7ed3-4576-b0cc-4c307f87db7b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:31.755074 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2238/4466] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:31.759372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:31.776299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910086-32b1-4442-8853-ad6a4b375f6c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:31.786517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:31.787190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.787478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.788269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] PATH_INFO: `/v3/projects/939fd477be214483874d147e32cb6a35/users/08def8a420aa4a19b2cbf2e6988d2955/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:31.823409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939fd477be214483874d147e32cb6a35, user_id=08def8a420aa4a19b2cbf2e6988d2955, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:31.827426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:31.980626 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2229/4467] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:31 2022] PUT /identity/v3/projects/939fd477be214483874d147e32cb6a35/users/08def8a420aa4a19b2cbf2e6988d2955/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:31.986252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:31.986900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:31.987348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:32.023585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:32.024221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:32.191232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2239/4468] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:32.251198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:32.253617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:32.341310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:32.402638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb72fc-3dc1-457a-8928-55f7c8f8a052 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:32.407256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:32.409619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:32.410019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:32.410352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:32.444360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:32.450802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:32.473113 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2230/4469] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:33.712482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:34.436881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:36.207565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:44.804789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:44.808231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:44.842516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093afe-f6b4-40ed-82c5-60a4da15fac2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:44.863678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:44.870268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:44.874933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:44.890736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:44.894268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:45.017238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:45.038385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:45.040198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594f7c2-ba67-401f-a365-df8fe27fd354 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:45.060739 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2240/4470] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:46.622113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:46.635388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39b318-ae80-4d0d-b399-1599cdcbb953 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:46.656545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:46.657680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:46.658365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:46.658885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:46.665931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:46.702073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:46.703721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:46.723443 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2231/4471] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:51.659902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:51.660396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:51.660574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:51.773205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] MFA Rules not processed for user `08def8a420aa4a19b2cbf2e6988d2955`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:51.775160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:51.928713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2241/4472] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:51.937927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:51.940149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:51.978734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508bc88-5c26-469a-9754-845fd4cf5b3d service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:51.993052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1067b9-7150-41ee-909b-1b44fb6c2567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:51.997648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1067b9-7150-41ee-909b-1b44fb6c2567 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:51.998093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1067b9-7150-41ee-909b-1b44fb6c2567 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:51.998454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1067b9-7150-41ee-909b-1b44fb6c2567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:52.026199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1067b9-7150-41ee-909b-1b44fb6c2567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:52.034540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1067b9-7150-41ee-909b-1b44fb6c2567 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:52.056729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2232/4473] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:52.366324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:52.370822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:52.397538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f1e7-937b-4437-bee3-21c2882257f8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:52.412524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:52.413269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:52.413646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:52.425662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] PATH_INFO: `/v3/users/355ca7d004c142c4925c2fd3af669821` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:52.428692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=355ca7d004c142c4925c2fd3af669821)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:52.444395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:52.759190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355ca7d004c142c4925c2fd3af669821'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:52.760969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355ca7d004c142c4925c2fd3af669821'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:52.898162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355ca7d004c142c4925c2fd3af669821'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:52.923015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355ca7d004c142c4925c2fd3af669821'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:52.924999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355ca7d004c142c4925c2fd3af669821'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:52.985601 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2242/4474] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:52 2022] DELETE /identity/v3/users/355ca7d004c142c4925c2fd3af669821 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:52.990882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194317-3cd8-4cd9-9c39-29c3e8d30f4e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:52.991436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194317-3cd8-4cd9-9c39-29c3e8d30f4e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:52.991436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194317-3cd8-4cd9-9c39-29c3e8d30f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:53.018861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ef194317-3cd8-4cd9-9c39-29c3e8d30f4e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:53.020902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef194317-3cd8-4cd9-9c39-29c3e8d30f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:53.055133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:53.154104 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2233/4475] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:53.164785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:53.166761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:53.259403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5c7a3-aafe-4981-877d-ba68c45049bd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:53.279987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339bd0a-2a0e-49ba-a83c-1b031a468021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:53.281082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339bd0a-2a0e-49ba-a83c-1b031a468021 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:53.281571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339bd0a-2a0e-49ba-a83c-1b031a468021 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:53.282960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339bd0a-2a0e-49ba-a83c-1b031a468021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:53.322857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:53.330340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339bd0a-2a0e-49ba-a83c-1b031a468021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:53.333105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339bd0a-2a0e-49ba-a83c-1b031a468021 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:53.357713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2243/4476] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:53.635552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:53.635844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:53.636189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:53.719753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] MFA Rules not processed for user `df46ce1cbcc44a47b7d6bd88c230cb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:53.724267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:53.914863 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2234/4477] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:53.927663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe041-027c-4322-9407-3cba7e4b9ecf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:53.928209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe041-027c-4322-9407-3cba7e4b9ecf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:53.928209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe041-027c-4322-9407-3cba7e4b9ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:53.978694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a20fe041-027c-4322-9407-3cba7e4b9ecf None None] MFA Rules not processed for user `df46ce1cbcc44a47b7d6bd88c230cb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:53.979968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a20fe041-027c-4322-9407-3cba7e4b9ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:54.012531 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2244/4478] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:54.574793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:54.578161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:54.595925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aedda-f18e-4953-85f7-c81fef8a2ef3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:54.604635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:54.607416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:54.607938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:54.608861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] PATH_INFO: `/v3/projects/45d9f13ac11d4222aef33731aa3ca83f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:54.611798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d9f13ac11d4222aef33731aa3ca83f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:54.616137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:54.918245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d9f13ac11d4222aef33731aa3ca83f', 'request_id': 'req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:54.930831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d9f13ac11d4222aef33731aa3ca83f', 'request_id': 'req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:54.948533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d9f13ac11d4222aef33731aa3ca83f', 'request_id': 'req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:55.096037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] The token cache is being invalidate because project 45d9f13ac11d4222aef33731aa3ca83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:55.096327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:55.100659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b5518c3-5e9a-4fbb-ad7c-0a4e3f5c5501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:55.104070 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2235/4479] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:54 2022] DELETE /identity/v3/projects/45d9f13ac11d4222aef33731aa3ca83f => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:55.109589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.110144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.110218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.140353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:55.142405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:55.243244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2245/4480] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:55.252018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.252309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.252831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.279769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:55.281545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:55.296111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:55.296537 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2236/4481] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:55.309465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3d5f5-c861-4491-b132-b61f56c37935 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:55.319422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:55.325243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.325243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.325243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.325243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:55.325243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:55.325243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:55.338082 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2246/4482] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:12:55.343805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:55.363134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f42e-d47a-463d-8034-4240c00642f9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:55.373434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:55.375197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.376178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.383339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.383339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:55.383339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:55.578086 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2237/4483] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:55 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:55.590850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:55.626255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c9b6-8a4a-47a4-8f4a-b7c9216f85d2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:55.825181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:55.826980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.827265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.830347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.830347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:55.831515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:55.858255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:55.860152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:55.889142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b905-69a5-4ca1-9f48-06c893db0ad8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:55.937186 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2247/4484] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:55 2022] POST /identity/v3/users => generated 291 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:55.945165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:55.951104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:55.951909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.952294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.952736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] PATH_INFO: `/v3/users/8ddf256d1034424e9422b9d275c251e4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.954301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddf256d1034424e9422b9d275c251e4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:55.957485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:55.962986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd780a5-2933-4ff4-9584-ddd96722f283 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:55.973328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:55.974943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:55.975597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:55.975597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:55.976494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:55.978307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:56.004113 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2248/4485] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:56.006860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:56.035398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e9c8-9269-49b1-a79a-f3fa3abe2192 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:56.052821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:56.053737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:56.054068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:56.054401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:56.055070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:56.056731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:56.084056 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2249/4486] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:56.085687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:56.098415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbe429-255c-48b2-b8d2-965cae3a4d21 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:56.104666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39fc58-8c20-40bc-81d3-b0584c113fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:56.106231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39fc58-8c20-40bc-81d3-b0584c113fef admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:56.106674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39fc58-8c20-40bc-81d3-b0584c113fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:56.107345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39fc58-8c20-40bc-81d3-b0584c113fef admin admin] PATH_INFO: `/v3/projects/701f064a75da49c780616ce27084336d/users/7940271d3f2b4ea696422588155c7f8d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:56.126895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:56.142406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39fc58-8c20-40bc-81d3-b0584c113fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=701f064a75da49c780616ce27084336d, user_id=7940271d3f2b4ea696422588155c7f8d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:56.150002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39fc58-8c20-40bc-81d3-b0584c113fef admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:56.246416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddf256d1034424e9422b9d275c251e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:56.275333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddf256d1034424e9422b9d275c251e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:56.298808 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2250/4487] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:56 2022] PUT /identity/v3/projects/701f064a75da49c780616ce27084336d/users/7940271d3f2b4ea696422588155c7f8d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:12:56.304556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddf256d1034424e9422b9d275c251e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:56.305608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddf256d1034424e9422b9d275c251e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:56.306436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddf256d1034424e9422b9d275c251e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:56.315859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:56.319812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:56.320383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:56.394617 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2238/4488] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:55 2022] DELETE /identity/v3/users/8ddf256d1034424e9422b9d275c251e4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:56.408236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] MFA Rules not processed for user `7940271d3f2b4ea696422588155c7f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:56.410955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:56.446440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:56.553084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2251/4489] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:56.620638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:56.624802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:56.710718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066ad6d-0a84-4f6c-bf41-b10c853f76a4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:56.724483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:56.725280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:56.725660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:56.726803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:56.737450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:56.739961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:56.753915 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2239/4490] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:56.784305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:56.785993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:56.897803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101effb-7383-40bb-b2e2-a77fb7029006 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:56.909919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:56.911130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:56.912660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:56.913102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] PATH_INFO: `/v3/users/7940271d3f2b4ea696422588155c7f8d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:56.915945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7940271d3f2b4ea696422588155c7f8d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:56.929354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:57.052552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:57.054840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:57.071274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d09a-3f25-44de-b88f-5f0abee8be75 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:57.084769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:57.084769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.086059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.086545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] PATH_INFO: `/v3/projects/5267391a5c11415a90b0ce48613c0668` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.091321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5267391a5c11415a90b0ce48613c0668)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:57.093746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:57.226512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7940271d3f2b4ea696422588155c7f8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.230672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7940271d3f2b4ea696422588155c7f8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.357088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7940271d3f2b4ea696422588155c7f8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.367848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7940271d3f2b4ea696422588155c7f8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.368870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e6545312-cbf6-41f9-b9f8-2acdd5286346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7940271d3f2b4ea696422588155c7f8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.379236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5267391a5c11415a90b0ce48613c0668', 'request_id': 'req-c278417f-46c8-41bc-b761-01785ae597f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.410053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5267391a5c11415a90b0ce48613c0668', 'request_id': 'req-c278417f-46c8-41bc-b761-01785ae597f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.424960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5267391a5c11415a90b0ce48613c0668', 'request_id': 'req-c278417f-46c8-41bc-b761-01785ae597f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.428164 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2252/4491] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:56 2022] DELETE /identity/v3/users/7940271d3f2b4ea696422588155c7f8d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:57.430254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e97d3-2968-4469-8563-683d0083361a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.432808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e97d3-2968-4469-8563-683d0083361a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.433244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e97d3-2968-4469-8563-683d0083361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.479620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e1e97d3-2968-4469-8563-683d0083361a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:57.482923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e1e97d3-2968-4469-8563-683d0083361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:57.519827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] The token cache is being invalidate because project 5267391a5c11415a90b0ce48613c0668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:57.520389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.521502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c278417f-46c8-41bc-b761-01785ae597f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:57.525049 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2240/4492] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:57 2022] DELETE /identity/v3/projects/5267391a5c11415a90b0ce48613c0668 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:57.533946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.535273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.535710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.577157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:57.581109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:57.586752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:57.646456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:57.712433 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2253/4493] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:57.754059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2241/4494] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:57.759385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.759707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.760050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.770464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:57.772120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:57.798193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:57.799788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:57.823380 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2254/4495] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:57.825886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:57.843408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddc77d-23db-46d9-8663-526996e3ffb0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:57.849614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:57.850346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.850549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.850837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.851539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:57.852106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:57.853991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:57.869905 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2255/4496] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:57.874823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:57.888972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f71f8-ac29-42bc-adb3-806d079e1958 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:57.895801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:57.896504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.896784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.897064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.897768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:57.899695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:57.957824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8087a4-1d21-455c-bc02-3db198db6abe None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:57.978931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:57.979724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:57.980084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:57.980333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:57.998671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:58.000203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:58.007666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2256/4497] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:57 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:58.014913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:58.030011 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2242/4498] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:12:58.239876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880695-3425-4118-9360-39cbfb975d7d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:58.250093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:58.252625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:58.252625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:58.253161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:58.254862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:58.258064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:58.362292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2257/4499] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:58 2022] POST /identity/v3/users => generated 286 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:12:58.366800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:58.386638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407f78c-7129-4356-9cba-8015fcd59f01 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:58.397303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:58.398416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:58.399270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:58.399909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:58.400967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:58.404519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:58.423419 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2243/4500] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:58.428421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:58.450645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83b1c6-81aa-48a6-992a-53dd2f5bb956 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:58.457317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700220bd-2ddd-4366-8672-76aaf29bddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:58.458987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700220bd-2ddd-4366-8672-76aaf29bddc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:58.459284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700220bd-2ddd-4366-8672-76aaf29bddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:58.462874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700220bd-2ddd-4366-8672-76aaf29bddc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:58.462874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700220bd-2ddd-4366-8672-76aaf29bddc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:58.466000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700220bd-2ddd-4366-8672-76aaf29bddc6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:58.488940 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2258/4501] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:58.493778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:58.520413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5048c-eca4-48ee-b0ea-1aee22e2e9ae admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:58.528851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a963a-5bc6-4a2f-9439-916c6bb8e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:58.530075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a963a-5bc6-4a2f-9439-916c6bb8e555 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:58.530600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a963a-5bc6-4a2f-9439-916c6bb8e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:58.531066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a963a-5bc6-4a2f-9439-916c6bb8e555 admin admin] PATH_INFO: `/v3/projects/c6e8fa8a33ad461e87fb95fd60cb0e24/users/d9c11643a65447f4ac9436b623148567/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:58.555587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a963a-5bc6-4a2f-9439-916c6bb8e555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e8fa8a33ad461e87fb95fd60cb0e24, user_id=d9c11643a65447f4ac9436b623148567, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:58.563166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a963a-5bc6-4a2f-9439-916c6bb8e555 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:58.774631 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2244/4502] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:58 2022] PUT /identity/v3/projects/c6e8fa8a33ad461e87fb95fd60cb0e24/users/d9c11643a65447f4ac9436b623148567/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:58.788075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:58.788075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:58.788477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:58.828592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] MFA Rules not processed for user `d9c11643a65447f4ac9436b623148567`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:58.830757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:58.920737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:58.930274 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2259/4503] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:58.945001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:58.946157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:58.946692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:58.972677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] MFA Rules not processed for user `d9c11643a65447f4ac9436b623148567`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:58.974170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:58.987042 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2245/4504] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:59.007457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:59.009419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:59.100577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:59.102120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:59.139087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876b8a-1e46-4cc7-b3d5-9435edb0cf9a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:59.145808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277c07-50d0-4043-813e-69b6ccb6cce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:59.146499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277c07-50d0-4043-813e-69b6ccb6cce4 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.146785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277c07-50d0-4043-813e-69b6ccb6cce4 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.147065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277c07-50d0-4043-813e-69b6ccb6cce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.166441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277c07-50d0-4043-813e-69b6ccb6cce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:59.169399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277c07-50d0-4043-813e-69b6ccb6cce4 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:59.202163 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2260/4505] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:59.238493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171b2da-46fc-4d28-8509-ae6021a130eb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:59.239364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d69329-0779-40c2-999d-398eb6d818d5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.240749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d69329-0779-40c2-999d-398eb6d818d5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.241803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d69329-0779-40c2-999d-398eb6d818d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.246522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:59.248279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.248618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.248902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] PATH_INFO: `/v3/projects/701f064a75da49c780616ce27084336d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.250993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701f064a75da49c780616ce27084336d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:59.253804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:59.274760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2d69329-0779-40c2-999d-398eb6d818d5 None None] MFA Rules not processed for user `08def8a420aa4a19b2cbf2e6988d2955`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:59.276745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2d69329-0779-40c2-999d-398eb6d818d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:59.374859 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2261/4506] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:59.385545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:59.401396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701f064a75da49c780616ce27084336d', 'request_id': 'req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:59.409471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701f064a75da49c780616ce27084336d', 'request_id': 'req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:59.423976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701f064a75da49c780616ce27084336d', 'request_id': 'req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:59.567051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] The token cache is being invalidate because project 701f064a75da49c780616ce27084336d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:59.571291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:59.572181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab681d4b-b43e-4fdf-8afb-d83b4bd1b333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:59.577209 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2246/4507] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:59 2022] DELETE /identity/v3/projects/701f064a75da49c780616ce27084336d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:12:59.582612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.582910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.583187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.612994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:59.613893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:59.715604 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2262/4508] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:59.725666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.726004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.726283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.772648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:59.775145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:59.817979 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2247/4509] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:59.819049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:59.849521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e89fd-0821-4fcf-a8b2-14dbc9f0b54c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:59.865709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:59.865709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.865709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.865709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.870060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:59.873027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:59.875917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:59.918741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:59.925826 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2263/4510] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:59.936769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f0128-1f35-4291-8d05-5e089e8f2610 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:59.954040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:59.954669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:59.958709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:59.958709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:59.958709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:59.958709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:00.190515 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2248/4511] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:59 2022] POST /identity/v3/projects => generated 369 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:00.191757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:00.209610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90a0a6-bbcd-40e2-b838-239056e5cd92 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:00.234326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:00.321246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:00.322721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:00.323196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:00.323785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:00.325668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:00.327763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:00.433383 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2264/4512] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:00 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:00.435211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:00.459810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749316d-184a-4b25-9d3f-b4774cf9332d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:00.491942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:00.492731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:00.493023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:00.493302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:00.493996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:00.495660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:00.514367 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2249/4513] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:00.519499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:00.534598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4806b-d587-4872-8332-7c2d185b1994 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:00.542852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63969d9-90f9-4af5-b885-089e06929b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:00.543496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63969d9-90f9-4af5-b885-089e06929b40 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:00.544006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63969d9-90f9-4af5-b885-089e06929b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:00.544267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63969d9-90f9-4af5-b885-089e06929b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:00.544934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63969d9-90f9-4af5-b885-089e06929b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:00.547057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63969d9-90f9-4af5-b885-089e06929b40 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:00.577373 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2265/4514] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:00.581498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:00.599491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f5f0c-d49e-4a5c-9c6f-eff15762d96d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:00.606677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:00.607625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:00.608098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:00.608979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] PATH_INFO: `/v3/projects/f0b29c0deba84bc18224e7ba37d74d39/users/4166ef8ad0da42f69a8b682cf66e19ac/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:00.635261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b29c0deba84bc18224e7ba37d74d39, user_id=4166ef8ad0da42f69a8b682cf66e19ac, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:00.639158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:00.781551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2250/4515] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:00 2022] PUT /identity/v3/projects/f0b29c0deba84bc18224e7ba37d74d39/users/4166ef8ad0da42f69a8b682cf66e19ac/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:00.791802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:00.792122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:00.793047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:00.832073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] MFA Rules not processed for user `4166ef8ad0da42f69a8b682cf66e19ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:00.833455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:00.938040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:00.949368 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2266/4516] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:01.023437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6dc1b-c76e-4cfa-9aad-68c63f4f50a1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:01.029683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:01.030436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:01.030791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:01.031064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:01.031708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:01.033627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:01.164588 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2251/4517] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:00 2022] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:01.170976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:01.186321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfea5-fa96-49b8-bf71-930b3818a540 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:01.297093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:01.299121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:01.299867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:01.300230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:01.301476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:01.303555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:01.401112 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2267/4518] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:01 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:01.406396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:01.438891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee236-29bf-44ff-b64b-5f1b20ad2891 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:01.450969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178ae0-5459-44dc-bcd2-1761e6e4b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:01.451861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178ae0-5459-44dc-bcd2-1761e6e4b3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:01.452288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178ae0-5459-44dc-bcd2-1761e6e4b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:01.452700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178ae0-5459-44dc-bcd2-1761e6e4b3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:01.453583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178ae0-5459-44dc-bcd2-1761e6e4b3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:01.456062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178ae0-5459-44dc-bcd2-1761e6e4b3c8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:01.475819 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2252/4519] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:01.480201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:01.495426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0169-ca8e-4f5e-846f-3c2545ad547b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:01.513897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:01.516433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:01.517369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:01.518271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] PATH_INFO: `/v3/projects/06ddbed650024ebdbc97eaa5711154a3/users/e099d973bc8947b8a5b07a1bf592b06e/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:01.519928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:01.520663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:01.521179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:01.548138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:01.570816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ddbed650024ebdbc97eaa5711154a3, user_id=e099d973bc8947b8a5b07a1bf592b06e, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:01.574415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:01.582983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] MFA Rules not processed for user `d9c11643a65447f4ac9436b623148567`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:01.584097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:01.671920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:01.753979 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2268/4520] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:01 2022] PUT /identity/v3/projects/06ddbed650024ebdbc97eaa5711154a3/users/e099d973bc8947b8a5b07a1bf592b06e/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:01.760357 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2253/4521] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:01.762263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:02.005658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850b447-70f2-458f-89e5-04974974039e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:02.019048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21073-5ce8-46de-adeb-da2667fdfcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:02.020368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21073-5ce8-46de-adeb-da2667fdfcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:02.020692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21073-5ce8-46de-adeb-da2667fdfcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:02.021036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21073-5ce8-46de-adeb-da2667fdfcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:02.021915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21073-5ce8-46de-adeb-da2667fdfcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:02.024685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21073-5ce8-46de-adeb-da2667fdfcc1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:02.050941 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2269/4522] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:02.055064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:02.068542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442b21f-e0a6-4956-8e03-cb3abdb646d5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:02.075847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:02.077069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:02.077633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:02.078195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] PATH_INFO: `/v3/projects/06ddbed650024ebdbc97eaa5711154a3/users/e099d973bc8947b8a5b07a1bf592b06e/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:02.081133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ddbed650024ebdbc97eaa5711154a3, user_id=e099d973bc8947b8a5b07a1bf592b06e, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:02.085268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:02.137080 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2254/4523] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:02 2022] PUT /identity/v3/projects/06ddbed650024ebdbc97eaa5711154a3/users/e099d973bc8947b8a5b07a1bf592b06e/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:02.149009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:02.149425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:02.149670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:02.246886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] MFA Rules not processed for user `e099d973bc8947b8a5b07a1bf592b06e`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:02.251856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:02.439927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2270/4524] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:02.450643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:02.452863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:02.474511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:02.482070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:02.721051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cea9-4427-4901-b7bf-cedc62fd33c6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:02.726046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:02.732599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:02.733321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:02.733799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:02.734746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35ed27-0a5d-4e2d-b528-380a57a8268d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:02.736683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:02.751222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:02.758030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:02.758030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:02.758030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:02.780075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:02.781662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:02.796330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2255/4525] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:02.903868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:02.905413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:02.960743 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2271/4526] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:03.615896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:04.432631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:04.450646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13a93-79f1-4b03-b3d3-e19d80341045 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:04.457167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:04.458547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:04.459049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:04.460218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:04.465633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:04.483186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:04.485287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68643256-5168-49ba-9d9e-094a86d8b209 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:04.498741 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2256/4527] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:07.680723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:07.960495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cddbe9-2331-4767-84b2-acc7361d71bd service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:07.981637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:07.983146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:07.994706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:07.994706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] PATH_INFO: `/v3/users/4166ef8ad0da42f69a8b682cf66e19ac` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:07.994706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4166ef8ad0da42f69a8b682cf66e19ac)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:07.994706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:08.266903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4166ef8ad0da42f69a8b682cf66e19ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:08.267830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4166ef8ad0da42f69a8b682cf66e19ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:08.400923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4166ef8ad0da42f69a8b682cf66e19ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:08.426134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4166ef8ad0da42f69a8b682cf66e19ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:08.431091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4166ef8ad0da42f69a8b682cf66e19ac'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:08.460029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2272/4528] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:07 2022] DELETE /identity/v3/users/4166ef8ad0da42f69a8b682cf66e19ac => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:08.470519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:08.472134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:08.472938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:08.509628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:08.511316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:08.653138 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2257/4529] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:08.663880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:08.665814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:08.738528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:08.771940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8443fc-8e17-4677-90f4-3c916dbde686 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:08.782804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:08.782804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:08.782804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:08.784114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:08.796752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:08.798331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:08.811599 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2273/4530] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:10.439680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:10.442112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:10.474825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91425-6b6b-41ce-86aa-84db51f2c734 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:10.498095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:10.499138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:10.499416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:10.499866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] PATH_INFO: `/v3/users/423c7314f08c46d1b410a0af4db23f42` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:10.502097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423c7314f08c46d1b410a0af4db23f42)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:10.510300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:10.552772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:10.555013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:10.579808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59717727-6894-4798-9599-8d82bc3ebeae service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:10.592954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:10.593942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:10.594371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:10.594766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] PATH_INFO: `/v3/projects/f0b29c0deba84bc18224e7ba37d74d39` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:10.596166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b29c0deba84bc18224e7ba37d74d39)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:10.598588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:10.820522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423c7314f08c46d1b410a0af4db23f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.825478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:10.828482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b29c0deba84bc18224e7ba37d74d39', 'request_id': 'req-6be934bc-c0d4-475d-a129-e29b1964506f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.842205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b29c0deba84bc18224e7ba37d74d39', 'request_id': 'req-6be934bc-c0d4-475d-a129-e29b1964506f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.845249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423c7314f08c46d1b410a0af4db23f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.863527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423c7314f08c46d1b410a0af4db23f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.870017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423c7314f08c46d1b410a0af4db23f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.876472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b29c0deba84bc18224e7ba37d74d39', 'request_id': 'req-6be934bc-c0d4-475d-a129-e29b1964506f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.881912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1aaffd9b-750e-461e-b8d6-9a3c3bb962b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423c7314f08c46d1b410a0af4db23f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.973249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] The token cache is being invalidate because project f0b29c0deba84bc18224e7ba37d74d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:10.982473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:10.984393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:11.005562 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2274/4531] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:10 2022] DELETE /identity/v3/projects/f0b29c0deba84bc18224e7ba37d74d39 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:11.007894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:11.012814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:11.092648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2258/4532] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:10 2022] DELETE /identity/v3/users/423c7314f08c46d1b410a0af4db23f42 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:11.110534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:11.110840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:11.111112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:11.148870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:11.150716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:11.193184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be934bc-c0d4-475d-a129-e29b1964506f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:11.289272 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2259/4533] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:11.299633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:11.302549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:11.314334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:11.315334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:11.315807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:11.316126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] PATH_INFO: `/v3/users/e099d973bc8947b8a5b07a1bf592b06e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:11.317330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e099d973bc8947b8a5b07a1bf592b06e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:11.319424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:11.420126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5ee66-027b-466b-a33a-2a8f4bd064ff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:11.429156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:11.430292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:11.431160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:11.431773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:11.475494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:11.480487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:11.503124 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2260/4534] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:11.697365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e099d973bc8947b8a5b07a1bf592b06e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:11.701308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e099d973bc8947b8a5b07a1bf592b06e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:11.820325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e099d973bc8947b8a5b07a1bf592b06e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:11.835072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e099d973bc8947b8a5b07a1bf592b06e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:11.836499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e099d973bc8947b8a5b07a1bf592b06e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:11.893526 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2275/4535] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:11 2022] DELETE /identity/v3/users/e099d973bc8947b8a5b07a1bf592b06e => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:12.715296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:12.718123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:12.765251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e7556-5a02-43e2-b54d-30473973f663 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:12.951761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:12.953047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:12.953342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:12.954040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] PATH_INFO: `/v3/users/7b7f1378bdc64f5fb8ddc1c8c1e4389a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:12.958493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7f1378bdc64f5fb8ddc1c8c1e4389a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:12.961082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:13.338480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:13.340566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:13.372629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794667-5ec6-4f46-9622-aa5f7e7d9312 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:13.388776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:13.398473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:13.398762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:13.399609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] PATH_INFO: `/v3/projects/35151ebaac5a4f48b613100d7f9f8812` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:13.408668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35151ebaac5a4f48b613100d7f9f8812)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:13.412803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:13.460339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7f1378bdc64f5fb8ddc1c8c1e4389a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.540442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7f1378bdc64f5fb8ddc1c8c1e4389a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.555330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7f1378bdc64f5fb8ddc1c8c1e4389a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.556314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7f1378bdc64f5fb8ddc1c8c1e4389a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.557264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c33c5bc6-1872-4502-83b4-1029d30ff911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7f1378bdc64f5fb8ddc1c8c1e4389a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.632662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35151ebaac5a4f48b613100d7f9f8812', 'request_id': 'req-7a244da1-a5c2-41a5-87c5-ea690c903502'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.654798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35151ebaac5a4f48b613100d7f9f8812', 'request_id': 'req-7a244da1-a5c2-41a5-87c5-ea690c903502'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.666548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35151ebaac5a4f48b613100d7f9f8812', 'request_id': 'req-7a244da1-a5c2-41a5-87c5-ea690c903502'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.729685 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2261/4536] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:12 2022] DELETE /identity/v3/users/7b7f1378bdc64f5fb8ddc1c8c1e4389a => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:13.731398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:13.731919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:13.732396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:13.757288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:13.758979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:13.868057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] The token cache is being invalidate because project 35151ebaac5a4f48b613100d7f9f8812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:13.868483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.875539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7a244da1-a5c2-41a5-87c5-ea690c903502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:13.891698 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2276/4537] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:13 2022] DELETE /identity/v3/projects/35151ebaac5a4f48b613100d7f9f8812 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:13.899779 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2262/4538] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:13.899987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd05c0-587b-466f-9c8e-5bf93ec83d28 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:13.899987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd05c0-587b-466f-9c8e-5bf93ec83d28 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:13.903545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd05c0-587b-466f-9c8e-5bf93ec83d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:13.956297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:13.959019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:13.973746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-38dd05c0-587b-466f-9c8e-5bf93ec83d28 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:13.975184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-38dd05c0-587b-466f-9c8e-5bf93ec83d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:14.004902 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2277/4539] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:14.008126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:14.008126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:14.008126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:14.062853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:14.069877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:14.098554 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2278/4540] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:14.109014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:14.124761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2960-6b2a-441f-bc12-2c51ebc2ab03 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:14.148870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:14.149256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:14.149542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:14.149815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:14.161287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e37d27-a73e-4900-91f2-32ff22a7cbd1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:14.171881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:14.173585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:14.174233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:14.174754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:14.177340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:14.178036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:14.179152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:14.183792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:14.208383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:14.210728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:14.219672 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2279/4541] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:14.220878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:14.246244 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2263/4542] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:13:14.254264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f150ac-1170-4205-a367-a8c68801e6d0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:14.274519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:14.275167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:14.275455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:14.275716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:14.276538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:14.278598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:14.488295 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2280/4543] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:14 2022] POST /identity/v3/projects => generated 367 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:14.494326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:14.512233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:14.515042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:14.546448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c35c-99ba-4fa0-85a5-db6133691aa1 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:14.740766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:14.741791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:14.744359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:14.745905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:14.746718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:14.752866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:14.806199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390649-56ab-4851-bab1-3028fc0a4a54 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:14.816330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:14.817007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:14.819019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:14.819356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] PATH_INFO: `/v3/projects/06ddbed650024ebdbc97eaa5711154a3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:14.820819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ddbed650024ebdbc97eaa5711154a3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:14.822934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:14.941580 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2264/4544] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:14 2022] POST /identity/v3/users => generated 284 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:14.947044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:14.983061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1761e-d78b-4dd8-83a5-d4ef23d2cb63 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:15.012248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:15.016261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.019064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.019448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.023746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:15.029486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:15.067958 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2265/4545] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:13:15.072373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:15.076861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ddbed650024ebdbc97eaa5711154a3', 'request_id': 'req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:15.090863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345ea6-3940-4875-8dc1-9b18530887a4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:15.104252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ddbed650024ebdbc97eaa5711154a3', 'request_id': 'req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:15.133463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ddbed650024ebdbc97eaa5711154a3', 'request_id': 'req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:15.205537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:15.238920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:15.240244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.243894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.244451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.252806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] The token cache is being invalidate because project 06ddbed650024ebdbc97eaa5711154a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:15.253168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:15.254417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-906fb205-c2e9-4f8f-b8b9-9c61ef2b2a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:15.257753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2281/4546] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:14 2022] DELETE /identity/v3/projects/06ddbed650024ebdbc97eaa5711154a3 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:15.259518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:15.263242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9520-1b3a-4732-9282-e0402cb922dd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.263515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9520-1b3a-4732-9282-e0402cb922dd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.263803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9520-1b3a-4732-9282-e0402cb922dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.266994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:15.309497 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2266/4547] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:13:15.316929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e5cc9520-1b3a-4732-9282-e0402cb922dd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:15.318370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:15.319440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e5cc9520-1b3a-4732-9282-e0402cb922dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:15.328309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:15.356438 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2282/4548] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:15.364373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.364663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.364956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.391751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb44516-dcc3-4cc4-9671-68dcc5b3cdbe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:15.407341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:15.408782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:15.414904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c096d-0e81-4dcf-bf72-76dc3a02a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:15.416461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c096d-0e81-4dcf-bf72-76dc3a02a1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.426687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c096d-0e81-4dcf-bf72-76dc3a02a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.427340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c096d-0e81-4dcf-bf72-76dc3a02a1f7 admin admin] PATH_INFO: `/v3/projects/183f9adb11894af2875dd1700eefbffc/users/27ae2c7ee58748ef9162b4b5e3c6bbcd/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.429122 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2283/4549] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:15.435313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:15.450736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa05f6-1829-4a67-9c3b-d37c3154c910 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:15.469144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:15.472325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.472325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.472325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.472325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:15.472325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:15.478832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:15.510576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c096d-0e81-4dcf-bf72-76dc3a02a1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183f9adb11894af2875dd1700eefbffc, user_id=27ae2c7ee58748ef9162b4b5e3c6bbcd, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:15.510666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2284/4550] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:15.513101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:15.527604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c096d-0e81-4dcf-bf72-76dc3a02a1f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:15.539199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba427-7b69-4524-9f8d-2167271c4cb0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:15.570662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:15.571569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.571858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.572248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.573608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:15.578597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:15.784180 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2267/4551] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:15 2022] PUT /identity/v3/projects/183f9adb11894af2875dd1700eefbffc/users/27ae2c7ee58748ef9162b4b5e3c6bbcd/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:15.803425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:15.803893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:15.804398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:15.808328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2285/4552] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:15 2022] POST /identity/v3/projects => generated 369 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:15.813212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:15.890902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] MFA Rules not processed for user `27ae2c7ee58748ef9162b4b5e3c6bbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:15.892353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:15.992955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165e84-6bf8-49f5-aeaf-a442ba54cd41 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:16.019178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:16.020558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:16.027780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:16.030438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:16.031903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:16.041487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:16.123886 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2268/4553] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:16.144966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:16.147971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:16.176727 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2286/4554] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:15 2022] POST /identity/v3/users => generated 285 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:16.187442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:16.225483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577aef-e606-4133-9d11-e77101f42688 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:16.284014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:16.284014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:16.284014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:16.284014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:16.284687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:16.284687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:16.284687 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2287/4555] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:16.286073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:16.311989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383194-7953-4b49-acfd-69fad28062cb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:16.320017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf3ad3-8ab1-4105-a3da-f8eb0384240f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:16.331592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:16.332447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:16.332761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:16.333065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:16.333783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:16.337434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:16.346348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24070c7d-68f1-4d75-ab71-507894d4e0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:16.352030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24070c7d-68f1-4d75-ab71-507894d4e0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:16.352030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24070c7d-68f1-4d75-ab71-507894d4e0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:16.352030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24070c7d-68f1-4d75-ab71-507894d4e0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:16.369739 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2288/4556] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:13:16.374279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24070c7d-68f1-4d75-ab71-507894d4e0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:16.376776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:16.382633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24070c7d-68f1-4d75-ab71-507894d4e0f2 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:16.408422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5cbc-8ec3-4c4f-bf12-f093d56429b2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:16.417283 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2269/4557] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:16.421128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:16.422010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:16.423148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:16.423148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] PATH_INFO: `/v3/projects/a330f6b0cb9d40c18652feb4ed38b92f/users/79eda5c748a149b1a40067b78e811762/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:16.456306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a330f6b0cb9d40c18652feb4ed38b92f, user_id=79eda5c748a149b1a40067b78e811762, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:16.462185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:16.615245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2289/4558] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:16 2022] PUT /identity/v3/projects/a330f6b0cb9d40c18652feb4ed38b92f/users/79eda5c748a149b1a40067b78e811762/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:16.633183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:16.633183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:16.633472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:16.749504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] MFA Rules not processed for user `79eda5c748a149b1a40067b78e811762`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:16.751023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:17.008330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2270/4559] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:17.011057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:17.190423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531f74-0d79-4664-8a28-3ef4f6c6816a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:17.209671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:17.210953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:17.210953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:17.211236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:17.211741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:17.215889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:17.444507 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2290/4560] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:17 2022] POST /identity/v3/projects => generated 367 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:17.452856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:17.467496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f28c4e-4a2f-409f-83bd-107d885db534 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:17.561481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:17.563512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:17.563904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:17.564381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:17.565057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:17.567587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:17.662903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:17.748227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:17.749094 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2271/4561] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:17 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:17.784368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb120a-eb66-4096-ae47-a66b8c596658 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:17.809975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:17.809975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:17.809975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:17.809975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:17.810409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:17.810409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:17.822902 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2291/4562] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:17.825888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:17.841309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29fad5-b0b1-4169-bbaa-9eb5157d1eb3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:17.851815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:17.861489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:17.861489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:17.861489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] PATH_INFO: `/v3/projects/ce28922ec8484620a4f7869868942c9c/users/9f7964724ab1470aacd3196e1e85b652/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:17.873953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce28922ec8484620a4f7869868942c9c, user_id=9f7964724ab1470aacd3196e1e85b652, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:17.876768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:17.995735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:18.005131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:18.006053 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2272/4563] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:17 2022] PUT /identity/v3/projects/ce28922ec8484620a4f7869868942c9c/users/9f7964724ab1470aacd3196e1e85b652/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:18.008426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:18.109308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57a35-303a-4122-8300-f8742d0e6b02 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:18.125535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:18.125876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:18.125969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:18.126859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:18.127619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:18.129585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:18.144820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2273/4564] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:18.144820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:18.146589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:18.166297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d937c2-5238-47dd-bec0-75429b229fb9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:18.174363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:18.175640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:18.176115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:18.176674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] PATH_INFO: `/v3/projects/66aacf11fed743cc923e6bb613ec14b2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:18.178626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66aacf11fed743cc923e6bb613ec14b2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:18.181393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:18.185647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d72ac-1813-4ac6-9d56-833fdc885cc6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:18.300922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:18.302136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:18.302674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:18.303410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:18.308521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:18.353888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:18.356227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:18.407972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66aacf11fed743cc923e6bb613ec14b2', 'request_id': 'req-1ed8ccd8-049f-4329-9517-65db4b8a91d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:18.439006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66aacf11fed743cc923e6bb613ec14b2', 'request_id': 'req-1ed8ccd8-049f-4329-9517-65db4b8a91d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:18.439499 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2292/4565] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:13:18.455477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66aacf11fed743cc923e6bb613ec14b2', 'request_id': 'req-1ed8ccd8-049f-4329-9517-65db4b8a91d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:18.458988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:18.529840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae85fa-e68a-40fe-9b07-d341948a6ad0 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:18.670738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc9024-d73b-4a70-bac6-8da376bef764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:18.671809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9024-d73b-4a70-bac6-8da376bef764 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:18.672550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9024-d73b-4a70-bac6-8da376bef764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:18.673044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9024-d73b-4a70-bac6-8da376bef764 admin admin] PATH_INFO: `/v3/projects/ce28922ec8484620a4f7869868942c9c/users/9f7964724ab1470aacd3196e1e85b652/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:18.675954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc9024-d73b-4a70-bac6-8da376bef764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce28922ec8484620a4f7869868942c9c, user_id=9f7964724ab1470aacd3196e1e85b652, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:18.679291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc9024-d73b-4a70-bac6-8da376bef764 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:18.706909 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2293/4566] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:18 2022] PUT /identity/v3/projects/ce28922ec8484620a4f7869868942c9c/users/9f7964724ab1470aacd3196e1e85b652/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:18.720016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:18.721494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:18.722197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:18.737460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] The token cache is being invalidate because project 66aacf11fed743cc923e6bb613ec14b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:18.738027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:18.749020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ed8ccd8-049f-4329-9517-65db4b8a91d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:18.749020 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2274/4567] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:18 2022] DELETE /identity/v3/projects/66aacf11fed743cc923e6bb613ec14b2 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:18.757259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a4a0c-1f71-482d-ae42-26738c20ffeb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:18.757903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a4a0c-1f71-482d-ae42-26738c20ffeb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:18.758320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a4a0c-1f71-482d-ae42-26738c20ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:18.823136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-768a4a0c-1f71-482d-ae42-26738c20ffeb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:18.824674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-768a4a0c-1f71-482d-ae42-26738c20ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:18.858059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] MFA Rules not processed for user `9f7964724ab1470aacd3196e1e85b652`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:18.858059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:19.091953 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2275/4568] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:19.098744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.099057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.101640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.142230 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2294/4569] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:19.154846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.159533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:19.159669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:19.163023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:19.204498 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2276/4570] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:19.207460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.237288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc814b4-675e-4318-9852-b45c62e73c3f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.249245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:19.249873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.251768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.252279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.255132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:19.255591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:19.259790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:19.303207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2277/4571] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:19.310413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.332465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88d7a7-9948-4914-9b7d-0bc3b6599157 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.334471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b367cfa-f29f-4331-a023-dff24b7f726b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.340938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:19.342974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.343412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.345024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.348993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:19.349665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.350082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.350359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.351018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:19.355979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:19.368188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:19.369973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:19.397273 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2295/4572] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:19.514958 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2278/4573] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:19 2022] POST /identity/v3/projects => generated 401 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:19.519411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.538270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169bbba-3b99-4b61-a524-1cca521822b4 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.584945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.681883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:19.682679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.683114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.683669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.684509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:19.687347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:19.790506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80fd0-d208-4273-a51b-98e943dd17ed admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.808732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:19.809444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.809727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.810027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.812128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2296/4574] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:19 2022] POST /identity/v3/users => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:19.816257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.818191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:19.879376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd868-302d-4c9f-8421-abbe60bab12f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.900189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:19.901287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:19.901954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:19.902510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:19.903351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:19.907584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:19.923055 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2297/4575] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:19.930695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:19.986848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e90ad-c173-4e97-adc4-33663de05fde admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:19.993838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:19.996876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:20.006382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07761e-3ff6-44ff-b8c9-72a7e7f917cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:20.007017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07761e-3ff6-44ff-b8c9-72a7e7f917cd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:20.009977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07761e-3ff6-44ff-b8c9-72a7e7f917cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:20.010297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07761e-3ff6-44ff-b8c9-72a7e7f917cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:20.012982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07761e-3ff6-44ff-b8c9-72a7e7f917cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:20.013143 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2279/4576] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:20.014715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07761e-3ff6-44ff-b8c9-72a7e7f917cd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:20.059537 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2298/4577] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:20.067756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:20.083219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0b61-202b-4928-b9f0-1df13c62efd2 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:20.106148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:20.108250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:20.108615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:20.109142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] PATH_INFO: `/v3/projects/b9ed8457a748455f9c421f87edc47517/users/1da2349e75a34edabaed5ea9966b7f36/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:20.140662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ed8457a748455f9c421f87edc47517, user_id=1da2349e75a34edabaed5ea9966b7f36, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:20.143764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:20.272466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2280/4578] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:20 2022] PUT /identity/v3/projects/b9ed8457a748455f9c421f87edc47517/users/1da2349e75a34edabaed5ea9966b7f36/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:20.286767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:20.287126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:20.287354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:20.347332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] MFA Rules not processed for user `1da2349e75a34edabaed5ea9966b7f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:20.362691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:20.530443 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2299/4579] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:20.535294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:20.670051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd7b2c-2b2a-4475-88b5-cf5cd305b547 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:20.675447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:20.676462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:20.676853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:20.677251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:20.678268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:20.684647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:20.855001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2281/4580] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:20 2022] POST /identity/v3/projects => generated 401 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:20.855516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:20.869372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5b48-162b-49e2-9a11-39360ed61c24 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:20.979289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:20.979289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:20.980851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:20.982333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:20.983273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:20.990393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:21.177404 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2300/4581] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:20 2022] POST /identity/v3/users => generated 307 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:13:21.186673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:21.202654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ece66-a0a8-4094-93ee-5c440a9aa619 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:21.217632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:21.218442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:21.219575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:21.219854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:21.220801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:21.222717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:21.324095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:21.346325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2282/4582] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:21.362864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391dbac-4b1e-4fa6-92fc-45992f4e7687 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:21.376675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:21.379161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:21.379872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:21.380839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] PATH_INFO: `/v3/projects/339e76b3e720446cb062573a423f3c87/users/afb18298c1b247a99c74eab912145e58/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:21.419866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339e76b3e720446cb062573a423f3c87, user_id=afb18298c1b247a99c74eab912145e58, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:21.433316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:21.693029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2301/4583] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:21 2022] PUT /identity/v3/projects/339e76b3e720446cb062573a423f3c87/users/afb18298c1b247a99c74eab912145e58/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:21.698183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:21.716933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2859dc0-6c5a-422a-aad9-985fdfcad5d5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:21.832382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c66f9-19d7-45cc-b0c1-76e6aad46e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:21.833024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c66f9-19d7-45cc-b0c1-76e6aad46e05 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:21.833299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c66f9-19d7-45cc-b0c1-76e6aad46e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:21.833575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c66f9-19d7-45cc-b0c1-76e6aad46e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:21.834265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c66f9-19d7-45cc-b0c1-76e6aad46e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:21.836088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c66f9-19d7-45cc-b0c1-76e6aad46e05 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:21.855960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:21.866129 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2283/4584] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:21.868048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896dfc0-e637-47af-952f-cfa9e351cd64 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:21.873183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:21.873906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:21.874200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:21.874579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] PATH_INFO: `/v3/projects/339e76b3e720446cb062573a423f3c87/users/afb18298c1b247a99c74eab912145e58/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:21.876748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339e76b3e720446cb062573a423f3c87, user_id=afb18298c1b247a99c74eab912145e58, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:21.882115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:21.915001 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2302/4585] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:21 2022] PUT /identity/v3/projects/339e76b3e720446cb062573a423f3c87/users/afb18298c1b247a99c74eab912145e58/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:21.931881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:21.931881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:21.931881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:21.969836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] MFA Rules not processed for user `afb18298c1b247a99c74eab912145e58`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:21.971396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:22.148056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:22.211444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:22.220117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2284/4586] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:22.226240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b17e-6128-4207-b911-63743603a9f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:22.232570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb18298c1b247a99c74eab912145e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339e76b3e720446cb062573a423f3c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:22.233700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:22.234221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:22.234680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:22.235752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:22.238110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:22.342819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2303/4587] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:13:22 2022] POST /identity/v3/roles => generated 240 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:22.342904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:22.372047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0a34b-f141-43fd-85f2-bb9576b4399f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:22.384097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c9e73-5f2c-4f7b-8862-c2d1f5ed2974 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb18298c1b247a99c74eab912145e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339e76b3e720446cb062573a423f3c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:22.384977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9e73-5f2c-4f7b-8862-c2d1f5ed2974 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:22.385268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9e73-5f2c-4f7b-8862-c2d1f5ed2974 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:22.387112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9e73-5f2c-4f7b-8862-c2d1f5ed2974 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] PATH_INFO: `/v3/projects/b9ed8457a748455f9c421f87edc47517/users/1da2349e75a34edabaed5ea9966b7f36/roles/0e3d5e96e20c40aaa8b2a027f6209dae` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:22.393805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c9e73-5f2c-4f7b-8862-c2d1f5ed2974 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9ed8457a748455f9c421f87edc47517, user_id=1da2349e75a34edabaed5ea9966b7f36, role_id=0e3d5e96e20c40aaa8b2a027f6209dae)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:22.409921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c9e73-5f2c-4f7b-8862-c2d1f5ed2974 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:22.541526 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2285/4588] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:22 2022] PUT /identity/v3/projects/b9ed8457a748455f9c421f87edc47517/users/1da2349e75a34edabaed5ea9966b7f36/roles/0e3d5e96e20c40aaa8b2a027f6209dae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:22.548267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:22.718033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15dc8f-2b3f-4c67-928c-c9be5510b905 tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:22.823702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da2349e75a34edabaed5ea9966b7f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ed8457a748455f9c421f87edc47517', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1838896699', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:22.823702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:22.823702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:22.824403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] PATH_INFO: `/v3/users/1da2349e75a34edabaed5ea9966b7f36/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:22.824403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] RBAC: Authorizing `identity:create_application_credential(user_id=1da2349e75a34edabaed5ea9966b7f36)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:22.824403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:23.080030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:23.082281 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2304/4589] 10.222.0.78 () {60 vars in 1315 bytes} [Sun Aug 28 20:13:22 2022] POST /identity/v3/users/1da2349e75a34edabaed5ea9966b7f36/application_credentials => generated 659 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:23.086593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:23.086877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:23.192284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] MFA Rules not processed for user `1da2349e75a34edabaed5ea9966b7f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:23.200326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:23.282779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:23.516477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:23.526214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2286/4590] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:23 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 20:13:23.534481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b450c12-6aae-4b8a-9d1b-3601b866c450 tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:23.543572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da2349e75a34edabaed5ea9966b7f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ed8457a748455f9c421f87edc47517', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1838896699', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:23.544621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:23.545094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:23.545525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] PATH_INFO: `/v3/users/1da2349e75a34edabaed5ea9966b7f36/application_credentials/b63096e5a7084dc2b7a0d990d2183337` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:23.547083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1da2349e75a34edabaed5ea9966b7f36, application_credential_id=b63096e5a7084dc2b7a0d990d2183337)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:23.556489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:23.668891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2305/4591] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:13:23 2022] DELETE /identity/v3/users/1da2349e75a34edabaed5ea9966b7f36/application_credentials/b63096e5a7084dc2b7a0d990d2183337 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:23.669681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:23.829666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f152c-2250-4248-bc37-f70dfeefa470 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:23.855425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb18298c1b247a99c74eab912145e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339e76b3e720446cb062573a423f3c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:23.856591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:23.857072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:23.857521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] PATH_INFO: `/v3/roles/0e3d5e96e20c40aaa8b2a027f6209dae` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:23.862388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0e3d5e96e20c40aaa8b2a027f6209dae)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:23.864198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:24.241336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] Invalidating the token cache because role 0e3d5e96e20c40aaa8b2a027f6209dae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:24.247919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:24.247919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-571ac3b5-414d-4d54-b2e4-58f4151aebba tempest-ApplicationCredentialsV3AdminTest-659715024 tempest-ApplicationCredentialsV3AdminTest-659715024-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:24.247919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2287/4592] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:23 2022] DELETE /identity/v3/roles/0e3d5e96e20c40aaa8b2a027f6209dae => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:24.253469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:24.256271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:24.377279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f333-1044-4be6-b785-f2f8a23ca90e tempest-ApplicationCredentialsV3AdminTest-835903218 tempest-ApplicationCredentialsV3AdminTest-835903218-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:24.532502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:24.533344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:24.533517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:24.533932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] PATH_INFO: `/v3/users/1da2349e75a34edabaed5ea9966b7f36` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:24.535336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da2349e75a34edabaed5ea9966b7f36)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:24.537389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:24.958630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da2349e75a34edabaed5ea9966b7f36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:24.959635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da2349e75a34edabaed5ea9966b7f36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:25.029229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da2349e75a34edabaed5ea9966b7f36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:25.045519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da2349e75a34edabaed5ea9966b7f36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:25.046879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da2349e75a34edabaed5ea9966b7f36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:25.097521 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2306/4593] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:24 2022] DELETE /identity/v3/users/1da2349e75a34edabaed5ea9966b7f36 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:25.102712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:25.103235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:25.103340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:25.144591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:25.147424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:25.271178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2288/4594] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:25.271367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:25.271367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:25.356162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244a5b-251e-47a5-b34b-4baa7c3cdfe1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:25.376078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:25.376662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:25.376662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:25.376816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:25.410760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:25.412670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:25.449252 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2307/4595] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:25.899691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:27.204352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:28.025182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:28.028176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:28.097229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f244-caec-482f-a995-9599e16f18e1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:28.114412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:28.117268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:28.118142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:28.118924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] PATH_INFO: `/v3/projects/b9ed8457a748455f9c421f87edc47517` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:28.121459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ed8457a748455f9c421f87edc47517)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:28.124811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:28.431164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ed8457a748455f9c421f87edc47517', 'request_id': 'req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:28.462822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ed8457a748455f9c421f87edc47517', 'request_id': 'req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:28.520015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ed8457a748455f9c421f87edc47517', 'request_id': 'req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:28.766852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] The token cache is being invalidate because project b9ed8457a748455f9c421f87edc47517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:28.767762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:28.772608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:28.775207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2289/4596] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:28 2022] DELETE /identity/v3/projects/b9ed8457a748455f9c421f87edc47517 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:28.782719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:28.854351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1ec1-1ac3-4f00-8cc0-3b52c0a7e9cd service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:29.011086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:29.017520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:29.018153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:29.018698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] PATH_INFO: `/v3/users/afb18298c1b247a99c74eab912145e58` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:29.023944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb18298c1b247a99c74eab912145e58)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:29.032901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:29.472847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb18298c1b247a99c74eab912145e58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:29.474986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb18298c1b247a99c74eab912145e58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:29.597953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb18298c1b247a99c74eab912145e58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:29.667053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:29.669598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:29.689378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb18298c1b247a99c74eab912145e58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:29.699077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bd9a6c13-fdaa-4dcf-a728-1020f5c9ea09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb18298c1b247a99c74eab912145e58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:29.723193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:29.760602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647d8b1-8e8e-4a1f-a154-1b0e033c746b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:29.797774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:29.801099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:29.804166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:29.805015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] PATH_INFO: `/v3/users/79eda5c748a149b1a40067b78e811762` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:29.811838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79eda5c748a149b1a40067b78e811762)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:29.819414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:29.827079 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2308/4597] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:28 2022] DELETE /identity/v3/users/afb18298c1b247a99c74eab912145e58 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:29.835157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:30.171650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79eda5c748a149b1a40067b78e811762'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:30.187264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79eda5c748a149b1a40067b78e811762'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:30.196668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79eda5c748a149b1a40067b78e811762'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:30.198086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79eda5c748a149b1a40067b78e811762'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:30.202387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79eda5c748a149b1a40067b78e811762'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:30.319897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2290/4598] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:29 2022] DELETE /identity/v3/users/79eda5c748a149b1a40067b78e811762 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:30.322346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:30.322346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:30.322346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:30.439900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:30.445569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:30.685702 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2309/4599] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:30.722679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:30.731539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:30.935201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7159-70c7-4474-a880-971e87353c4f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:30.941176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:30.942163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:30.942702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:30.943191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:30.999605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:31.002850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:31.016325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2291/4600] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:31.735337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:31.862605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:32.414486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:32.415005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:32.439108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:32.441940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:32.469337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec7472-7699-486d-a412-06b8bd42b525 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:32.503180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46eac-0529-4d8a-9910-4768e5cf5472 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:32.510732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:32.511398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:32.511681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:32.511964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] PATH_INFO: `/v3/projects/a330f6b0cb9d40c18652feb4ed38b92f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:32.517669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a330f6b0cb9d40c18652feb4ed38b92f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:32.525089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:32.531848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:32.532187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:32.532496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:32.534395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] PATH_INFO: `/v3/projects/339e76b3e720446cb062573a423f3c87` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:32.537569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=339e76b3e720446cb062573a423f3c87)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:32.559313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:33.005895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339e76b3e720446cb062573a423f3c87', 'request_id': 'req-7cba2312-8c08-43a7-a74f-3bf43441a03d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.017228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339e76b3e720446cb062573a423f3c87', 'request_id': 'req-7cba2312-8c08-43a7-a74f-3bf43441a03d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.032867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339e76b3e720446cb062573a423f3c87', 'request_id': 'req-7cba2312-8c08-43a7-a74f-3bf43441a03d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.033643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a330f6b0cb9d40c18652feb4ed38b92f', 'request_id': 'req-491223ea-c39c-4c00-9192-03ee95ce93ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.050191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a330f6b0cb9d40c18652feb4ed38b92f', 'request_id': 'req-491223ea-c39c-4c00-9192-03ee95ce93ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.080547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a330f6b0cb9d40c18652feb4ed38b92f', 'request_id': 'req-491223ea-c39c-4c00-9192-03ee95ce93ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.176768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] The token cache is being invalidate because project 339e76b3e720446cb062573a423f3c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:33.177262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.178673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7cba2312-8c08-43a7-a74f-3bf43441a03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.183108 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2292/4601] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:32 2022] DELETE /identity/v3/projects/339e76b3e720446cb062573a423f3c87 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:33.190047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896489-503a-4082-bcbe-4a304aadbc25 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.190921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896489-503a-4082-bcbe-4a304aadbc25 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.191662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896489-503a-4082-bcbe-4a304aadbc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.192786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:33.228268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e9896489-503a-4082-bcbe-4a304aadbc25 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:33.231004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e9896489-503a-4082-bcbe-4a304aadbc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:33.270805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] The token cache is being invalidate because project a330f6b0cb9d40c18652feb4ed38b92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:33.271102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.278390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.280118 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2310/4602] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:32 2022] DELETE /identity/v3/projects/a330f6b0cb9d40c18652feb4ed38b92f => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:33.285242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:33.286781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:33.407562 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2293/4603] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:33.421530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.421530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.421530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.460706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491223ea-c39c-4c00-9192-03ee95ce93ee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:33.472503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:33.473527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.490072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.490313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:33.490391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] PATH_INFO: `/v3/users/9f7964724ab1470aacd3196e1e85b652` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.490461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:33.490549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7964724ab1470aacd3196e1e85b652)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:33.490549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:33.499972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2294/4604] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:33.501212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:33.513689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cc9bf-e407-4c98-9dc2-2a75144d4dda None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:33.524045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:33.525047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.526054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.526552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.527712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:33.528223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:33.532549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:33.562831 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2295/4605] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:33.566394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:33.583026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee702-e36b-4eae-9632-aa19ac3ed368 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:33.593396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:33.593396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:33.595908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.596469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.596994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.597878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:33.600254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:33.823196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7964724ab1470aacd3196e1e85b652'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.824290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7964724ab1470aacd3196e1e85b652'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.835778 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2296/4606] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:33 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:33.839367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:33.971813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7964724ab1470aacd3196e1e85b652'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:33.989040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7964724ab1470aacd3196e1e85b652'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:34.002566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7964724ab1470aacd3196e1e85b652'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:34.048826 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2311/4607] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:33 2022] DELETE /identity/v3/users/9f7964724ab1470aacd3196e1e85b652 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:34.111648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876b1b-8778-46ba-9133-fe6a6c5ec4c9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:34.304289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:34.305205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:34.305474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:34.308483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:34.308483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:34.310159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:34.489658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:34.493450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:34.496231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:34.507072 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2297/4608] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:33 2022] POST /identity/v3/users => generated 286 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:34.560213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad6d5-3121-4561-ac69-910ec9ad2aa3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:34.577491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:34.578158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:34.578439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:34.578711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:34.579391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:34.581134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:34.619839 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2312/4609] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:34.622579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:34.639397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e13f7-e6ad-4471-bcff-f09a5b10faa5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:34.656663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf818d4b-6090-4690-84a3-e874f30d151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:34.659616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818d4b-6090-4690-84a3-e874f30d151e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:34.660200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818d4b-6090-4690-84a3-e874f30d151e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:34.661014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818d4b-6090-4690-84a3-e874f30d151e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:34.665184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf818d4b-6090-4690-84a3-e874f30d151e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:34.668007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf818d4b-6090-4690-84a3-e874f30d151e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:34.725267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:34.741538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2298/4610] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:34.744533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0fc22-70fd-490f-8cee-84c758ee285e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:34.756837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:34.758830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:34.759340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:34.760475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] PATH_INFO: `/v3/projects/ce53923e7e724a21bc6a43a94b9f2b2d/users/f1e0a6938695444e80b222699509513c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:34.784371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce53923e7e724a21bc6a43a94b9f2b2d, user_id=f1e0a6938695444e80b222699509513c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:34.788980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:34.816454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:34.887154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2313/4611] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:34 2022] PUT /identity/v3/projects/ce53923e7e724a21bc6a43a94b9f2b2d/users/f1e0a6938695444e80b222699509513c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:34.902483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:34.903054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:34.903526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:34.944131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] MFA Rules not processed for user `f1e0a6938695444e80b222699509513c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:34.945804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:35.115133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:35.116477 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2299/4612] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:35.298965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b504a77-52e3-49ac-bdbf-f88aaec4dc44 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:35.321385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:35.322057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:35.322365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:35.323147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:35.323805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:35.327069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:35.525114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:35.617491 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2314/4613] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:35 2022] POST /identity/v3/projects => generated 371 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:35.618108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:35.649832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90af2ce-11b1-40c6-91c0-226023e6d063 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:35.828312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:35.830555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:35.831562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:35.832014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:35.832445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:35.833650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:35.838243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:35.963515 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2300/4614] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:35 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:35.967565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:35.984039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7600a8-368f-43e8-917d-6aa7104e34fe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:35.996206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:36.002184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:36.002184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:36.002184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:36.002184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:36.002184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:36.044716 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2315/4615] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:36.049569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:36.063658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f189-e38d-44e4-992a-34742fa5cdf1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:36.074729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:36.075421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:36.077993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:36.078320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] PATH_INFO: `/v3/projects/7c985efdaa6c4e4cb1f22f6b37b1c6b5/users/3c05ccb421924a79bd211c53cdb2fe47/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:36.117237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c985efdaa6c4e4cb1f22f6b37b1c6b5, user_id=3c05ccb421924a79bd211c53cdb2fe47, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:36.123882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:36.216878 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2301/4616] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:36 2022] PUT /identity/v3/projects/7c985efdaa6c4e4cb1f22f6b37b1c6b5/users/3c05ccb421924a79bd211c53cdb2fe47/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:36.220702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:36.236643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d39a8-f80e-434e-829c-a5fff66545ca admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:36.388762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424f120-e645-4604-9f4d-37d771d2165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:36.388762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424f120-e645-4604-9f4d-37d771d2165c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:36.388762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424f120-e645-4604-9f4d-37d771d2165c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:36.388762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424f120-e645-4604-9f4d-37d771d2165c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:36.389186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424f120-e645-4604-9f4d-37d771d2165c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:36.389186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424f120-e645-4604-9f4d-37d771d2165c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:36.417306 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2316/4617] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:36.420176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:36.437668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3661e63-2562-4d56-ad6c-2c0c0c19590a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:36.456861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:36.458030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:36.458315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:36.482522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] PATH_INFO: `/v3/projects/7c985efdaa6c4e4cb1f22f6b37b1c6b5/users/3c05ccb421924a79bd211c53cdb2fe47/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:36.482522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c985efdaa6c4e4cb1f22f6b37b1c6b5, user_id=3c05ccb421924a79bd211c53cdb2fe47, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:36.482522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:36.533903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2302/4618] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:36 2022] PUT /identity/v3/projects/7c985efdaa6c4e4cb1f22f6b37b1c6b5/users/3c05ccb421924a79bd211c53cdb2fe47/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:36.534224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:36.534224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:36.534224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:36.552903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:36.585465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] MFA Rules not processed for user `3c05ccb421924a79bd211c53cdb2fe47`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:36.587183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:36.724562 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2317/4619] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:36.729708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:36.746997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42466fe5-9e6f-4d19-87fb-b78ea8fbe54f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:36.763023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:36.763678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:36.763959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:36.764235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:36.764905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:36.770112 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:36.770112 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:36.770112 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:36.773057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:37.027657 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2303/4620] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:36 2022] POST /identity/v3/services => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:37.029971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:37.054734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997b06-3651-4de6-841e-dae7c4a73d69 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:37.096355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:37.098021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:37.098559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:37.099102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:37.100100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:37.101731 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:37.101731 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:37.101731 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:37.103929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:37.193744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:37.315230 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1629964839. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:37.315230 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:37.315230 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:37.486950 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2318/4621] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:13:37 2022] POST /identity/v3/endpoints => generated 361 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:37.491552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:37.517019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb1f3-3f9e-4a8d-9cb1-948ef4d5ec2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:37.581878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:37.586310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:37.586804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:37.587340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-1629964839` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:37.588946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1629964839)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:37.591426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:37.608817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2304/4622] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:13:37 2022] GET /identity/v3/regions/tempest-region-1629964839 => generated 180 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:37.613683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:37.691509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508d410-3cf8-4046-a1b5-1e35e3f3634a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:37.691509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:37.691509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:37.692537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:37.692537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:37.692537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:37.692537 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:37.692537 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:37.692537 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:37.693304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:37.902713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2319/4623] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:37 2022] POST /identity/v3/services => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:37.906859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:37.927337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5d67-5702-4c5f-9fdf-387ea02d3230 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:37.990257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:37.991111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:37.992700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:37.993164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:37.995477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:37.997958 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:37.997958 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:37.997958 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:38.000115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:38.018974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:38.020767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:38.153028 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-512525095. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:38.153028 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:38.153028 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:38.251067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9619e-5cb1-41b3-9e4e-aae288136a52 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:38.296994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:38.298603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:38.299078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:38.299912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] PATH_INFO: `/v3/projects/ce28922ec8484620a4f7869868942c9c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:38.306061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce28922ec8484620a4f7869868942c9c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:38.309168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:38.362598 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2305/4624] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:13:37 2022] POST /identity/v3/endpoints => generated 361 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:38.366843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:38.441739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda633b-71d0-43c8-96e7-f04f2ce5bba1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:38.465586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:38.466577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:38.467071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:38.467546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-512525095` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:38.468354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-512525095)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:38.469770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:38.479651 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2306/4625] 10.222.0.78 () {58 vars in 1203 bytes} [Sun Aug 28 20:13:38 2022] GET /identity/v3/regions/tempest-region-512525095 => generated 178 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:38.480988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:38.484058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:38.593413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce28922ec8484620a4f7869868942c9c', 'request_id': 'req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:38.609744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce28922ec8484620a4f7869868942c9c', 'request_id': 'req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:38.627392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce28922ec8484620a4f7869868942c9c', 'request_id': 'req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:38.699741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49469e-df9e-47e7-8049-80c053fd28aa tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:38.789046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] The token cache is being invalidate because project ce28922ec8484620a4f7869868942c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:38.789472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:38.791750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:38.793543 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2320/4626] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:38 2022] DELETE /identity/v3/projects/ce28922ec8484620a4f7869868942c9c => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:38.795165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:38.804391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:38.880310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:38.881098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:38.881482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:38.881878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:38.885391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:38.928174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:38.937548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:38.970240 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2307/4627] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:38 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:38.976789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:38.977829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:39.014862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993dbc5-26ef-4df1-9bc1-fc4ed77f02e8 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:39.033842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:39.035873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.038946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.040483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.056582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3be00e-2db4-49a9-a597-4fa1cbf0cdeb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:39.068449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:39.076470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63296de-ccd6-4457-8d4e-7c01b1e71607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:39.077207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:39.078077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63296de-ccd6-4457-8d4e-7c01b1e71607 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.084838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63296de-ccd6-4457-8d4e-7c01b1e71607 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.086740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63296de-ccd6-4457-8d4e-7c01b1e71607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.095122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:39.116409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2308/4628] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:38 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:39.120734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:39.121488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63296de-ccd6-4457-8d4e-7c01b1e71607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:39.125484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:39.126125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63296de-ccd6-4457-8d4e-7c01b1e71607 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:39.159372 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2321/4629] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:38 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:39.164713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75dcd6-40c0-4fb4-aa7e-89b83cbad277 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.169953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75dcd6-40c0-4fb4-aa7e-89b83cbad277 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.169953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75dcd6-40c0-4fb4-aa7e-89b83cbad277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.241311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-df75dcd6-40c0-4fb4-aa7e-89b83cbad277 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:39.242974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df75dcd6-40c0-4fb4-aa7e-89b83cbad277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:39.357232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504d1c-13e0-4e72-a905-e14424342151 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:39.374131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:39.375278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.375911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.376535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.378158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:39.382336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:39.434924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:39.462719 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2322/4630] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:39.472110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.472503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.472907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.496049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:39.497265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:39.498656 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1699062799. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:39.498656 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:39.498656 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:39.515836 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2323/4631] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:39.520452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:39.536865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b760-211b-491b-bea8-90a57e9afe2e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:39.593214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:39.593214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.593214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.593214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.594060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:39.594060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:39.594060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:39.627433 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2324/4632] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:39.631442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:39.658609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e91b69-6c10-4802-87f0-c366d3e91912 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:39.683961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:39.684857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:39.685813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:39.686671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:39.689092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:39.692671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:39.804760 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2309/4633] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:13:39 2022] POST /identity/v3/endpoints => generated 359 bytes in 685 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:39.806856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:39.879172 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2325/4634] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:39 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:13:39.880722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:39.889191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae7c3c-cb34-4977-8841-db455af0354b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.070838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.072021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.072989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.073375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-1699062799` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.074178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1699062799)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.074934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10834c-aecb-4a51-bbcd-44ed5d528378 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.076438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.081887 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2310/4635] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:13:39 2022] GET /identity/v3/regions/tempest-region-1699062799 => generated 180 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:13:40.093065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.115397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c74e-cfd0-4654-a3f6-d5db4a18d7f2 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.131758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.132211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.132857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.133303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.134180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.135894 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:40.135894 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:40.135894 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:40.138962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.152863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.153725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.154181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.154610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.155401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.168555 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2311/4636] 10.222.0.78 () {58 vars in 1134 bytes} [Sun Aug 28 20:13:40 2022] GET /identity/v3/endpoints => generated 4395 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:40.170072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.172646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.196730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9236d-b02b-4c20-91a5-61f6303d3e2b tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.214891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.215649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.216209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.216371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/9b1b799c8d854441a20701bb5d1282e4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.226589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=9b1b799c8d854441a20701bb5d1282e4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.231799 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:40.231799 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:40.231799 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:40.232869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.237482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2312/4637] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:40 2022] GET /identity/v3/endpoints/9b1b799c8d854441a20701bb5d1282e4 => generated 359 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:40.241453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.261263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac715a34-f06b-4009-9212-3334fa27e572 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.283839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.285750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.285750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.285750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/9b1b799c8d854441a20701bb5d1282e4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.287101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9b1b799c8d854441a20701bb5d1282e4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.288552 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:40.288552 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:40.288552 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:40.289914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.301688 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2326/4638] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:39 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:40.305832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.382924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6e129-cc24-4646-a9c7-3082cfe8141f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.386770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9b1b799c8d854441a20701bb5d1282e4', 'request_id': 'req-6b8382f5-d092-4c5e-bb2a-c3d09422485a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:40.401117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.401883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.402721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.402721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.403130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.404953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.408729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2313/4639] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:13:40 2022] DELETE /identity/v3/endpoints/9b1b799c8d854441a20701bb5d1282e4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:40.416523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.457385 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2327/4640] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:40.463698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.520675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8382f5-d092-4c5e-bb2a-c3d09422485a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.528982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d61962-e0fb-4f07-b34c-eec8a517b2ab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.540978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.541614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.541927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.542208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.546374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.557545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.613509 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2314/4641] 10.222.0.78 () {58 vars in 1134 bytes} [Sun Aug 28 20:13:40 2022] GET /identity/v3/endpoints => generated 4049 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:40.622760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.622760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.622760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.623673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.623760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.623760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.623760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.639416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b015b3-b4ca-477e-baca-3d23029b0a3e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.651747 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2328/4642] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:40.653631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.655480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.658624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.659291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.660245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/9b1b799c8d854441a20701bb5d1282e4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.683850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:13:40.701823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171a889-d993-4f49-907e-3989d42ca54a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Could not find endpoint: 9b1b799c8d854441a20701bb5d1282e4.: keystone.exception.EndpointNotFound: Could not find endpoint: 9b1b799c8d854441a20701bb5d1282e4. Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:13:40.723588 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 9b1b799c8d854441a20701bb5d1282e4. Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:13:40.725788 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:13:40.735679 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 9b1b799c8d854441a20701bb5d1282e4. Aug 28 20:13:40.743502 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:13:40.745019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ef958-c7e2-445a-aecf-6dc0ddbb7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.745141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2315/4643] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:13:40 2022] DELETE /identity/v3/endpoints/9b1b799c8d854441a20701bb5d1282e4 => generated 114 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:13:40.745226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef958-c7e2-445a-aecf-6dc0ddbb7952 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.745226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef958-c7e2-445a-aecf-6dc0ddbb7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.745226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef958-c7e2-445a-aecf-6dc0ddbb7952 admin admin] PATH_INFO: `/v3/projects/54dde84f0a7d48e4afda6718e51659d5/users/5d97e2d5250e433aac0568bd508cc461/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.745458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:40.770597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d38b4-9d63-4d1b-92bd-a14abde3edf9 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:40.795502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:40.801156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:40.806164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef958-c7e2-445a-aecf-6dc0ddbb7952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dde84f0a7d48e4afda6718e51659d5, user_id=5d97e2d5250e433aac0568bd508cc461, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.806317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:40.806317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-1699062799` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:40.807541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1699062799)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:40.809051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef958-c7e2-445a-aecf-6dc0ddbb7952 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.811260 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:40.811260 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:40.811260 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:40.814252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:40.839504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:41.028745 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2329/4644] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:40 2022] PUT /identity/v3/projects/54dde84f0a7d48e4afda6718e51659d5/users/5d97e2d5250e433aac0568bd508cc461/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:41.040321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.040699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.041642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.047335 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2316/4645] 10.222.0.78 () {58 vars in 1209 bytes} [Sun Aug 28 20:13:40 2022] DELETE /identity/v3/regions/tempest-region-1699062799 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:41.049795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.107710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2d05d-5d9e-4cfd-a4ff-242d386fa0ec tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.128457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] MFA Rules not processed for user `5d97e2d5250e433aac0568bd508cc461`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:41.129957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:41.270638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.272845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.273678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.274279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.275737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.277666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.293054 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2317/4646] 10.222.0.78 () {58 vars in 1134 bytes} [Sun Aug 28 20:13:41 2022] GET /identity/v3/endpoints => generated 4049 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:41.298881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.310673 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2330/4647] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:41 2022] POST /identity/v3/auth/tokens => generated 3894 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:41.311743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.326791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69025313-c0e9-4164-9377-c9e79b46888e tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.355492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.356319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.356711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.357084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.357868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Adding query filter params (service_id=bfda48f346fb42ee95a8981e5881b38e) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:41.358294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.360908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.397687 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2318/4648] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:13:41 2022] GET /identity/v3/endpoints?service_id=bfda48f346fb42ee95a8981e5881b38e => generated 503 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:41.402563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.432907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939451af-abdf-4b43-ad14-37c39b8d0399 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.448652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.450050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.450452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.450832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.452378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Adding query filter params (service_id=bb2c851633454dbbb60a90e8655ce3a6) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:41.452378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.456322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.458389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f01f-a194-41e7-9415-480439f7e369 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.468605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.469237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.470156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.470578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.471324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.474800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2319/4649] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:13:41 2022] GET /identity/v3/endpoints?service_id=bb2c851633454dbbb60a90e8655ce3a6 => generated 503 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:41.475293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.476040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.495462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029a834-2394-44a9-820b-69e5382008fb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.499620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:41.515523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.516289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.516701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.517072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.521469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:41.522463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.524694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.549462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2320/4650] 10.222.0.78 () {58 vars in 1167 bytes} [Sun Aug 28 20:13:41 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:41.550656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.566472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e068b-a10e-44d9-a930-5b38799dd426 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.579636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.588312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.588312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.588312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.588312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:41.588312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.591454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.611754 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2321/4651] 10.222.0.78 () {58 vars in 1171 bytes} [Sun Aug 28 20:13:41 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:41.613120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.640002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f11d6-0c78-4db9-a35f-871c05548f79 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.649521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37547dde-9303-4982-b421-1b6fea8b31c1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.650749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547dde-9303-4982-b421-1b6fea8b31c1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.658423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547dde-9303-4982-b421-1b6fea8b31c1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.658796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547dde-9303-4982-b421-1b6fea8b31c1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.659895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37547dde-9303-4982-b421-1b6fea8b31c1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.661532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37547dde-9303-4982-b421-1b6fea8b31c1 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:41.674861 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2331/4652] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:41 2022] POST /identity/v3/projects => generated 387 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:41.686052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:41.830387 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2322/4653] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:41 2022] POST /identity/v3/services => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:41.839729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.840247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.840548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.872224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] MFA Rules not processed for user `3a7700aca8a14e1bae6e45e5d52e439c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:41.874634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:41.902267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ec552-ed1e-452f-8fee-87a2a7b3115e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:41.922093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:41.923772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:41.924218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:41.924660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:41.925502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:41.928254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.036102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2323/4654] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:41 2022] POST /identity/v3/auth/tokens => generated 4018 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:42.036251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2332/4655] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:41 2022] POST /identity/v3/users => generated 294 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:42.038133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.038253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.068151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900941-d549-45f6-9463-d71f9034b1da admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.092529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.093379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.093827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.094259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.095078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.097261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.120735 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2333/4656] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:42.123984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.147029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcebc5-8074-41b7-85c9-085abbf79511 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.175312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.175312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.175312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.175312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.175697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.177476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ba6f-0f5c-4b80-a0e7-cb0985db3620 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.196477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.214779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.216637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.217008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.218195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.219497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.227358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.255287 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2334/4657] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:42.257618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.280780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ccfa-0473-4756-a087-189708a15d72 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.296374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099df1c-6fca-40ba-8cc9-8fbbc0d7be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.304660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099df1c-6fca-40ba-8cc9-8fbbc0d7be98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.305115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099df1c-6fca-40ba-8cc9-8fbbc0d7be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.305481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099df1c-6fca-40ba-8cc9-8fbbc0d7be98 admin admin] PATH_INFO: `/v3/projects/256cfe3950ba4474a4b2ddcbd0cc1926/users/e87a07d570184a4ba51fd1d0ecafde8f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.334873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099df1c-6fca-40ba-8cc9-8fbbc0d7be98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256cfe3950ba4474a4b2ddcbd0cc1926, user_id=e87a07d570184a4ba51fd1d0ecafde8f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.339744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:42.340462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099df1c-6fca-40ba-8cc9-8fbbc0d7be98 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.381704 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-901424318. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:42.381704 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:42.381704 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:42.529737 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2335/4658] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:42 2022] PUT /identity/v3/projects/256cfe3950ba4474a4b2ddcbd0cc1926/users/e87a07d570184a4ba51fd1d0ecafde8f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:42.541538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.545630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.545630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.601330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2324/4659] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:13:42 2022] POST /identity/v3/endpoints => generated 358 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:42.607361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.643248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] MFA Rules not processed for user `e87a07d570184a4ba51fd1d0ecafde8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:42.645372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:42.661235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76ddc9-37cb-46f3-8bf6-aa3c20f2f687 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.767294 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2336/4660] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:42 2022] POST /identity/v3/auth/tokens => generated 4212 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:42.768902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.839971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.842030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.842472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.842916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-901424318` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.843667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-901424318)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.844901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.850389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2325/4661] 10.222.0.78 () {58 vars in 1203 bytes} [Sun Aug 28 20:13:42 2022] GET /identity/v3/regions/tempest-region-901424318 => generated 178 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:42.861788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:42.874256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda9603-4091-4690-9f00-e2272b61056d tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.881798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.883786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.884626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.885060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/15d0dda142da4174a0a5d421d6184d5e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.898581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=15d0dda142da4174a0a5d421d6184d5e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.899641 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:42.899641 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:42.899641 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:42.902967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:42.915609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f2142-b849-4184-810e-7d397f9d3582 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:42.930725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:42.930725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:42.931087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:42.931245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:42.932461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:42.934471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.064508 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1826002910. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:43.064508 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:43.064508 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:43.117409 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2337/4662] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:42 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:43.123841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.178633 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2326/4663] 10.222.0.78 () {60 vars in 1256 bytes} [Sun Aug 28 20:13:42 2022] PATCH /identity/v3/endpoints/15d0dda142da4174a0a5d421d6184d5e => generated 364 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:43.185612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.235491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c16bf-c679-4c36-a8b5-5c35234de4e8 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.247011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df798-bcfc-41d0-a4a1-48d615f48a87 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.289389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.290050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.290330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.290600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.291811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.298246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.354969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.354969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.354969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.355345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-1826002910` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.355345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1826002910)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.355345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.355345 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2327/4664] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:13:43 2022] GET /identity/v3/regions/tempest-region-1826002910 => generated 180 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:43.359573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.372692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ebe7d-8c56-4fe0-bea6-27de2e050bdb tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.379559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.383268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.383268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.383268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/15d0dda142da4174a0a5d421d6184d5e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.392439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=15d0dda142da4174a0a5d421d6184d5e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.395596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.409987 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2338/4665] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:43 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:43.420677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.421212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:43.439876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece178df-4b5a-4edc-bc98-f01e8d2eafbc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.451526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.452181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.452468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.452743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.453938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.457941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.487899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2339/4666] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:43.488910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.499032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '15d0dda142da4174a0a5d421d6184d5e', 'request_id': 'req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:43.520915 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2328/4667] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:13:43 2022] DELETE /identity/v3/endpoints/15d0dda142da4174a0a5d421d6184d5e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:43.526503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.531496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86770b21-73d9-4930-b5d0-479710e7f7ce admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.595795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.596486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.596776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.597049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] PATH_INFO: `/v3/projects/08926c47060d461a85b9e54bd73368ee/users/98b8eddc9f51482bbd6357e8a113fd81/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.612671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d22c1-c4e3-47e1-b9a9-45ca8bdf5271 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.623956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.625006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.626648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.629560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:43.631095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-1826002910` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.632156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1826002910)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.636427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.675531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08926c47060d461a85b9e54bd73368ee, user_id=98b8eddc9f51482bbd6357e8a113fd81, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.678247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:43.785272 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2329/4668] 10.222.0.78 () {58 vars in 1209 bytes} [Sun Aug 28 20:13:43 2022] DELETE /identity/v3/regions/tempest-region-1826002910 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:43.790091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.839909 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2340/4669] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:43 2022] PUT /identity/v3/projects/08926c47060d461a85b9e54bd73368ee/users/98b8eddc9f51482bbd6357e8a113fd81/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:43.841006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:43.849549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f72b1-74b2-4c97-b3e7-024a1d43a066 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:43.963579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:43.965970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:43.966259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:43.966534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-901424318` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:43.967138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-901424318)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:43.975788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.005619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786b70-f132-49eb-a259-07f800cfd626 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:44.067615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:44.068653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.069050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.069458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.070264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:44.082987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.108040 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2341/4670] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:44.112334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:44.124745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449545d-7f9d-403f-a5f1-ee8d88be1871 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:44.132094 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2330/4671] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:13:43 2022] DELETE /identity/v3/regions/tempest-region-901424318 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:44.137074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:44.149707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a421d-c74f-48aa-ae7c-01d1f69b199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:44.150965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a421d-c74f-48aa-ae7c-01d1f69b199f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.151471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a421d-c74f-48aa-ae7c-01d1f69b199f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.151961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a421d-c74f-48aa-ae7c-01d1f69b199f admin admin] PATH_INFO: `/v3/projects/08926c47060d461a85b9e54bd73368ee/users/98b8eddc9f51482bbd6357e8a113fd81/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.155206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a421d-c74f-48aa-ae7c-01d1f69b199f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08926c47060d461a85b9e54bd73368ee, user_id=98b8eddc9f51482bbd6357e8a113fd81, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:44.159830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a421d-c74f-48aa-ae7c-01d1f69b199f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.186309 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2342/4672] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:44 2022] PUT /identity/v3/projects/08926c47060d461a85b9e54bd73368ee/users/98b8eddc9f51482bbd6357e8a113fd81/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:44.197765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.198854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.199348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.218860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d1c72-21cb-4b46-a215-d9ec630a990a tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:44.254370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] MFA Rules not processed for user `98b8eddc9f51482bbd6357e8a113fd81`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:44.257316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:44.344096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:44.351162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.351162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.351162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/services/a34cd2a046a946c08f1a5b6ead1cbf29` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.351162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a34cd2a046a946c08f1a5b6ead1cbf29)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:44.351663 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:44.351663 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:13:44.351663 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:44.351858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.385714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:44.470079 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2343/4673] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:44 2022] POST /identity/v3/auth/tokens => generated 4097 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:44.471120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:44.473195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:44.544614 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2331/4674] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:44 2022] DELETE /identity/v3/services/a34cd2a046a946c08f1a5b6ead1cbf29 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:44.550015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:44.631612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60997f15-7693-46c5-8aa5-b5d7ec778479 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:44.651206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:44.652020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.652311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.652589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/05642c9be74e45a4b9dd3f88058733c5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.681749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd3c2a-0113-4893-990d-be27f1b9388b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:44.684515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=05642c9be74e45a4b9dd3f88058733c5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:44.693135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.696775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:44.698097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.698448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.698794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.715459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:44.717356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.745021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2344/4675] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:44 2022] GET /identity/v3/auth/tokens => generated 3963 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:44.820463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '05642c9be74e45a4b9dd3f88058733c5', 'request_id': 'req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:44.838160 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2332/4676] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:13:44 2022] DELETE /identity/v3/endpoints/05642c9be74e45a4b9dd3f88058733c5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:44.841925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:44.865724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d178-4434-4c36-b974-8262d06c36db service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:44.915186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:44.915803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:44.916078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:44.916362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-512525095` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:44.916970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-512525095)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:44.918130 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:44.918130 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:44.918130 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:44.919039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:44.993236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:45.066897 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-512525095. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:45.066897 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:45.066897 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:45.088627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2345/4677] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:13:44 2022] DELETE /identity/v3/regions/tempest-region-512525095 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:45.092791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:45.121346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd848d5-451a-49e0-bfc1-a75c6f86fd84 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:45.167559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:45.168262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:45.168544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:45.169043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/services/bb2c851633454dbbb60a90e8655ce3a6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:45.169829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bb2c851633454dbbb60a90e8655ce3a6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:45.172304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:45.384062 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2333/4678] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:45 2022] DELETE /identity/v3/services/bb2c851633454dbbb60a90e8655ce3a6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:45.389462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:45.413723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc13-e7dc-4618-b7db-9f532cbf5690 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:45.466940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:45.467599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:45.467890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:45.468167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/endpoints/9bc432394fc4436f85bea27bed1c9131` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:45.493103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9bc432394fc4436f85bea27bed1c9131)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:45.494261 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:45.494261 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:45.494261 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:45.503115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:45.669710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9bc432394fc4436f85bea27bed1c9131', 'request_id': 'req-cace7fec-672a-45f6-923c-2dbac96260a5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:45.690279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2346/4679] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:13:45 2022] DELETE /identity/v3/endpoints/9bc432394fc4436f85bea27bed1c9131 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:45.695592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:45.787266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cc916-0c7f-4349-a373-4e0bd3ea43bd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:45.840717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:45.841613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:45.842103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:45.842614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/regions/tempest-region-1629964839` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:45.843681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1629964839)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:45.845802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:45.986692 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1629964839. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:13:45.986692 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:13:45.986692 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:13:45.996604 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2334/4680] 10.222.0.78 () {58 vars in 1209 bytes} [Sun Aug 28 20:13:45 2022] DELETE /identity/v3/regions/tempest-region-1629964839 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:46.002859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:46.046303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace7fec-672a-45f6-923c-2dbac96260a5 tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:46.184521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c05ccb421924a79bd211c53cdb2fe47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:46.184521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:46.184521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:46.184940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] PATH_INFO: `/v3/services/bfda48f346fb42ee95a8981e5881b38e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:46.184940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bfda48f346fb42ee95a8981e5881b38e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:46.190664 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:46.190664 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:46.190664 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:46.194136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:46.230463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:46.233803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:46.352276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2347/4681] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:46 2022] DELETE /identity/v3/services/bfda48f346fb42ee95a8981e5881b38e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:46.353583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:46.363233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:46.499679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620fe8-1bdd-4988-82ff-258b1abaa8dd tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:46.568541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:46.569095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:46.569483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:46.569911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] PATH_INFO: `/v3/users/d43c3a2d11fd43ce93fdee6339c27eb2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:46.572785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43c3a2d11fd43ce93fdee6339c27eb2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:46.581811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:46.614992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19644efb-7836-487a-871a-e857bcf8a7ab tempest-EndPointsTestJSON-1402662315 tempest-EndPointsTestJSON-1402662315-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:46.636999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:46.637961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:46.640767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:46.641249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] PATH_INFO: `/v3/users/f1e0a6938695444e80b222699509513c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:46.650268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e0a6938695444e80b222699509513c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:46.652390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:46.695090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:46.979971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43c3a2d11fd43ce93fdee6339c27eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:46.986134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:47.018352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43c3a2d11fd43ce93fdee6339c27eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.032800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43c3a2d11fd43ce93fdee6339c27eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.033623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43c3a2d11fd43ce93fdee6339c27eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.034286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ef041ac-34be-4ded-b166-3cd1048f2b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43c3a2d11fd43ce93fdee6339c27eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.094619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e0a6938695444e80b222699509513c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.104767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e0a6938695444e80b222699509513c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.144057 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2335/4682] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:46 2022] DELETE /identity/v3/users/d43c3a2d11fd43ce93fdee6339c27eb2 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:47.151170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:47.151410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:47.151653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:47.236345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:47.239620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:47.244164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e0a6938695444e80b222699509513c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.271947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e0a6938695444e80b222699509513c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.271947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d9a0a923-e2b4-4035-99cd-3647a632616e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e0a6938695444e80b222699509513c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:47.368089 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2348/4683] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:46 2022] DELETE /identity/v3/users/f1e0a6938695444e80b222699509513c => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:47.371834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:47.372830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:47.373387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:47.416464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:47.418146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:47.593655 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2349/4684] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:47.606666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:47.608348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:47.687546 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2336/4685] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:47.694280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:47.700678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:47.755641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa18fc-663d-4390-8308-cfc9c3dc3227 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:47.761826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:47.762824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:47.763450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:47.763876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:47.802170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:47.807035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:47.836231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2350/4686] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:13:47.919363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:47.921260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:48.007765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088e02-7966-4921-a095-47eb6c49fee5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:48.016064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:48.017386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:48.018143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:48.018826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:48.042829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:48.046835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:48.100306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcf915-9c1f-4f78-8311-9e9f4d02e0e1 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:48.117195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:48.118111 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2337/4687] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:13:48.119266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:48.119944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:48.120655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:48.131646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:48.252345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:48.340015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:48.342389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:48.371029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2351/4688] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:48.450504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:48.807874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:48.809445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:48.854274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad47c-9ff1-4987-8037-8d1cf17d5ee5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:48.862111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:48.863385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:48.864661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:48.867778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] PATH_INFO: `/v3/projects/ce53923e7e724a21bc6a43a94b9f2b2d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:48.871606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce53923e7e724a21bc6a43a94b9f2b2d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:48.874514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:49.052799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce53923e7e724a21bc6a43a94b9f2b2d', 'request_id': 'req-672fe00c-2f4d-403c-9982-09a7baeaa54c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.061372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce53923e7e724a21bc6a43a94b9f2b2d', 'request_id': 'req-672fe00c-2f4d-403c-9982-09a7baeaa54c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.070152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce53923e7e724a21bc6a43a94b9f2b2d', 'request_id': 'req-672fe00c-2f4d-403c-9982-09a7baeaa54c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.200527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] The token cache is being invalidate because project ce53923e7e724a21bc6a43a94b9f2b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:49.201009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.205201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.208110 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2338/4689] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:48 2022] DELETE /identity/v3/projects/ce53923e7e724a21bc6a43a94b9f2b2d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:49.209485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:49.222876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9524-d074-4dde-8242-105712e8466c service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:49.287902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:49.288472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:49.288757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:49.289037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] PATH_INFO: `/v3/users/3c05ccb421924a79bd211c53cdb2fe47` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:49.290399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c05ccb421924a79bd211c53cdb2fe47)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:49.292692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:49.549304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c05ccb421924a79bd211c53cdb2fe47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.550271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c05ccb421924a79bd211c53cdb2fe47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.628156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:49.629384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:49.644130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fe00c-2f4d-403c-9982-09a7baeaa54c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:49.658310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c05ccb421924a79bd211c53cdb2fe47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.665895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c05ccb421924a79bd211c53cdb2fe47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.666103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:49.667622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:49.668988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:49.669239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3c47fbd-56cd-41e7-910f-50a126b68f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c05ccb421924a79bd211c53cdb2fe47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.669585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] PATH_INFO: `/v3/projects/97dc423079494a9cb8264d083bd9d228` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:49.671214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dc423079494a9cb8264d083bd9d228)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:49.673812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:49.721946 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2352/4690] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:49 2022] DELETE /identity/v3/users/3c05ccb421924a79bd211c53cdb2fe47 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:49.899401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dc423079494a9cb8264d083bd9d228', 'request_id': 'req-77f8962e-4244-466d-8eaf-ccda25c31ac6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.906842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dc423079494a9cb8264d083bd9d228', 'request_id': 'req-77f8962e-4244-466d-8eaf-ccda25c31ac6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.914598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dc423079494a9cb8264d083bd9d228', 'request_id': 'req-77f8962e-4244-466d-8eaf-ccda25c31ac6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:49.969225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:50.055931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] The token cache is being invalidate because project 97dc423079494a9cb8264d083bd9d228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:50.055931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:50.055931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77f8962e-4244-466d-8eaf-ccda25c31ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:50.055931 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2339/4691] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:49 2022] DELETE /identity/v3/projects/97dc423079494a9cb8264d083bd9d228 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:50.060751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.061186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.061599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.087057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:50.088660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:50.182186 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2353/4692] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:50.184246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.184627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.185001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.224543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:50.226335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:50.237315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2340/4693] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:50.242073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:50.256460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9099-43b4-486d-822e-a4b9fd8343a0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:50.264186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:50.265333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.265767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.266165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.267438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:50.268287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:50.270522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:50.297939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2354/4694] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:50.298130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:50.304602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b202908-72dd-4f5e-aca9-61aeb0331bf4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:50.311877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:50.312972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.313424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.314497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.315319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:50.320692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:50.421379 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2341/4695] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:50 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:50.425811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:50.450419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55337b-9651-4b9b-ab81-07a7fda4fb91 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:50.668082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:50.672436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.672436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.672436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.672436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:50.675142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:50.785127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:50.787821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:50.823777 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2355/4696] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:50 2022] POST /identity/v3/users => generated 288 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:50.825491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:50.832839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f7943-c7d6-4aeb-9f3f-77e434adeb4e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:50.839525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3d69-40a8-47e7-a695-a7b669cb31bc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:50.845309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:50.845956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.846406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.846694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.849683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:50.852252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:50.853373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:50.853491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:50.853688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] PATH_INFO: `/v3/users/27ae2c7ee58748ef9162b4b5e3c6bbcd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:50.854730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:50.855631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ae2c7ee58748ef9162b4b5e3c6bbcd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:50.857456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:50.915221 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2356/4697] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:13:50.924892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:50.935253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.018509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3e9d4-9720-423c-abb4-c64a8f9ba469 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:51.042010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:51.042010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.042010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.072180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] PATH_INFO: `/v3/projects/7c985efdaa6c4e4cb1f22f6b37b1c6b5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.098594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c985efdaa6c4e4cb1f22f6b37b1c6b5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:51.098594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:51.140317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ae2c7ee58748ef9162b4b5e3c6bbcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.156037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ae2c7ee58748ef9162b4b5e3c6bbcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.166560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ae2c7ee58748ef9162b4b5e3c6bbcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.167509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ae2c7ee58748ef9162b4b5e3c6bbcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.180531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ae2c7ee58748ef9162b4b5e3c6bbcd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.314650 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2342/4698] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:50 2022] DELETE /identity/v3/users/27ae2c7ee58748ef9162b4b5e3c6bbcd => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:51.315852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:51.319896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.389475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'request_id': 'req-541eb0e5-7512-4bf6-9f77-3ccd23228944'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.399757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'request_id': 'req-541eb0e5-7512-4bf6-9f77-3ccd23228944'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.427804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c985efdaa6c4e4cb1f22f6b37b1c6b5', 'request_id': 'req-541eb0e5-7512-4bf6-9f77-3ccd23228944'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.446582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:51.465721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb638-3d46-41f8-92d7-1177ff7858e2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:51.510328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] The token cache is being invalidate because project 7c985efdaa6c4e4cb1f22f6b37b1c6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:51.510653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.512097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-541eb0e5-7512-4bf6-9f77-3ccd23228944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:51.517352 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2357/4699] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:50 2022] DELETE /identity/v3/projects/7c985efdaa6c4e4cb1f22f6b37b1c6b5 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:51.517352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.517352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.517352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.530891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560466-df39-4ac6-a985-c3a42bd9a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:51.531899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560466-df39-4ac6-a985-c3a42bd9a0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.531899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560466-df39-4ac6-a985-c3a42bd9a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.532079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560466-df39-4ac6-a985-c3a42bd9a0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.532646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52560466-df39-4ac6-a985-c3a42bd9a0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:51.534594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52560466-df39-4ac6-a985-c3a42bd9a0a2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:51.537657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:51.539019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.553886 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2343/4700] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:51.558864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.559204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.559441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.571759 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2358/4701] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:51.573352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:51.584097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.585173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:51.586699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.598547 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2344/4702] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:51.599476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:51.602038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.611484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7cd7-0a77-41c1-be9e-ac2d1d3b31f5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:51.619879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f416cb8-c389-4839-b985-71c2cf674d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:51.620844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416cb8-c389-4839-b985-71c2cf674d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.621208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416cb8-c389-4839-b985-71c2cf674d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.621560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416cb8-c389-4839-b985-71c2cf674d5f admin admin] PATH_INFO: `/v3/projects/dbfadcbfe7c441b4b518a61f64b76f33/users/6e86c53843374b0b986e5141d078bb03/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.649549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416cb8-c389-4839-b985-71c2cf674d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfadcbfe7c441b4b518a61f64b76f33, user_id=6e86c53843374b0b986e5141d078bb03, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:51.653343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416cb8-c389-4839-b985-71c2cf674d5f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:51.771448 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2359/4703] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:51 2022] PUT /identity/v3/projects/dbfadcbfe7c441b4b518a61f64b76f33/users/6e86c53843374b0b986e5141d078bb03/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:51.779219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3563d1-b8e0-4936-a798-14d4ca8fc28d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.784480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3563d1-b8e0-4936-a798-14d4ca8fc28d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.786493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3563d1-b8e0-4936-a798-14d4ca8fc28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.788002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f0f2a-0768-4506-9d5c-5bccbd453bea None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:51.846800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:51.861693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ef3563d1-b8e0-4936-a798-14d4ca8fc28d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:51.870646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ef3563d1-b8e0-4936-a798-14d4ca8fc28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:51.904072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:51.904628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.904914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.905183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.942003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2360/4704] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:51.942661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:51.942950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:51.943283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:51.978439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] MFA Rules not processed for user `6e86c53843374b0b986e5141d078bb03`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:51.979778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:52.004549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.006585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.021001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2345/4705] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:52.023079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.038496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609f91-fcc6-4baa-b94b-ffc7fc668318 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.052705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.054081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.054586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.055045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.056279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:52.056916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.059177 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2361/4706] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:52.059997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.076756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.079231 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2346/4707] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:52.083009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.089336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4db769-be62-41c3-9960-633a3ed8a51d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.093651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.094482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.094884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.095257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.105346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.106965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.111213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b213-7b82-4195-8e4d-5b5a59f7661b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.117710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.118507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.118791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.119055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.121659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.122591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.127231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2362/4708] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:52.307585 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2347/4709] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:52 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:52.309026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.326724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907a1f4-eaa2-4d6e-b56c-91350783f98f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.535201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.536791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.537914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.538361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.541405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.555177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.737070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2363/4710] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:52 2022] POST /identity/v3/users => generated 285 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:13:52.741936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.778040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9b8d-872a-4ec1-96ce-1d7927296c41 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.791578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.792731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.808198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.808919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.809939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.813266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.867353 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2348/4711] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:52.869181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.888225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a8a5-528b-4304-a90f-fd7fc6350638 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.902761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8e0a9-084e-4256-8e91-17e83fe5b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.904959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8e0a9-084e-4256-8e91-17e83fe5b5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.905567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8e0a9-084e-4256-8e91-17e83fe5b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.906061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8e0a9-084e-4256-8e91-17e83fe5b5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.908226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8e0a9-084e-4256-8e91-17e83fe5b5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.910994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8e0a9-084e-4256-8e91-17e83fe5b5c2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:52.925119 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2364/4712] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:52.929521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:52.946416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf322-a240-4abe-92f1-4278a4607620 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:52.954960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:52.955771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:52.956258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:52.956731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] PATH_INFO: `/v3/projects/41411691b85944e69afe7528b4978632/users/c5c0b528db9f4f549629253b56d46372/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:52.978810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41411691b85944e69afe7528b4978632, user_id=c5c0b528db9f4f549629253b56d46372, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:52.982678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:53.084797 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2349/4713] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:52 2022] PUT /identity/v3/projects/41411691b85944e69afe7528b4978632/users/c5c0b528db9f4f549629253b56d46372/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:53.095939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:53.097252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:53.098177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:53.139040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] MFA Rules not processed for user `c5c0b528db9f4f549629253b56d46372`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:53.140299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:53.146501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:53.290258 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2365/4714] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:53.295034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:53.325542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:53.329270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:53.364690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:53.431469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aeae7-c0d9-4f0f-b540-e183833a6e82 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:53.440219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:53.441278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:53.441731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:53.442964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:53.444459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:53.448524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:53.474695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf667ef0-b19e-41f5-81ff-8ed2392fbc5c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:53.484994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:53.485521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:53.485880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:53.486377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] PATH_INFO: `/v3/projects/183f9adb11894af2875dd1700eefbffc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:53.487954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=183f9adb11894af2875dd1700eefbffc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:53.490217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:53.580444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2350/4715] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:53 2022] POST /identity/v3/projects => generated 367 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:53.581719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:53.717820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183f9adb11894af2875dd1700eefbffc', 'request_id': 'req-639fc5b4-f322-4784-9af0-75d94f09a13d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:53.732249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183f9adb11894af2875dd1700eefbffc', 'request_id': 'req-639fc5b4-f322-4784-9af0-75d94f09a13d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:53.747542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183f9adb11894af2875dd1700eefbffc', 'request_id': 'req-639fc5b4-f322-4784-9af0-75d94f09a13d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:53.752031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f72a-f105-44ef-a546-d6386892ec98 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:53.872390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:53.873029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:53.873376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:53.873745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:53.875026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:53.876816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:53.967750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] The token cache is being invalidate because project 183f9adb11894af2875dd1700eefbffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:53.968047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:53.969724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-639fc5b4-f322-4784-9af0-75d94f09a13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:53.980278 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2366/4716] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:53 2022] DELETE /identity/v3/projects/183f9adb11894af2875dd1700eefbffc => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:53.982777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4facd25-5872-4157-928d-95e38fcef91d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:53.982777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4facd25-5872-4157-928d-95e38fcef91d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:53.982777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4facd25-5872-4157-928d-95e38fcef91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.008073 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2351/4717] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:53 2022] POST /identity/v3/users => generated 290 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:54.014014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.019252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:54.025599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f4facd25-5872-4157-928d-95e38fcef91d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:54.026065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f4facd25-5872-4157-928d-95e38fcef91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:54.058239 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2367/4718] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:54.065340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.066306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770086-d5ae-40a2-9388-d834d0b46d71 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.066951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.067490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.082734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.087831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.087831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.087831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.088453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.092143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.096182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:54.097651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:54.108464 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2368/4719] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:54.115874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.120617 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2352/4720] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:13:54.132890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.141921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25993c9d-dd49-49ab-9b4c-896aa58c2981 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.150552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9577e0-0c67-4fa2-9787-ff1e33e68226 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.156002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.156986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.157653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.158036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.158926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:13:54.159442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.161317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.169210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.171486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.171794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.172077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] PATH_INFO: `/v3/projects/e0bc5ea4d63949c7837d5fb15d83f4f2/users/6fee4cf490a7472aad368cc7c9c85e9f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.181465 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2369/4721] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:13:54.184533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.201436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0937178-9308-44fe-a1f6-8b5801b2888c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.208895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.209524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.209806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.210348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.211380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.213563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.219010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bc5ea4d63949c7837d5fb15d83f4f2, user_id=6fee4cf490a7472aad368cc7c9c85e9f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.221940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.311212 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2353/4722] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:54 2022] PUT /identity/v3/projects/e0bc5ea4d63949c7837d5fb15d83f4f2/users/6fee4cf490a7472aad368cc7c9c85e9f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:54.315511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.359676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2370/4723] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:54 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:54.363366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.475935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822161-e869-4bb9-b837-0f8c9ef64fd0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.482135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce7cf-51d2-4566-a64e-840f3014a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.483350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce7cf-51d2-4566-a64e-840f3014a06f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.483783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce7cf-51d2-4566-a64e-840f3014a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.484217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce7cf-51d2-4566-a64e-840f3014a06f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.484863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a813b7-75fe-4f36-90e4-1a673c851189 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.485643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce7cf-51d2-4566-a64e-840f3014a06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.488256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce7cf-51d2-4566-a64e-840f3014a06f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.502863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.504260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.504495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.505898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.506894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.508558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.522573 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2354/4724] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:13:54.528742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.550537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7a41-6753-4dac-a9a2-4f680e2c5842 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.556488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.559515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.559515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.559515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] PATH_INFO: `/v3/projects/e0bc5ea4d63949c7837d5fb15d83f4f2/users/6fee4cf490a7472aad368cc7c9c85e9f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.563205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bc5ea4d63949c7837d5fb15d83f4f2, user_id=6fee4cf490a7472aad368cc7c9c85e9f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.568103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.594216 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2355/4725] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:54 2022] PUT /identity/v3/projects/e0bc5ea4d63949c7837d5fb15d83f4f2/users/6fee4cf490a7472aad368cc7c9c85e9f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:54.611494 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2371/4726] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:54 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:13:54.612191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.615038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.615352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.615626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.624681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:54.678238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] MFA Rules not processed for user `6fee4cf490a7472aad368cc7c9c85e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:54.683697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:54.788302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:54.794261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f1c8-7315-4132-bb60-49af49ac7635 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.800253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.801221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.801963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.802394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.803210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.805043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.829538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2356/4727] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:54.834714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.854462 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2372/4728] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:54.855452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.857373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822954eb-2c6f-4e9a-bade-01fedff08458 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.867805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.869061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c502a-39fe-47eb-b029-f6ae4434a922 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.869462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.870096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.870622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.871965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.874870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.875504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.877229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.877532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.878248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.878979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.880620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.899184 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2357/4729] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:54.906529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:54.918331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601a537-3d50-4fd1-85c4-40745049f09d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:54.924497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f2119-4099-43bc-b72e-029338728215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:54.926217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2119-4099-43bc-b72e-029338728215 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:54.926669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2119-4099-43bc-b72e-029338728215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:54.927173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2119-4099-43bc-b72e-029338728215 admin admin] PATH_INFO: `/v3/projects/61d5a3ea8708484d905ef64529381546/users/7c8f3ce2a9384f44a87ec11f96013d09/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:54.947554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f2119-4099-43bc-b72e-029338728215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d5a3ea8708484d905ef64529381546, user_id=7c8f3ce2a9384f44a87ec11f96013d09, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:54.951432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f2119-4099-43bc-b72e-029338728215 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:54.979223 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2373/4730] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:13:54 2022] POST /identity/v3/domains => generated 275 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:54.984418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.104549 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2358/4731] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:54 2022] PUT /identity/v3/projects/61d5a3ea8708484d905ef64529381546/users/7c8f3ce2a9384f44a87ec11f96013d09/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:55.117114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.121529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.121529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.154211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699a8c-a38c-409c-b8a1-f211b2d64d13 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.188161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] MFA Rules not processed for user `7c8f3ce2a9384f44a87ec11f96013d09`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:55.190235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:55.297263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.298180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.298467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.298762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.299426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.302914 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:55.302914 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:55.302914 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:55.308239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.329718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2359/4732] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:55.334672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.469107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c7c8-599c-41c0-bc8f-3b1aa1756f25 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.470907 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2374/4733] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:13:54 2022] POST /identity/v3/groups => generated 280 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:55.475687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.476227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.476956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.477291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.477596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.478274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.480931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.497247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac21d-4e15-41ea-a30f-d0c8860a3a1b tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.506586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.507376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.507658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.507933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/d4ff040fb59845a3bf449e5247f41bd3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.523481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:update_group(group_id=d4ff040fb59845a3bf449e5247f41bd3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.524610 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:55.524610 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:55.524610 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:55.525819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.707015 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2360/4734] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:55 2022] POST /identity/v3/projects => generated 377 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:55.711543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.713262 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2375/4735] 10.222.0.78 () {60 vars in 1247 bytes} [Sun Aug 28 20:13:55 2022] PATCH /identity/v3/groups/d4ff040fb59845a3bf449e5247f41bd3 => generated 292 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:55.717334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.741596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d0c3-9065-408c-8b26-f3c35772a8c7 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.802358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfccf2-3e29-4b4a-862a-33b6e54fe764 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.808641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.809602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.809602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.809798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.809919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.810475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.810580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.810838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.811812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/d4ff040fb59845a3bf449e5247f41bd3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.812933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.817575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:get_group(group_id=d4ff040fb59845a3bf449e5247f41bd3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.818855 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:55.818855 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:55.818855 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:55.824980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.824980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2376/4736] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:55 2022] GET /identity/v3/groups/d4ff040fb59845a3bf449e5247f41bd3 => generated 292 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:13:55.826150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.837353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4af8ac-43d0-44ec-81c4-156a9d70f531 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.842234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.844375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.844375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.844375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/d4ff040fb59845a3bf449e5247f41bd3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.845467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:update_group(group_id=d4ff040fb59845a3bf449e5247f41bd3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.847473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.956483 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2361/4737] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:55 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:55.960520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.973030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2377/4738] 10.222.0.78 () {60 vars in 1246 bytes} [Sun Aug 28 20:13:55 2022] PATCH /identity/v3/groups/d4ff040fb59845a3bf449e5247f41bd3 => generated 309 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:13:55.976910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:55.979317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5e4c-dafd-49d7-bfe9-d58df3efe3a5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.988527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.989272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.989671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.990073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:55.990755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b081e-acfb-4889-bbc9-ad99f7783a09 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:55.990897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:55.992703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:55.997029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:55.998176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:55.998681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:55.999285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/d4ff040fb59845a3bf449e5247f41bd3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.005427 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2362/4739] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:56.008889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d4ff040fb59845a3bf449e5247f41bd3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.010177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.011424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.024253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10460-84e8-4b47-b905-59b0e69c7bc7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:56.031629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:56.032583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.033099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.033631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] PATH_INFO: `/v3/projects/cb71dd0c673b42edb834f63fff053fb2/users/f5df03ea86024eb98924a8d538e16c44/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.055751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb71dd0c673b42edb834f63fff053fb2, user_id=f5df03ea86024eb98924a8d538e16c44, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.059091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.209296 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2363/4740] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:56 2022] PUT /identity/v3/projects/cb71dd0c673b42edb834f63fff053fb2/users/f5df03ea86024eb98924a8d538e16c44/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:56.213704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.240899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2378/4741] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:13:55 2022] DELETE /identity/v3/groups/d4ff040fb59845a3bf449e5247f41bd3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:56.245964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.372875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbca7-9d3d-4234-a15d-3257a306a081 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:56.386663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:56.423122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823204-1f43-4e97-bceb-c47bd9d20927 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:56.449577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:56.450341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.450676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.451013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.452088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.453757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.501589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:56.502508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.502875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.503246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.503995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.505747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.520687 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2364/4742] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:56.527289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.547662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844084-2658-4fa2-a620-cb620e7aa82c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:56.554696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9245-f147-456e-8f0e-e8fd1b4517bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:56.555385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9245-f147-456e-8f0e-e8fd1b4517bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.555895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9245-f147-456e-8f0e-e8fd1b4517bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.556196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9245-f147-456e-8f0e-e8fd1b4517bf admin admin] PATH_INFO: `/v3/projects/cb71dd0c673b42edb834f63fff053fb2/users/f5df03ea86024eb98924a8d538e16c44/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.558485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc9245-f147-456e-8f0e-e8fd1b4517bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb71dd0c673b42edb834f63fff053fb2, user_id=f5df03ea86024eb98924a8d538e16c44, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.561118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc9245-f147-456e-8f0e-e8fd1b4517bf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.579142 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2365/4743] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:56 2022] PUT /identity/v3/projects/cb71dd0c673b42edb834f63fff053fb2/users/f5df03ea86024eb98924a8d538e16c44/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:56.592122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.593578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.594346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.621474 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2379/4744] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:13:56 2022] POST /identity/v3/groups => generated 327 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:56.622933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.652844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeaa5c-705e-43af-9804-a47d4f1a7e52 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:56.661199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] MFA Rules not processed for user `f5df03ea86024eb98924a8d538e16c44`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:56.662677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:56.787846 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2366/4745] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:56.792245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.829814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:56.831046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.831046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.831046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.831644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.833491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.844587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf254fbd-6528-4123-a529-35ae4ec1bb9c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:56.862215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:56.866392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:56.868703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:56.868984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:56.869798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:56.875851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:56.976965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:56.985913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2367/4746] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:13:56 2022] POST /identity/v3/domains => generated 245 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:13:56.989941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:56.994749 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2380/4747] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:56 2022] POST /identity/v3/users => generated 323 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:56.996370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:57.007983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a77521-0f34-4c25-997c-3c253ec006df tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.062659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:57.114946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.115693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.116674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.117023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/da2f8afc12154c819574ccb0a9425704` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.156103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553aad-5063-4f7f-8bdc-d2a168159e55 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.163466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.164256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.164786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.165926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.166927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.171008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=da2f8afc12154c819574ccb0a9425704)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.171966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:57.181538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:57.304197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2381/4748] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:13:56 2022] PUT /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/da2f8afc12154c819574ccb0a9425704 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:57.305561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:57.364341 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2368/4749] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:13:56 2022] POST /identity/v3/projects => generated 409 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:57.372943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:57.468587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e9dfd-5f9b-4333-9f16-152da9f274db tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.582963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f4316-ac5e-4f69-8ae4-fddcf0186c43 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.589696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.590402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.591174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.591174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.591615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.593625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:57.619416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.620141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.620431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.620742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.621462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.624174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:57.754459 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2369/4750] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:57 2022] POST /identity/v3/users => generated 347 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:57.758537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:57.772408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d00c6-888d-4583-b0d0-5f1d16a820f3 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.784767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.786011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.787379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.787926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.801132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.804484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:57.816812 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2382/4751] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:57 2022] POST /identity/v3/users => generated 323 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:57.819493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:57.840864 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2370/4752] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:57.841297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:57.855965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ce4ad-ea69-42ee-8e15-2b42356a3eb0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.871306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.872198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.872555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.873000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/ac759d3512384ea5b198a0af9a599577` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.880689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b47c0-8436-47f5-9905-0aa7d7217b90 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:57.898858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b822-1bd9-479a-a51b-cf683b521f6f tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:57.901049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b822-1bd9-479a-a51b-cf683b521f6f tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:57.901499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b822-1bd9-479a-a51b-cf683b521f6f tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:57.901999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b822-1bd9-479a-a51b-cf683b521f6f tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/projects/32c89fb56d794c8f9a53ed8c538beb31/users/4707f477ebbb45f69eb174edbdec1619/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:57.919589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=ac759d3512384ea5b198a0af9a599577)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.922781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:57.929449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43b822-1bd9-479a-a51b-cf683b521f6f tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32c89fb56d794c8f9a53ed8c538beb31, user_id=4707f477ebbb45f69eb174edbdec1619, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:57.932785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43b822-1bd9-479a-a51b-cf683b521f6f tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.034663 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2371/4753] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:13:57 2022] PUT /identity/v3/projects/32c89fb56d794c8f9a53ed8c538beb31/users/4707f477ebbb45f69eb174edbdec1619/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:58.040623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c38cd-19f2-49c4-9836-0bc2e8380d0e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.040916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c38cd-19f2-49c4-9836-0bc2e8380d0e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.041351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c38cd-19f2-49c4-9836-0bc2e8380d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.057795 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2383/4754] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:13:57 2022] PUT /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/ac759d3512384ea5b198a0af9a599577 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:58.062008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.273670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188dde-649a-499a-accb-2c6809594b32 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.280633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.281269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.282087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.282087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.282668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.284592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.297100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-623c38cd-19f2-49c4-9836-0bc2e8380d0e None None] MFA Rules not processed for user `4707f477ebbb45f69eb174edbdec1619`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:58.299679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-623c38cd-19f2-49c4-9836-0bc2e8380d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:58.324779 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2372/4755] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:58.335761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.336172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.336555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.379566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] MFA Rules not processed for user `4707f477ebbb45f69eb174edbdec1619`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:58.381586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:58.392781 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2373/4756] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:58.401636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.414286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8b5a-f758-441e-a353-03b2a9d8340f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.420635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4707f477ebbb45f69eb174edbdec1619', 'user_domain_id': '1cbcdfb5c86e4110bf0edbca02441a70', 'system_scope': None, 'project_id': '32c89fb56d794c8f9a53ed8c538beb31', 'project_domain_id': '1cbcdfb5c86e4110bf0edbca02441a70', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.421262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.421558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.421827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.433709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.435783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.451973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2374/4757] 10.222.0.78 () {56 vars in 1284 bytes} [Sun Aug 28 20:13:58 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:13:58.452658 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2384/4758] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:13:58 2022] POST /identity/v3/users => generated 321 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:13:58.457146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.458374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.480457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eb29e-a834-4368-81d9-08a04e6ccc72 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.488775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.489632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.490491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.491400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/402f5713e2544466a39d1e39465fcec4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.518228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=402f5713e2544466a39d1e39465fcec4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.524659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.583042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3adb6-9062-43bf-be41-6651dad08dac tempest-test_project-170103647 tempest-user-697790910] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.594363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.597801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.598259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.598734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/users/4707f477ebbb45f69eb174edbdec1619` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.603179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4707f477ebbb45f69eb174edbdec1619)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.609693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.626510 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2385/4759] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:13:58 2022] PUT /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/402f5713e2544466a39d1e39465fcec4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:58.631842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.730474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1bb4-0616-4ca1-a01c-15cefe5b7329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.736793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.737586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.738010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.738393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.739775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=24fe90def57e4d8da84e4a0e6afb4545)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.740926 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:58.740926 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:58.740926 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:58.742502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.765654 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2386/4760] 10.222.0.78 () {58 vars in 1242 bytes} [Sun Aug 28 20:13:58 2022] GET /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users => generated 1083 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:13:58.766863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.779396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b900-4a27-4f57-b03a-ffec7979196c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.784764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.785975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.786406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.786684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/da2f8afc12154c819574ccb0a9425704` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.789074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=da2f8afc12154c819574ccb0a9425704)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.790461 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:13:58.790461 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:13:58.790461 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:13:58.791665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.810422 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2387/4761] 10.222.0.78 () {58 vars in 1342 bytes} [Sun Aug 28 20:13:58 2022] HEAD /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/da2f8afc12154c819574ccb0a9425704 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:58.814505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:58.828070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5adb9-fd8b-4183-a048-609fb00bb30f tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:58.833287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:58.834163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:58.834445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:58.834720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/da2f8afc12154c819574ccb0a9425704` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:58.834921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4707f477ebbb45f69eb174edbdec1619'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:58.837653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=da2f8afc12154c819574ccb0a9425704)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:58.839792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:58.860660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4707f477ebbb45f69eb174edbdec1619'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:58.872671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4707f477ebbb45f69eb174edbdec1619'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:58.873944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4707f477ebbb45f69eb174edbdec1619'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:58.874965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4707f477ebbb45f69eb174edbdec1619'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:58.928802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da2f8afc12154c819574ccb0a9425704'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.056453 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2375/4762] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:13:58 2022] DELETE /identity/v3/users/4707f477ebbb45f69eb174edbdec1619 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:59.061359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:59.063075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:59.141883 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2388/4763] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:13:58 2022] DELETE /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/da2f8afc12154c819574ccb0a9425704 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:59.154261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:59.160986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:59.191352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a904a-3ff8-446c-b652-bbf890692776 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:59.313339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:59.314577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:59.314949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:59.315169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/projects/32c89fb56d794c8f9a53ed8c538beb31` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:59.320189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32c89fb56d794c8f9a53ed8c538beb31)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:59.323007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:59.331372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95778953-d0f3-447a-b6f9-a1c22aa07ae0 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:59.338795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:59.340865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:59.341349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:59.341817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/ac759d3512384ea5b198a0af9a599577` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:59.351880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=ac759d3512384ea5b198a0af9a599577)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:59.355479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:59.378460 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2389/4764] 10.222.0.78 () {58 vars in 1342 bytes} [Sun Aug 28 20:13:59 2022] HEAD /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/ac759d3512384ea5b198a0af9a599577 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:13:59.384560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:59.402781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6917689-a551-49d9-8bb9-2d3b86315959 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:59.410373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:59.411591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:59.411825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:59.412142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/ac759d3512384ea5b198a0af9a599577` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:59.414856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=ac759d3512384ea5b198a0af9a599577)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:59.417746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:59.505713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c89fb56d794c8f9a53ed8c538beb31', 'request_id': 'req-29012fe8-2632-4118-a9eb-56becbc63a8e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.512372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c89fb56d794c8f9a53ed8c538beb31', 'request_id': 'req-29012fe8-2632-4118-a9eb-56becbc63a8e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.522525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c89fb56d794c8f9a53ed8c538beb31', 'request_id': 'req-29012fe8-2632-4118-a9eb-56becbc63a8e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.538778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ac759d3512384ea5b198a0af9a599577'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.606650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] The token cache is being invalidate because project 32c89fb56d794c8f9a53ed8c538beb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:13:59.607860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.607860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:13:59.609838 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2376/4765] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:13:59 2022] DELETE /identity/v3/projects/32c89fb56d794c8f9a53ed8c538beb31 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:59.614731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:59.618105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:59.760345 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2390/4766] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:13:59 2022] DELETE /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/ac759d3512384ea5b198a0af9a599577 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:13:59.764898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:59.766949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:59.811191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012fe8-2632-4118-a9eb-56becbc63a8e tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:59.929497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934f0b-5d60-469d-b056-452a600423b8 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:59.958076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:59.977255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:59.988560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:59.989091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:59.991240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/402f5713e2544466a39d1e39465fcec4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:59.991661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:59.994089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:59.994484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:59.994810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/domains/1cbcdfb5c86e4110bf0edbca02441a70` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:59.998071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=402f5713e2544466a39d1e39465fcec4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:00.001644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1cbcdfb5c86e4110bf0edbca02441a70)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:00.003355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:00.005829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:00.015003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:00.047494 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2391/4767] 10.222.0.78 () {58 vars in 1342 bytes} [Sun Aug 28 20:13:59 2022] HEAD /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/402f5713e2544466a39d1e39465fcec4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:00.052447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:00.076311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd0638-b218-4b5a-86c3-5d05927337e2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:00.079997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.081144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.099926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:00.100604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:00.100891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:00.101181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/402f5713e2544466a39d1e39465fcec4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:00.103869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=24fe90def57e4d8da84e4a0e6afb4545, user_id=402f5713e2544466a39d1e39465fcec4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:00.106177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:00.208556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '402f5713e2544466a39d1e39465fcec4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.227215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.231390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.234083 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2377/4768] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:13:59 2022] PATCH /identity/v3/domains/1cbcdfb5c86e4110bf0edbca02441a70 => generated 246 bytes in 620 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:00.238130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:00.245721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:00.325509 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2392/4769] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:14:00 2022] DELETE /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users/402f5713e2544466a39d1e39465fcec4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:00.327063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:00.329176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:00.439131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929387-d573-49d5-9add-61c602f5c761 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:00.586365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4d432-dd7a-412f-b136-bcc03aa1e10d tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:00.592992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:00.592992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:00.592992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:00.592992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:00.594737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:00.597066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5df03ea86024eb98924a8d538e16c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb71dd0c673b42edb834f63fff053fb2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:00.597801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:00.598846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:00.599918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] PATH_INFO: `/v3/domains/1cbcdfb5c86e4110bf0edbca02441a70` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:00.616603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1cbcdfb5c86e4110bf0edbca02441a70)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:00.620391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:00.692193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:00.695029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:00.699495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.722004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.751800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2378/4770] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:00.752338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:00.755607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:00.945620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70', 'request_id': 'req-865c111c-15b4-4397-bbc4-e76a35e691d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.976882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70', 'request_id': 'req-865c111c-15b4-4397-bbc4-e76a35e691d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:00.977151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8688-71a7-4fbc-a534-4ddadcde5fe1 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:01.009759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70', 'request_id': 'req-865c111c-15b4-4397-bbc4-e76a35e691d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.098178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:01.098929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:01.099244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:01.099577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:01.101587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=24fe90def57e4d8da84e4a0e6afb4545)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:01.103411 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:01.103411 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:01.103411 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:01.104861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:01.123162 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2379/4771] 10.222.0.78 () {58 vars in 1242 bytes} [Sun Aug 28 20:14:00 2022] GET /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545/users => generated 145 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:01.134184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:01.146121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e3d72-2084-4a99-8763-c1a18e695923 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:01.154781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:01.155521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:01.156074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:01.156367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users/402f5713e2544466a39d1e39465fcec4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:01.157365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] The token cache is being invalidate because project 1cbcdfb5c86e4110bf0edbca02441a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:01.157931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.158057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_user(user_id=402f5713e2544466a39d1e39465fcec4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:01.158988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.161169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:01.169424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70', 'request_id': 'req-865c111c-15b4-4397-bbc4-e76a35e691d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.175483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70', 'request_id': 'req-865c111c-15b4-4397-bbc4-e76a35e691d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.176578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1cbcdfb5c86e4110bf0edbca02441a70', 'request_id': 'req-865c111c-15b4-4397-bbc4-e76a35e691d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.184361 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2393/4772] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:00 2022] DELETE /identity/v3/domains/1cbcdfb5c86e4110bf0edbca02441a70 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:01.192750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:01.194601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:01.310863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c111c-15b4-4397-bbc4-e76a35e691d1 tempest-TestDefaultProjectId-1681820600 tempest-TestDefaultProjectId-1681820600-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:01.320007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:01.321427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:01.321917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:01.325110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] PATH_INFO: `/v3/users/7c8f3ce2a9384f44a87ec11f96013d09` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:01.325110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8f3ce2a9384f44a87ec11f96013d09)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:01.329673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:01.362244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402f5713e2544466a39d1e39465fcec4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.379023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402f5713e2544466a39d1e39465fcec4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.390853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402f5713e2544466a39d1e39465fcec4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.391713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402f5713e2544466a39d1e39465fcec4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.392602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402f5713e2544466a39d1e39465fcec4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.509726 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2380/4773] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:01 2022] DELETE /identity/v3/users/402f5713e2544466a39d1e39465fcec4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:01.516306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:01.518628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:01.631489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9b93-dad2-4c8a-87f6-b40dd8801d2a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:01.638170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:01.638933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:01.639279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:01.639626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users/ac759d3512384ea5b198a0af9a599577` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:01.640444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8f3ce2a9384f44a87ec11f96013d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.640993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ac759d3512384ea5b198a0af9a599577)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:01.641785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8f3ce2a9384f44a87ec11f96013d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.644285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:01.811397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8f3ce2a9384f44a87ec11f96013d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.834429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8f3ce2a9384f44a87ec11f96013d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.835551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-684303e2-b546-4ec5-9421-a5d2529110e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8f3ce2a9384f44a87ec11f96013d09'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.858665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac759d3512384ea5b198a0af9a599577'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.864916 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2394/4774] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:01 2022] DELETE /identity/v3/users/7c8f3ce2a9384f44a87ec11f96013d09 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:01.866636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:01.867028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:01.867460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:01.892205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:01.893974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:01.904373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac759d3512384ea5b198a0af9a599577'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.919560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:01.923036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac759d3512384ea5b198a0af9a599577'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.924185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac759d3512384ea5b198a0af9a599577'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:01.925090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac759d3512384ea5b198a0af9a599577'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:02.000936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2381/4775] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:01 2022] DELETE /identity/v3/users/ac759d3512384ea5b198a0af9a599577 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:02.011626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:02.013492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:02.043882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2395/4776] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:02.056645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:02.058947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:02.203115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0393-1236-4d4c-81ca-9591e5a3b38a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:02.209559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:02.214669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:02.215100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:02.215485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users/da2f8afc12154c819574ccb0a9425704` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:02.218244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_user(user_id=da2f8afc12154c819574ccb0a9425704)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:02.220159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:02.254820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6292223-6690-49b9-9cf1-3e57397c300f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:02.361354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:02.362303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:02.363062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:02.363452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:02.510100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:02.511734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:02.523935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2f8afc12154c819574ccb0a9425704'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:02.543082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2f8afc12154c819574ccb0a9425704'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:02.544744 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2396/4777] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:14:02.562339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2f8afc12154c819574ccb0a9425704'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:02.564067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2f8afc12154c819574ccb0a9425704'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:02.564948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2f8afc12154c819574ccb0a9425704'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:02.668718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2382/4778] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:02 2022] DELETE /identity/v3/users/da2f8afc12154c819574ccb0a9425704 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:02.673129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:02.694923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ce71c-1aed-4ddc-86d1-993cde3c90fc service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:02.845661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:02.846584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:02.846961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:02.847334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/24fe90def57e4d8da84e4a0e6afb4545` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:02.848992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=24fe90def57e4d8da84e4a0e6afb4545)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:02.852305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:03.003096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:03.073234 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2397/4779] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:02 2022] DELETE /identity/v3/groups/24fe90def57e4d8da84e4a0e6afb4545 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:03.075783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:03.079732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:03.113544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129ab1-b55e-4a67-bf80-57efe1a7636c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:03.282707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:03.283419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:03.283809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:03.287419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:03.287419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:03.290347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:03.403248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2383/4780] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:03 2022] POST /identity/v3/groups => generated 324 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:03.404497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:03.425936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda23a2-c08b-4980-bc65-7d269cb03f0a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:03.438508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:03.439272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:03.439459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:03.439741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:03.440411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:03.445371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:03.669427 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2398/4781] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:03 2022] POST /identity/v3/groups => generated 326 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:03.673677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:03.688176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4723c27-f24e-4aa3-acf3-e57b94bbd5c2 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:03.700282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:03.701003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:03.701588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:03.701695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:03.709819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:03.712696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:03.805611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:03.878094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:03.880350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:03.886707 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2384/4782] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:03 2022] POST /identity/v3/groups => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:03.896000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:03.920966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9765af-0d7f-45dd-81e5-c3aa8b773b20 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:03.931734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:03.940569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:03.941057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:03.941694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:03.942634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:03.944116 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:03.944116 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:03.944116 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:03.948595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:03.961437 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2385/4783] 10.222.0.78 () {58 vars in 1125 bytes} [Sun Aug 28 20:14:03 2022] GET /identity/v3/groups => generated 1485 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:03.963386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:03.967214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:04.044395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f2605-6772-415f-9532-eb8fcd7e6b6e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:04.053477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:04.054627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:04.055120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:04.055607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] PATH_INFO: `/v3/projects/61d5a3ea8708484d905ef64529381546` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:04.057706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d5a3ea8708484d905ef64529381546)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:04.060468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:04.131016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996448-29b9-42b0-a7a1-42479301f220 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:04.137722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:04.138811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:04.139241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:04.139630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] PATH_INFO: `/v3/users/d9c11643a65447f4ac9436b623148567` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:04.140948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c11643a65447f4ac9436b623148567)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:04.143047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:04.264015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d5a3ea8708484d905ef64529381546', 'request_id': 'req-9e79182f-2deb-47b4-b6c0-23be48c6ef43'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.289162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d5a3ea8708484d905ef64529381546', 'request_id': 'req-9e79182f-2deb-47b4-b6c0-23be48c6ef43'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.309719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d5a3ea8708484d905ef64529381546', 'request_id': 'req-9e79182f-2deb-47b4-b6c0-23be48c6ef43'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.450563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] The token cache is being invalidate because project 61d5a3ea8708484d905ef64529381546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:04.451500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.452387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.458636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2399/4784] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:03 2022] DELETE /identity/v3/projects/61d5a3ea8708484d905ef64529381546 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:14:04.459716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:04.463523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:04.570689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c11643a65447f4ac9436b623148567'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.635144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c11643a65447f4ac9436b623148567'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.651956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79182f-2deb-47b4-b6c0-23be48c6ef43 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:04.662012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c11643a65447f4ac9436b623148567'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.663370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c11643a65447f4ac9436b623148567'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.665363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c11643a65447f4ac9436b623148567'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:04.666394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ecfa-3b5a-43b9-ab08-001850433193 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:04.667335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ecfa-3b5a-43b9-ab08-001850433193 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:04.671558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ecfa-3b5a-43b9-ab08-001850433193 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:04.673279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ecfa-3b5a-43b9-ab08-001850433193 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/04212d5941fe46388992998684d046c2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:04.719823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597ecfa-3b5a-43b9-ab08-001850433193 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=04212d5941fe46388992998684d046c2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:04.731000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597ecfa-3b5a-43b9-ab08-001850433193 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:04.878040 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2386/4785] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:03 2022] DELETE /identity/v3/users/d9c11643a65447f4ac9436b623148567 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:04.879209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:04.882881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:05.034536 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2400/4786] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:04 2022] DELETE /identity/v3/groups/04212d5941fe46388992998684d046c2 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:05.037045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:05.037688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:05.038258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:05.085619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731fed2-c872-4067-b7c6-b2c95ec3276a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:05.102522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:05.104227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:05.269030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2401/4787] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:05.280055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:05.287227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:05.291528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:05.333473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:05.334181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:05.334470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:05.337883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] PATH_INFO: `/v3/users/f5df03ea86024eb98924a8d538e16c44` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:05.343165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5df03ea86024eb98924a8d538e16c44)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:05.346690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:05.538695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cff04b-4fbb-4722-8321-6a4d3f745e0e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:05.554174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:05.555427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:05.555915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:05.556342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/bd0f46d2141e46e8930f3ebc1341612e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:05.589247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bd0f46d2141e46e8930f3ebc1341612e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:05.593168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:05.776583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5df03ea86024eb98924a8d538e16c44'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:05.813086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5df03ea86024eb98924a8d538e16c44'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:05.892688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5df03ea86024eb98924a8d538e16c44'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:05.894075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5df03ea86024eb98924a8d538e16c44'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:05.894583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2402/4788] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:05 2022] DELETE /identity/v3/groups/bd0f46d2141e46e8930f3ebc1341612e => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:05.896216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:05.899671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5df03ea86024eb98924a8d538e16c44'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:05.906810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:05.915460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:06.012755 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2387/4789] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:04 2022] DELETE /identity/v3/users/f5df03ea86024eb98924a8d538e16c44 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:06.013872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:06.018597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:06.085448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67ff7-f47f-4ec7-ac9c-9894e195ad8a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:06.194865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:06.195299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:06.195780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:06.196665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:06.199141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:06.220959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982407e7-f227-414c-b84b-1637d6727562 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:06.238164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:06.239092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:06.239530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:06.239959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/3f65dbb2abb04a3e83472737a514be2f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:06.259266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3f65dbb2abb04a3e83472737a514be2f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:06.261383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:06.342082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:06.344170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:06.386496 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2403/4790] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:06.446931 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2388/4791] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:06 2022] DELETE /identity/v3/groups/3f65dbb2abb04a3e83472737a514be2f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:06.460762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:06.476134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f21ed-df53-487f-b2e0-9a99fbfaaad8 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:06.589143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:06.590784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:06.591300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:06.591851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:06.592878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:06.595397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:06.740991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:06.755620 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2404/4792] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:06 2022] POST /identity/v3/users => generated 323 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:14:06.768229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90941a6-7b12-45a6-91b7-01246cad415c tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:06.786210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:06.787763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:06.788543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:06.789251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:06.792619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:06.798529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:06.908356 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2389/4793] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:06 2022] POST /identity/v3/groups => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:06.919385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:06.937018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e989e-fd36-4e3b-b9c6-3e0d356e475e tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:06.950703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:06.950703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:06.950703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:06.950936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/959bbd2c275e4389a6aa07da319a2831/users/92f7e98b6c364db0af3ac655988a81e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.019252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=959bbd2c275e4389a6aa07da319a2831, user_id=92f7e98b6c364db0af3ac655988a81e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:07.019910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:07.158362 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2405/4794] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:14:06 2022] PUT /identity/v3/groups/959bbd2c275e4389a6aa07da319a2831/users/92f7e98b6c364db0af3ac655988a81e2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:07.162864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:07.176161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed838fa-faaf-4d4c-a856-aeb1ebd421dc tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:07.189226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:07.312684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:07.315346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:07.315890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:07.316325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.317333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:07.320103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:07.392959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:07.396193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:07.433085 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2390/4795] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:07 2022] POST /identity/v3/groups => generated 326 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:07.434736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:07.465093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a418-fb3f-4ae6-bb47-b6b9553923ab tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:07.472698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:07.476759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:07.481244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:07.483441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:07.485664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/ae6a3406836641faa886d960aa97d4de/users/92f7e98b6c364db0af3ac655988a81e2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.504698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ae6a3406836641faa886d960aa97d4de, user_id=92f7e98b6c364db0af3ac655988a81e2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:07.510809 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:07.510809 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:07.510809 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:07.528012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:07.603828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aecb7f-fe07-477d-be23-fb629b83ee1a tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:07.615502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:07.616376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:07.616964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:07.618877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] PATH_INFO: `/v3/projects/c6e8fa8a33ad461e87fb95fd60cb0e24` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.619803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e8fa8a33ad461e87fb95fd60cb0e24)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:07.622628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:07.682766 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2391/4796] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:14:07 2022] PUT /identity/v3/groups/ae6a3406836641faa886d960aa97d4de/users/92f7e98b6c364db0af3ac655988a81e2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:07.690530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:07.794022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad781-317b-40de-be9f-1e4df057d100 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:07.798639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e8fa8a33ad461e87fb95fd60cb0e24', 'request_id': 'req-de929606-a8ea-4e1c-84e5-87f57071aefb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:07.809927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e8fa8a33ad461e87fb95fd60cb0e24', 'request_id': 'req-de929606-a8ea-4e1c-84e5-87f57071aefb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:07.826911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e8fa8a33ad461e87fb95fd60cb0e24', 'request_id': 'req-de929606-a8ea-4e1c-84e5-87f57071aefb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:07.901462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:07.902870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:07.903190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:07.903517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users/92f7e98b6c364db0af3ac655988a81e2/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.905353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=92f7e98b6c364db0af3ac655988a81e2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:07.908761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:07.943564 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2392/4797] 10.222.0.78 () {58 vars in 1242 bytes} [Sun Aug 28 20:14:07 2022] GET /identity/v3/users/92f7e98b6c364db0af3ac655988a81e2/groups => generated 837 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:07.947986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:07.952346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] The token cache is being invalidate because project c6e8fa8a33ad461e87fb95fd60cb0e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:07.952646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:07.954239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de929606-a8ea-4e1c-84e5-87f57071aefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:07.956540 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2406/4798] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:07 2022] DELETE /identity/v3/projects/c6e8fa8a33ad461e87fb95fd60cb0e24 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:14:07.964395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7f33c-366e-4fcf-bed9-d65f9f7e9cc3 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:07.964787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:07.965341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:07.967567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.971383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55493587-3c79-4e9c-8f83-dae2cb9eeacd tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:07.972569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55493587-3c79-4e9c-8f83-dae2cb9eeacd tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:07.973299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55493587-3c79-4e9c-8f83-dae2cb9eeacd tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:07.973793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55493587-3c79-4e9c-8f83-dae2cb9eeacd tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/ae6a3406836641faa886d960aa97d4de` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:07.976139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55493587-3c79-4e9c-8f83-dae2cb9eeacd tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ae6a3406836641faa886d960aa97d4de)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:07.980594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55493587-3c79-4e9c-8f83-dae2cb9eeacd tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:08.009157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:08.010728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.099386 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2407/4799] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:14:08.100728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:08.108379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.126983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec3202-3dd9-4ede-a9ff-7d6a787ebf01 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:08.130545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:08.135187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:08.136147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.136434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.136703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] PATH_INFO: `/v3/projects/cb71dd0c673b42edb834f63fff053fb2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.138125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb71dd0c673b42edb834f63fff053fb2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:08.140467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:08.180807 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2393/4800] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:07 2022] DELETE /identity/v3/groups/ae6a3406836641faa886d960aa97d4de => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:08.182603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.183061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.183477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.209377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:08.210771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.306876 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2394/4801] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:08.307752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:08.309723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.315200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb71dd0c673b42edb834f63fff053fb2', 'request_id': 'req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:08.322444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb71dd0c673b42edb834f63fff053fb2', 'request_id': 'req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:08.329752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb71dd0c673b42edb834f63fff053fb2', 'request_id': 'req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:08.409902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] The token cache is being invalidate because project cb71dd0c673b42edb834f63fff053fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:08.410221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:08.410539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15f235-1844-4c9b-9a3b-90216f57dd40 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:08.411017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:08.413017 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2408/4802] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:08 2022] DELETE /identity/v3/projects/cb71dd0c673b42edb834f63fff053fb2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:08.417420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:08.418863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.509394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35371861-48a8-4bc6-925a-3d49775fd1ef tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:08.509394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35371861-48a8-4bc6-925a-3d49775fd1ef tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.509394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35371861-48a8-4bc6-925a-3d49775fd1ef tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.510753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35371861-48a8-4bc6-925a-3d49775fd1ef tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/groups/959bbd2c275e4389a6aa07da319a2831` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.510753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35371861-48a8-4bc6-925a-3d49775fd1ef tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_group(group_id=959bbd2c275e4389a6aa07da319a2831)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:08.510753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35371861-48a8-4bc6-925a-3d49775fd1ef tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:08.518719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e3e8-3f3c-436d-b8f3-8596736e7c8a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:08.526101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:08.526927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.527253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.527536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.528354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:08.528562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:08.530368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903734-5107-4a27-a283-ecc291bb250d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:08.547748 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2409/4803] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:08.548825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.549111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.549390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.576561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:08.582497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.589096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2410/4804] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:08.589502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:08.605503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28c5f-bbf9-4eb5-8159-cba7c4f11993 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:08.611983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:08.613084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.613592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.614098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.615094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:08.628328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:08.902747 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2395/4805] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:08 2022] DELETE /identity/v3/groups/959bbd2c275e4389a6aa07da319a2831 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:08.909699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:08.910575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:08.911001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:08.918685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=2,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:08.924191 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2411/4806] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:08 2022] POST /identity/v3/projects => generated 373 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:08.926090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:08.929248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:08.943653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:08.945300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:09.073821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbe2fa-3aa0-41f2-9e6e-3893086e2c0b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:09.084960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:09.085721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:09.086135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:09.086510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/users/92f7e98b6c364db0af3ac655988a81e2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:09.087813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_user(user_id=92f7e98b6c364db0af3ac655988a81e2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:09.089771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:09.090294 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2396/4807] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:09.091978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:09.152976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd01996-a54a-44cc-a344-6d02be67d745 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:09.186831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:09.188639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:09.193519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:09.194364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:09.202223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:09.218353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:09.263228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f7e98b6c364db0af3ac655988a81e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:09.270489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f7e98b6c364db0af3ac655988a81e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:09.420413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f7e98b6c364db0af3ac655988a81e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:09.429002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f7e98b6c364db0af3ac655988a81e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:09.430004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f7e98b6c364db0af3ac655988a81e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:09.457698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2397/4808] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:09 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:09.463696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:09.467307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:09.494182 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2412/4809] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:08 2022] DELETE /identity/v3/users/92f7e98b6c364db0af3ac655988a81e2 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:09.495122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:09.509160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b73a2-99e4-4fc8-8dd5-57063bc27624 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:09.518742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:09.667125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:09.667922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:09.668174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:09.668347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:09.669002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:09.669341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:09.671005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:09.682403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca9689-29bd-412f-bfb9-3fe0c53a3329 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:09.696796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:09.697586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:09.698054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:09.698381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:09.699168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:09.704020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:09.706552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:09.713165 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2398/4810] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:09.714214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:09.717511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:09.730773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2413/4811] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:09.731787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:09.755803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a6b0c-aa0e-40a1-b3fc-4d4c2d527b1c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:09.771351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:09.771968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:09.771968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:09.772576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:09.773125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:09.777707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:09.890471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ab5d-1b1b-435f-9f1c-c832625b2172 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:09.909600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:09.911115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:09.911864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:09.912585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/domains/55759d80858a43db971f66536ec3410d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:09.916293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=55759d80858a43db971f66536ec3410d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:09.922228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:09.961396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2414/4812] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:09 2022] POST /identity/v3/projects => generated 365 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:09.961396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:09.989411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '55759d80858a43db971f66536ec3410d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:09.990766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '55759d80858a43db971f66536ec3410d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.099041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4038-8b26-4409-b8b9-468cee65a7fc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:10.133683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '55759d80858a43db971f66536ec3410d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.134529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '55759d80858a43db971f66536ec3410d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.142168 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2399/4813] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:09 2022] PATCH /identity/v3/domains/55759d80858a43db971f66536ec3410d => generated 276 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:10.144068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:10.144819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:10.235781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:10.240168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:10.240456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:10.240916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:10.241663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:10.244874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:10.247648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f1da-0342-4720-8aa1-17cee6638b27 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:10.256927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:10.257771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:10.259074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:10.259658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:10.261338 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2415/4814] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:10.261555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:10.262777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:10.263773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:10.264802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:10.403789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e1ac-81ff-4efa-8c20-abe13e2aec7d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:10.413639 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2400/4815] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:10 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:10.415967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:10.418514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:10.426830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:10.428426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:10.428876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:10.429314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:10.432696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:10.453318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:10.455299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:10.493501 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2416/4816] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:10.496627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:10.499575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:10.527901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ce01a-692f-44cf-a187-1f50eadaa131 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:10.569084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:10.570534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:10.572033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:10.572738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] PATH_INFO: `/v3/projects/8f278d1c14554c7f8d5ec84350865d23/users/b295fe815513471cbcc60f5053e54e5f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:10.573087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb790-0651-4aac-aff1-81ed879edcac admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:10.587256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee4cf490a7472aad368cc7c9c85e9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:10.589706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:10.589706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:10.589706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] PATH_INFO: `/v3/domains/55759d80858a43db971f66536ec3410d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:10.633721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f278d1c14554c7f8d5ec84350865d23, user_id=b295fe815513471cbcc60f5053e54e5f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:10.640362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=55759d80858a43db971f66536ec3410d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:10.642340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:10.644215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:10.701717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '55759d80858a43db971f66536ec3410d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.709995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '55759d80858a43db971f66536ec3410d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.762824 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2417/4817] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:10 2022] PUT /identity/v3/projects/8f278d1c14554c7f8d5ec84350865d23/users/b295fe815513471cbcc60f5053e54e5f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:10.770058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:10.979464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55759d80858a43db971f66536ec3410d', 'request_id': 'req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.987741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55759d80858a43db971f66536ec3410d', 'request_id': 'req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:10.998090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55759d80858a43db971f66536ec3410d', 'request_id': 'req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.038237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43618dcf-43d0-4083-82e1-edcce485cb4f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:11.086128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] The token cache is being invalidate because project 55759d80858a43db971f66536ec3410d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:11.087478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.088433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.099339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '55759d80858a43db971f66536ec3410d', 'request_id': 'req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.101001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '55759d80858a43db971f66536ec3410d', 'request_id': 'req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.108142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173 tempest-GroupsV3TestJSON-692989359 tempest-GroupsV3TestJSON-692989359-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '55759d80858a43db971f66536ec3410d', 'request_id': 'req-5d5cadbf-f1b4-45c3-af0f-307b22aa4173'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.133978 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2401/4818] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:10 2022] DELETE /identity/v3/domains/55759d80858a43db971f66536ec3410d => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:11.133978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.135098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.135993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.213961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:11.217123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] MFA Rules not processed for user `b295fe815513471cbcc60f5053e54e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:11.217348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.217348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.217348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.217579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:11.217676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:11.217676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:11.246944 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2418/4819] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:11.250107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:11.254614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:11.286241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b94f-1b48-4f2d-9088-b2ad7626bbc1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:11.294414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:11.295155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.295435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.295710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] PATH_INFO: `/v3/users/c5c0b528db9f4f549629253b56d46372` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.297423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c0b528db9f4f549629253b56d46372)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:11.299534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:11.332966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:11.334863 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2402/4820] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:11.335792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:11.339423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:11.360744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8690-db0b-414d-b788-abbb73a3945d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:11.368156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:11.369121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.369509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.369924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.370772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:11.373371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:11.387706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:11.398329 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2403/4821] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:11.414520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:11.414520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:11.460669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa569f38-9d6a-40aa-920c-21f5560d82d1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:11.467430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:11.468072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.468356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.468637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.469631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:11.471677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:11.587865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c0b528db9f4f549629253b56d46372'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.588380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c0b528db9f4f549629253b56d46372'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.599506 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2404/4822] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:11 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:11.600367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:11.698055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f58d-a87a-4c83-8819-af95744db746 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:11.703166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03593477-719d-4b74-8f4d-52adfb4f970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:11.703976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03593477-719d-4b74-8f4d-52adfb4f970f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.704270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03593477-719d-4b74-8f4d-52adfb4f970f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.704557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03593477-719d-4b74-8f4d-52adfb4f970f admin admin] PATH_INFO: `/v3/projects/c235915b28034070bbac4df8bd9a1be6/users/da6d3e8883474a108c8aa226557045c3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.728631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03593477-719d-4b74-8f4d-52adfb4f970f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c235915b28034070bbac4df8bd9a1be6, user_id=da6d3e8883474a108c8aa226557045c3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:11.731346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03593477-719d-4b74-8f4d-52adfb4f970f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:11.751703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c0b528db9f4f549629253b56d46372'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.760894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c0b528db9f4f549629253b56d46372'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.761750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c0b528db9f4f549629253b56d46372'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:11.789902 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2419/4823] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:11 2022] DELETE /identity/v3/users/c5c0b528db9f4f549629253b56d46372 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:11.790779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:11.792174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:11.843081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2405/4824] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:11 2022] PUT /identity/v3/projects/c235915b28034070bbac4df8bd9a1be6/users/da6d3e8883474a108c8aa226557045c3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:11.852861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8838fc-adec-41f7-b143-689f17e2ad65 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.853156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8838fc-adec-41f7-b143-689f17e2ad65 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.853449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8838fc-adec-41f7-b143-689f17e2ad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.878767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7e8838fc-adec-41f7-b143-689f17e2ad65 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:11.880626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e8838fc-adec-41f7-b143-689f17e2ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:11.887789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872b07-7434-44a8-8db1-4498436482c3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:11.954032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:11.954559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.954843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.955150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.955805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:11.957779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:11.961010 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2406/4825] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:11.962532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:11.962827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:11.963102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:11.990573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] MFA Rules not processed for user `da6d3e8883474a108c8aa226557045c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:11.991774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.058384 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2407/4826] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:12.059410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.060918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.076519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d70f1c-9802-45f1-9829-bb9e4d22d812 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.081279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.088528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.088528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.088528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] PATH_INFO: `/v3/users/5d97e2d5250e433aac0568bd508cc461` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.088528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d97e2d5250e433aac0568bd508cc461)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.088528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.118284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2420/4827] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:11 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:12.120862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.120967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.186858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82696-96d8-438b-a715-38d750763444 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.191055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.192013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.192369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.192715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.202899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.204404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.215292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2421/4828] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:12.219363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.219363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.231636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38f6d-9928-4fee-9db4-96752558800c service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.239490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.240222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.240520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.240800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.241449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.244133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.307864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d97e2d5250e433aac0568bd508cc461'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:12.329763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d97e2d5250e433aac0568bd508cc461'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:12.339865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d97e2d5250e433aac0568bd508cc461'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:12.340722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d97e2d5250e433aac0568bd508cc461'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:12.341441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d97e2d5250e433aac0568bd508cc461'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:12.364466 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2422/4829] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:12 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:12.365407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.369612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.439825 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2408/4830] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:12 2022] DELETE /identity/v3/users/5d97e2d5250e433aac0568bd508cc461 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:12.441106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.443342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.456668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e745-f146-441b-a23e-d62738ffa57c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.530527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490ca6-9ac4-46de-9a22-163554a3bd9a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.547210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.548569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.548882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.549164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.549642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7c78-553d-4521-9d2d-18595b01caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.549842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.551533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7c78-553d-4521-9d2d-18595b01caaf admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.551798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.551907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7c78-553d-4521-9d2d-18595b01caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.552536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7c78-553d-4521-9d2d-18595b01caaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.553550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7c78-553d-4521-9d2d-18595b01caaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.556004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7c78-553d-4521-9d2d-18595b01caaf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.569200 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2423/4831] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:12.571020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.571321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.571607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.592729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:12.593795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.603743 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2424/4832] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:12.604752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.615101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04092509-60cd-4317-bbff-c8f289132d99 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.620881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.621562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.621869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.622163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] PATH_INFO: `/v3/projects/bcf63b40037b4e67b370f74a996bb762/users/f7d3471d03854208be3d0129e869186a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.647084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf63b40037b4e67b370f74a996bb762, user_id=f7d3471d03854208be3d0129e869186a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.653967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.654523 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2409/4833] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:12 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:12.655160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.657734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:12.666847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:12.723974 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2425/4834] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:12 2022] PUT /identity/v3/projects/bcf63b40037b4e67b370f74a996bb762/users/f7d3471d03854208be3d0129e869186a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:12.727990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.749139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e261f-43dd-4a69-bfb7-5509d13144f2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.812376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.813354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.813354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.813589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.829657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaac8-5b55-421f-b82d-ba8aae6e1f14 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.831344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.834633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.847442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.848200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.848549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.848903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.850626 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2410/4835] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:12.850775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.851530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.853638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.863306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a21394-11d2-45ff-a54f-c67ad4338426 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.875279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2426/4836] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:12.879592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.879592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.879592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.879592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.879946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.880023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.880098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.895234 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2411/4837] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:12.896371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:12.897202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d76dd-5c17-45ad-9143-c496bad83aaa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.907179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.908373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.908934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.909770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] PATH_INFO: `/v3/projects/b8710e956aa94bd28eca61fd82195283/users/4961e457f06a45aeb0f6005098124559/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.910929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62300620-f51c-4532-b541-670b0fb09ee6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:12.918652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac87c1-3bfb-483e-b6e2-dc1e3ab5659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:12.922813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac87c1-3bfb-483e-b6e2-dc1e3ab5659d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.923095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac87c1-3bfb-483e-b6e2-dc1e3ab5659d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.923383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac87c1-3bfb-483e-b6e2-dc1e3ab5659d admin admin] PATH_INFO: `/v3/projects/bcf63b40037b4e67b370f74a996bb762/users/f7d3471d03854208be3d0129e869186a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.929707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac87c1-3bfb-483e-b6e2-dc1e3ab5659d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf63b40037b4e67b370f74a996bb762, user_id=f7d3471d03854208be3d0129e869186a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.933427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac87c1-3bfb-483e-b6e2-dc1e3ab5659d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.948198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8710e956aa94bd28eca61fd82195283, user_id=4961e457f06a45aeb0f6005098124559, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:12.956011 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2412/4838] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:12 2022] PUT /identity/v3/projects/bcf63b40037b4e67b370f74a996bb762/users/f7d3471d03854208be3d0129e869186a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:12.956352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:12.963391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:12.963747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:12.964101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:12.997661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] MFA Rules not processed for user `f7d3471d03854208be3d0129e869186a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:12.999221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:13.058833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2427/4839] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:12 2022] PUT /identity/v3/projects/b8710e956aa94bd28eca61fd82195283/users/4961e457f06a45aeb0f6005098124559/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:13.063922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.081454 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2413/4840] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:14:13.087291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.104648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafb83e-fe3f-4d2f-a0f2-7ba86de74ddd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.179135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e6a03-d26e-47d0-b602-c5ea71f20b30 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.186138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.186138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.190167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.190167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.190167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.190167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:13.191438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ae2df-c60f-4f61-b4f5-876dd04181fb tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.192141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae2df-c60f-4f61-b4f5-876dd04181fb tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.192492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae2df-c60f-4f61-b4f5-876dd04181fb tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.192852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae2df-c60f-4f61-b4f5-876dd04181fb tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.193627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ae2df-c60f-4f61-b4f5-876dd04181fb tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.195337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ae2df-c60f-4f61-b4f5-876dd04181fb tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:13.200626 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2428/4841] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:14:13.204985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.221133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca562-3d46-4e76-8829-0b679c6a1282 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.221133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.221542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.221823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.222129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] PATH_INFO: `/v3/projects/b8710e956aa94bd28eca61fd82195283/users/4961e457f06a45aeb0f6005098124559/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.224280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8710e956aa94bd28eca61fd82195283, user_id=4961e457f06a45aeb0f6005098124559, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.226826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:13.247514 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2429/4842] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:13 2022] PUT /identity/v3/projects/b8710e956aa94bd28eca61fd82195283/users/4961e457f06a45aeb0f6005098124559/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:14:13.248717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.250620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:13.273508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2414/4843] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:13 2022] POST /identity/v3/services => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:13.276631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.276631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.276631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.295811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:13.337288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] MFA Rules not processed for user `4961e457f06a45aeb0f6005098124559`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:13.339435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:13.382207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac580f8-5af0-4e80-b7fc-bd37e9ce8e66 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.400039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.400723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.401021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.401359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] PATH_INFO: `/v3/projects/41411691b85944e69afe7528b4978632` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.403094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41411691b85944e69afe7528b4978632)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.405002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:13.467194 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2415/4844] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3445 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:13.467194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.571973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41411691b85944e69afe7528b4978632', 'request_id': 'req-2aee302b-68fe-4621-9c7b-c15fec194b5c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:13.581563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41411691b85944e69afe7528b4978632', 'request_id': 'req-2aee302b-68fe-4621-9c7b-c15fec194b5c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:13.591574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41411691b85944e69afe7528b4978632', 'request_id': 'req-2aee302b-68fe-4621-9c7b-c15fec194b5c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:13.592737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba795-8139-4bff-bd61-16b97652ece5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.666995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.667628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.667996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.668180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.668854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.670023 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:13.670023 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:13.670023 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:13.671157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:13.713454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] The token cache is being invalidate because project 41411691b85944e69afe7528b4978632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:13.713765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:13.714587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:13.716232 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2430/4845] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:13 2022] DELETE /identity/v3/projects/41411691b85944e69afe7528b4978632 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:13.717075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.728113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:13.792842 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2416/4846] 10.222.0.78 () {60 vars in 1213 bytes} [Sun Aug 28 20:14:13 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:13.794729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:13.822291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:13.827794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee302b-68fe-4621-9c7b-c15fec194b5c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.834600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.835904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.837077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.837499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.838400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.840146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:13.919145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb585a0a-f85d-4580-b2e8-309c6130e582 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:13.926968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:13.928444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:13.928740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:13.929060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] PATH_INFO: `/v3/users/6fee4cf490a7472aad368cc7c9c85e9f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:13.931566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fee4cf490a7472aad368cc7c9c85e9f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:13.934828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:14.006393 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2431/4847] 10.222.0.78 () {60 vars in 1150 bytes} [Sun Aug 28 20:14:13 2022] POST /identity/v3/domains => generated 276 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:14.006393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:14.014933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:14.103749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6fe4f-b32f-406d-9c84-a3bb2f8beed8 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:14.108973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:14.109717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:14.110037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:14.110319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:14.111154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:14.112833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:14.127417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:14.169967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fee4cf490a7472aad368cc7c9c85e9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.183972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fee4cf490a7472aad368cc7c9c85e9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.191496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fee4cf490a7472aad368cc7c9c85e9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.192317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fee4cf490a7472aad368cc7c9c85e9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.193010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fee4cf490a7472aad368cc7c9c85e9f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.224407 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2432/4848] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:14 2022] POST /identity/v3/services => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:14.225475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:14.227205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:14.307092 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2417/4849] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:13 2022] DELETE /identity/v3/users/6fee4cf490a7472aad368cc7c9c85e9f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:14.308571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:14.311090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:14.318136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa9077-3ee8-47c1-9dd5-432a656e8dc8 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:14.387425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:14.388173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:14.388989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:14.389387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] PATH_INFO: `/v3/projects/54dde84f0a7d48e4afda6718e51659d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:14.390950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dde84f0a7d48e4afda6718e51659d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:14.393540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:14.393716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b897-0308-418a-9338-a8a2025b7ff4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:14.413472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:14.424417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:14.424713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:14.424997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:14.425707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:14.427849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:14.554242 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2418/4850] 10.222.0.78 () {60 vars in 1150 bytes} [Sun Aug 28 20:14:14 2022] POST /identity/v3/domains => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:14.556725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:14.558788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:14.566303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dde84f0a7d48e4afda6718e51659d5', 'request_id': 'req-b460f5a5-42ae-469a-a22d-0086560d718a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.572954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dde84f0a7d48e4afda6718e51659d5', 'request_id': 'req-b460f5a5-42ae-469a-a22d-0086560d718a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.579905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dde84f0a7d48e4afda6718e51659d5', 'request_id': 'req-b460f5a5-42ae-469a-a22d-0086560d718a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.698610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ae559-8786-41f3-9e72-975bfbb9a2c2 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:14.701358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] The token cache is being invalidate because project 54dde84f0a7d48e4afda6718e51659d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:14.701774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.704599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:14.706133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:14.707693 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2433/4851] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:14 2022] DELETE /identity/v3/projects/54dde84f0a7d48e4afda6718e51659d5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:14.708211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:14.708658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:14.711036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:14.712161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:14.712678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:14.714226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:14.714357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:14.814206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f5a5-42ae-469a-a22d-0086560d718a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:14.875848 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2419/4852] 10.222.0.78 () {60 vars in 1213 bytes} [Sun Aug 28 20:14:14 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:14.875848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:14.880177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:14.902430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:14.903507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:14.904381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:14.904755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:14.905532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:14.907312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:14.998748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261045cb-6506-4b45-aa7a-98ae28bc3cc3 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.006509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.020070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.021012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.021319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] PATH_INFO: `/v3/users/e87a07d570184a4ba51fd1d0ecafde8f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.023153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87a07d570184a4ba51fd1d0ecafde8f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.027087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.032317 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2434/4853] 10.222.0.78 () {60 vars in 1150 bytes} [Sun Aug 28 20:14:14 2022] POST /identity/v3/domains => generated 277 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:15.033480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.037066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:15.047892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:15.156108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85416-d0c4-40da-8fe4-0fe07ff7ea06 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.178207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.180013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.180762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.181531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.182390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.183767 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:15.183767 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:15.183767 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:15.185034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.198126 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2435/4854] 10.222.0.78 () {58 vars in 1191 bytes} [Sun Aug 28 20:14:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:15.200099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.203818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:15.238570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87a07d570184a4ba51fd1d0ecafde8f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.267336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87a07d570184a4ba51fd1d0ecafde8f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.279884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87a07d570184a4ba51fd1d0ecafde8f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.280898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87a07d570184a4ba51fd1d0ecafde8f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.281667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87a07d570184a4ba51fd1d0ecafde8f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.286954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17a8ca-d00f-45d2-b50c-fcf30ef79899 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.291713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.292489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.292840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.293188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] PATH_INFO: `/v3/projects/e0bc5ea4d63949c7837d5fb15d83f4f2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.294476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bc5ea4d63949c7837d5fb15d83f4f2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.296473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.388544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2420/4855] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:14 2022] DELETE /identity/v3/users/e87a07d570184a4ba51fd1d0ecafde8f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:15.388544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.390016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:15.476152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'request_id': 'req-5eca6ea2-bd05-4397-b955-42002e283689'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.491262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'request_id': 'req-5eca6ea2-bd05-4397-b955-42002e283689'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.509256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bc5ea4d63949c7837d5fb15d83f4f2', 'request_id': 'req-5eca6ea2-bd05-4397-b955-42002e283689'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.533271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368bc68-941f-4b9d-8d54-c1b62fea6c39 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.600940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.601663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.602634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.602921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.603596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.605217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.605348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] The token cache is being invalidate because project e0bc5ea4d63949c7837d5fb15d83f4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:15.605658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.606674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:15.609184 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2436/4856] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:15 2022] DELETE /identity/v3/projects/e0bc5ea4d63949c7837d5fb15d83f4f2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:15.610273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.612258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:15.690054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6ea2-bd05-4397-b955-42002e283689 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.704280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.705584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.706161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.706748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.707937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a29c3ed1571d4ef6978c9b974fd4e97b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.710349 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:15.710349 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:15.710349 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:15.713672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676089fd-4e3a-4ec8-b26a-4ec318a4479d tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.725492 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2437/4857] 10.222.0.78 () {58 vars in 1290 bytes} [Sun Aug 28 20:14:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b => generated 334 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:15.727910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.728207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.728485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.742986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2421/4858] 10.222.0.78 () {60 vars in 1150 bytes} [Sun Aug 28 20:14:15 2022] POST /identity/v3/domains => generated 279 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:15.744224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.783890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:15.785200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:15.848725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21be23-3ca5-4114-9205-0ca979af1b65 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.855026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.855867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.856446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.856875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.857998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a29c3ed1571d4ef6978c9b974fd4e97b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.859149 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:15.859149 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:15.859149 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:15.860193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.871362 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2422/4859] 10.222.0.78 () {58 vars in 1291 bytes} [Sun Aug 28 20:14:15 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b => generated 0 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 20:14:15.872414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.874387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:15.907430 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2438/4860] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3506 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:15.909486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:15.922602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:15.930670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1049-825e-4458-bd07-94a58dbe97a2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.957577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.957577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.957577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.957961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.957961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a29c3ed1571d4ef6978c9b974fd4e97b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:15.962340 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:15.962340 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:15.962340 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:15.963322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4749a-01d7-4baa-a0d7-bf8d50195f16 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:15.975755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912a5b2-cfa3-4e6d-b900-ffe9a9ee5a86 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:15.981812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:15.983157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:15.983682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:15.984097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/835dd01cc9d54236a726aaffcc86955b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:15.997628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=835dd01cc9d54236a726aaffcc86955b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.000906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.035492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '835dd01cc9d54236a726aaffcc86955b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.040621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '835dd01cc9d54236a726aaffcc86955b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.046107 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2439/4861] 10.222.0.78 () {58 vars in 1293 bytes} [Sun Aug 28 20:14:15 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:16.046107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.046107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.046107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.095516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:16.097340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.116751 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2440/4862] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3506 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:16.117911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.119500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.138763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9b79-2356-4d2c-812f-e2515dcf3b37 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:16.146911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:16.148108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.149345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.149875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] PATH_INFO: `/v3/projects/256cfe3950ba4474a4b2ddcbd0cc1926` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.151849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=256cfe3950ba4474a4b2ddcbd0cc1926)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.157499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.186329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835dd01cc9d54236a726aaffcc86955b', 'request_id': 'req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.198291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835dd01cc9d54236a726aaffcc86955b', 'request_id': 'req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.210610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835dd01cc9d54236a726aaffcc86955b', 'request_id': 'req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.288221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256cfe3950ba4474a4b2ddcbd0cc1926', 'request_id': 'req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.294706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256cfe3950ba4474a4b2ddcbd0cc1926', 'request_id': 'req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.302515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256cfe3950ba4474a4b2ddcbd0cc1926', 'request_id': 'req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.302962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:16.311263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project 835dd01cc9d54236a726aaffcc86955b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:16.311834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.313146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.325480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '835dd01cc9d54236a726aaffcc86955b', 'request_id': 'req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.326669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '835dd01cc9d54236a726aaffcc86955b', 'request_id': 'req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.331469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '835dd01cc9d54236a726aaffcc86955b', 'request_id': 'req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.340053 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2423/4863] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:15 2022] DELETE /identity/v3/domains/835dd01cc9d54236a726aaffcc86955b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:16.341065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.342683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.390339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] The token cache is being invalidate because project 256cfe3950ba4474a4b2ddcbd0cc1926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:16.390653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.391398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.394331 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2441/4864] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:16 2022] DELETE /identity/v3/projects/256cfe3950ba4474a4b2ddcbd0cc1926 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:16.394562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.408217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.448102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20e8a-7fca-43ba-bb3b-9a3ee3c0ba24 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:16.512927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d88f65-c3fc-4bec-8c7a-bd7cee18c98b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:16.515211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:16.515868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.516151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.516508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.517270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.519650 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:16.519650 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:16.519650 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:16.519650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.521614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:16.522539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.524064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.524502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.525326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:16.525806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.528518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.530258 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2424/4865] 10.222.0.78 () {58 vars in 1191 bytes} [Sun Aug 28 20:14:16 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:16.531324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.533884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.559377 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2442/4866] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:16.560574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.571360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.605461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db74aaf-10f2-4636-9d5f-f10426d4eb83 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:16.618953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:16.623549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.623549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.623549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] PATH_INFO: `/v3/users/98b8eddc9f51482bbd6357e8a113fd81` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.623549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b8eddc9f51482bbd6357e8a113fd81)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.626768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.655219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e562-bd6c-4183-954f-edea2690213f tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:16.661089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:16.661826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.662221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.662969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.663398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.665772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.781022 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2425/4867] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:14:16 2022] POST /identity/v3/domains => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:16.781473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.783725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:16.884619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa686-3749-45c3-a0ab-b741bb8e6d98 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:16.890319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:16.891089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:16.894138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:16.894138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:16.894138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a29c3ed1571d4ef6978c9b974fd4e97b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:16.894138 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:16.894138 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:16.894138 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:16.895186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Could not find Endpoint Group: a29c3ed1571d4ef6978c9b974fd4e97b.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a29c3ed1571d4ef6978c9b974fd4e97b. Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 28 20:14:16.916549 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a29c3ed1571d4ef6978c9b974fd4e97b. Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:16.922090 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2426/4868] 10.222.0.78 () {58 vars in 1293 bytes} [Sun Aug 28 20:14:16 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a29c3ed1571d4ef6978c9b974fd4e97b => generated 120 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:16.922539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:16.927559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b8eddc9f51482bbd6357e8a113fd81'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:16.928590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b8eddc9f51482bbd6357e8a113fd81'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.010371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ca48-71bd-4e48-a0c3-caa05a44985e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.020422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.021087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.021532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.021815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.022547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.024736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:17.049218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b8eddc9f51482bbd6357e8a113fd81'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.063508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b8eddc9f51482bbd6357e8a113fd81'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.065211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b8eddc9f51482bbd6357e8a113fd81'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.076498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:17.097813 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2443/4869] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:16 2022] DELETE /identity/v3/users/98b8eddc9f51482bbd6357e8a113fd81 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:17.098435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:17.099943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:17.156043 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2427/4870] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:16 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:17.156043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:17.158161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:17.186297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc1997-222b-4f7b-b1ab-b53d37e72a66 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.256473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b85603-c02e-414c-9fa1-7132cc32164d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.264266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.265145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.265760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.266280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services/241698cd24ca42a08e95f3611be2e557` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.267030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_service(service_id=241698cd24ca42a08e95f3611be2e557)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.270191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:17.275315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.278955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.278955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.278955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/d8ddfa96bd3a473f92974c7d32d96b5b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.290344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d8ddfa96bd3a473f92974c7d32d96b5b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.292612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:17.329278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.330111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.366132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2428/4871] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:17 2022] DELETE /identity/v3/services/241698cd24ca42a08e95f3611be2e557 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:17.367961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:17.373107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:17.454173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.455228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.461504 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2444/4872] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:17 2022] PATCH /identity/v3/domains/d8ddfa96bd3a473f92974c7d32d96b5b => generated 249 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:17.462632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:17.464368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:17.538691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf643-e457-4903-b921-fd3c9f8699fa tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.547678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79f629-6359-4b5a-9935-8c89eebdcd1e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.564742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:17.572212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.572845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.573126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.573400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.574117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.575751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:17.662214 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2445/4873] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:17 2022] POST /identity/v3/services => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:17.663325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:17.669540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:17.677546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.678368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.678779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.679153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.680924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.683864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:17.778307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e705-ac83-4b70-9edd-05fc72119857 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.783636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.784280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.784516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.784827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/d8ddfa96bd3a473f92974c7d32d96b5b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.806405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d8ddfa96bd3a473f92974c7d32d96b5b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.808681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:17.854363 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2429/4874] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:17 2022] POST /identity/v3/users => generated 288 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:17.858664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:17.873229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.881032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:17.888485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03903-4569-44b7-85cd-27bf684bffb7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:17.894785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:17.894785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:17.899768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:17.899768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:17.899768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:17.899768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.003827 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2430/4875] 10.222.0.78 () {60 vars in 1213 bytes} [Sun Aug 28 20:14:17 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:18.005031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.006862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:18.034046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bac96-d084-49e5-8fe7-acc9448da757 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.052952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b', 'request_id': 'req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.060376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b', 'request_id': 'req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.075004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b', 'request_id': 'req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.139190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.139772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.140060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.140336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.140998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.142968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.155960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2431/4876] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:18.157181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.198157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project d8ddfa96bd3a473f92974c7d32d96b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:18.198453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.203350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.223091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b', 'request_id': 'req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.227281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b', 'request_id': 'req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.228034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd8ddfa96bd3a473f92974c7d32d96b5b', 'request_id': 'req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:18.238830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9903dd2-57c6-4b0f-9e2c-b95f29d4c568 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.245430 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2446/4877] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:17 2022] DELETE /identity/v3/domains/d8ddfa96bd3a473f92974c7d32d96b5b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:18.245430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.248181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:18.250272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.250892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.251184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.252026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.252168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.270889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.288145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8901-711a-4d7d-8cbd-5c48930ca0df tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.300101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.300747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.301025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.301304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.302312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.304075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.327512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2447/4878] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:18.328956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.337132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:18.377415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2432/4879] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:18 2022] POST /identity/v3/services => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:18.377415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.419543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce514-0142-4ad4-843a-2d002d374713 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.426116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.426929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.427311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.427706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] PATH_INFO: `/v3/projects/3fab363395904e92a8e9935c83c780b0/users/3ee25ebeb4fc49ff9cf21310a256fdcf/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.457762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fab363395904e92a8e9935c83c780b0, user_id=3ee25ebeb4fc49ff9cf21310a256fdcf, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.466070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.524610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6692603-ff43-40d6-a3ce-333c6e5fa50e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.560418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.562383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.562675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.562955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.563675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.571665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.573817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2433/4880] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:18 2022] PUT /identity/v3/projects/3fab363395904e92a8e9935c83c780b0/users/3ee25ebeb4fc49ff9cf21310a256fdcf/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:18.574692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.587380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:18.756030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2448/4881] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:14:18 2022] POST /identity/v3/domains => generated 278 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:18.756982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:18.759154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:18.762786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9872-5b62-4cb1-95d2-10f00af2a074 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.842961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:18.899021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.900135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.900955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.901786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] PATH_INFO: `/v3/projects/08926c47060d461a85b9e54bd73368ee` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.903585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=08926c47060d461a85b9e54bd73368ee)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.906908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:18.947067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef4b9e-65d5-4efb-a8f7-1ef7b62d772d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:18.969023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:18.969967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:18.970333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:18.970736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ba9f03e7bf5742b398852ffd1ec353ab` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:18.971514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=ba9f03e7bf5742b398852ffd1ec353ab)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:18.974559 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:18.974559 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:18.974559 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:18.980997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b884c4-0023-4a1e-856f-1e18feb59c79 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:19.119685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2449/4882] 10.222.0.78 () {60 vars in 1313 bytes} [Sun Aug 28 20:14:18 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/ba9f03e7bf5742b398852ffd1ec353ab => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:19.122116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:19.122562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:19.122902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:19.140833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08926c47060d461a85b9e54bd73368ee', 'request_id': 'req-02c03dfa-fd59-4f81-b81e-9228f09050fd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.146942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08926c47060d461a85b9e54bd73368ee', 'request_id': 'req-02c03dfa-fd59-4f81-b81e-9228f09050fd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.157711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08926c47060d461a85b9e54bd73368ee', 'request_id': 'req-02c03dfa-fd59-4f81-b81e-9228f09050fd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.186159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] MFA Rules not processed for user `3ee25ebeb4fc49ff9cf21310a256fdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:19.187623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:19.261924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] The token cache is being invalidate because project 08926c47060d461a85b9e54bd73368ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:19.262456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.263340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.270216 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2434/4883] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:18 2022] DELETE /identity/v3/projects/08926c47060d461a85b9e54bd73368ee => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:19.271347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:19.276985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:19.407577 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2450/4884] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3653 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:19.409662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:19.412887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:19.465527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03dfa-fd59-4f81-b81e-9228f09050fd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:19.481257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:19.481953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:19.482249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:19.482533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/90b626d4efa54c30ad26518ef3b16928` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:19.515997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=90b626d4efa54c30ad26518ef3b16928)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:19.520315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:19.570914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '90b626d4efa54c30ad26518ef3b16928'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.573889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '90b626d4efa54c30ad26518ef3b16928'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.608757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca28d-900e-43f7-af59-2e64c9f09c1f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:19.717759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:19.718667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:19.719063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:19.719615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services/2c20c1268a3e4a4ea73e98376d26cbc5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:19.720415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2c20c1268a3e4a4ea73e98376d26cbc5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:19.722156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:19.822203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '90b626d4efa54c30ad26518ef3b16928'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.822203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03f025f3-cdf9-4183-8eb2-3e0a7a947d1b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '90b626d4efa54c30ad26518ef3b16928'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:19.828202 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2435/4885] 10.222.0.78 () {60 vars in 1250 bytes} [Sun Aug 28 20:14:19 2022] PATCH /identity/v3/domains/90b626d4efa54c30ad26518ef3b16928 => generated 278 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:19.829818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:19.830224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:19.830572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:19.870458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:19.871882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:19.878608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:19.888087 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2451/4886] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:19 2022] DELETE /identity/v3/services/2c20c1268a3e4a4ea73e98376d26cbc5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:19.888956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:19.892076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:19.991576 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2436/4887] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3506 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:19.994039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:19.998051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:20.023850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3118a-ad9c-4140-9801-4ded209d8cec tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.024044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:20.038920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.039597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.039972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.040262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.040998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.043276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.152639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e4bf-1d69-4a8a-ae5e-b87593568200 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.163397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58cf52-22a5-461c-abc2-6b2391c0d325 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.164193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58cf52-22a5-461c-abc2-6b2391c0d325 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.168302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58cf52-22a5-461c-abc2-6b2391c0d325 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.168620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58cf52-22a5-461c-abc2-6b2391c0d325 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/90b626d4efa54c30ad26518ef3b16928` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.181551 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2452/4888] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:19 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:20.183403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.190807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:20.196935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58cf52-22a5-461c-abc2-6b2391c0d325 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=90b626d4efa54c30ad26518ef3b16928)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.199077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58cf52-22a5-461c-abc2-6b2391c0d325 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.204641 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2437/4889] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:19 2022] GET /identity/v3/domains/90b626d4efa54c30ad26518ef3b16928 => generated 278 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:20.206020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.206325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.206629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.230846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:20.232289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:20.334207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2438/4890] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:20 2022] POST /identity/v3/auth/tokens => generated 3506 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:20.335359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.350639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80354-6a02-4e10-884f-81ff0b018e46 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.360359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.361083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.361589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.361907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.362577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.370217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.394923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bfa92-7fd9-4da1-9f40-29f12a550437 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.400789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.401373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.401700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.402047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ba9f03e7bf5742b398852ffd1ec353ab` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.406879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=ba9f03e7bf5742b398852ffd1ec353ab)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.406879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.507183 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2439/4891] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:20 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:20.517537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.541416 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2453/4892] 10.222.0.78 () {58 vars in 1293 bytes} [Sun Aug 28 20:14:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/ba9f03e7bf5742b398852ffd1ec353ab => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:20.542710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.564589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd02fe8-044d-458a-9130-dadfd7aa174c tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.578075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.579177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.579177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.579463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.579906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:20.580224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.583577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.618105 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2454/4893] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:20.622366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.648310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfedf10-8d68-4990-b162-23e22dbb8939 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.660781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.662735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.662735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.662735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.662735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.668655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.683993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171041-5421-48d9-b01d-bbda4f168bce admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.691517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.692833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.693201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.702966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/90b626d4efa54c30ad26518ef3b16928` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.703450 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2455/4894] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:20.703562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=90b626d4efa54c30ad26518ef3b16928)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.703653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.703749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.715316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59deb-1874-4bba-a5eb-1b3a9e759930 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.720890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:20.721539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:20.722267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:20.722267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services/3e3ba2bf45874f779218959e44a9a9c8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:20.722737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3e3ba2bf45874f779218959e44a9a9c8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:20.725489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:20.734046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '90b626d4efa54c30ad26518ef3b16928'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:20.740558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '90b626d4efa54c30ad26518ef3b16928'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:20.924091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2456/4895] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:20 2022] DELETE /identity/v3/services/3e3ba2bf45874f779218959e44a9a9c8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:20.925471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:20.957314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f63cb-c8e1-4637-b980-fde8693ee809 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:20.978116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b626d4efa54c30ad26518ef3b16928', 'request_id': 'req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:20.986808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b626d4efa54c30ad26518ef3b16928', 'request_id': 'req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:20.996937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b626d4efa54c30ad26518ef3b16928', 'request_id': 'req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:21.058317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.059018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.059226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.059506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.060705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.062458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:21.111644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project 90b626d4efa54c30ad26518ef3b16928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:21.111942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:21.113049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:21.127721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '90b626d4efa54c30ad26518ef3b16928', 'request_id': 'req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:21.128855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '90b626d4efa54c30ad26518ef3b16928', 'request_id': 'req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:21.133414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '90b626d4efa54c30ad26518ef3b16928', 'request_id': 'req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:21.156448 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2440/4896] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:20 2022] DELETE /identity/v3/domains/90b626d4efa54c30ad26518ef3b16928 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:21.156448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.158352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:21.179652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74fffa-cae5-46f9-b4cd-5e12d8ca627b tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.185700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.186435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.186803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.188036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] PATH_INFO: `/v3/projects/1ad482171307487ebc2d9c0804107ffd/users/557dadc03f0f4be5a5dd8b198c12d123/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.205189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad482171307487ebc2d9c0804107ffd, user_id=557dadc03f0f4be5a5dd8b198c12d123, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.207972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:21.235075 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2457/4897] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:20 2022] POST /identity/v3/projects => generated 393 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:21.241122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.243149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:21.325075 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2441/4898] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:21 2022] PUT /identity/v3/projects/1ad482171307487ebc2d9c0804107ffd/users/557dadc03f0f4be5a5dd8b198c12d123/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:21.326081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.330545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:21.444644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3113-8a64-4bea-a427-bc9e6aec83f1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.490140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e35a9-bd18-45a6-9168-731773061232 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.497658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.497973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.498273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.498500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.499302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.500954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:21.522896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2442/4899] 10.222.0.78 () {58 vars in 1128 bytes} [Sun Aug 28 20:14:21 2022] GET /identity/v3/domains => generated 1346 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:21.522896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.523850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:21.543714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.544383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.544719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.545082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/21a38552e7f34b8da8bccdf4863a0742` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.545664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=21a38552e7f34b8da8bccdf4863a0742)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.548000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:21.704390 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2458/4900] 10.222.0.78 () {58 vars in 1293 bytes} [Sun Aug 28 20:14:21 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/21a38552e7f34b8da8bccdf4863a0742 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:21.708980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.837630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a8aab-3fcd-4484-a663-573a2356dd4e tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.840327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1e8a9-9dee-49cf-b4dd-6f9f3f6fe666 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.842840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.843472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.843774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.844148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.844813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.845265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.845909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.846196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.846493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.846875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:21.847299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.849241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:21.861757 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2459/4901] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:21.861757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.871147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11941-325d-40f5-9b21-efd0cd377ec2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.876265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.881633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.881633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.881633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/90b626d4efa54c30ad26518ef3b16928` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.885676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find domain: 90b626d4efa54c30ad26518ef3b16928.: keystone.exception.DomainNotFound: Could not find domain: 90b626d4efa54c30ad26518ef3b16928. Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 90b626d4efa54c30ad26518ef3b16928. Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:21.891403 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:21.892728 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 90b626d4efa54c30ad26518ef3b16928. Aug 28 20:14:21.893958 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:21.895183 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2460/4902] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:21 2022] PATCH /identity/v3/domains/90b626d4efa54c30ad26518ef3b16928 => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:21.895183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:21.907528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604406-cce2-4ec1-a7a1-2ec0ab9a3564 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:21.913048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d3471d03854208be3d0129e869186a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcf63b40037b4e67b370f74a996bb762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:21.913802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:21.918413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:21.918413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] PATH_INFO: `/v3/services/78bc838151d94443b4bb754b56754a82` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:21.918413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorizing `identity:delete_service(service_id=78bc838151d94443b4bb754b56754a82)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:21.918413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.037398 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2443/4903] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:21 2022] POST /identity/v3/users => generated 297 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:22.039137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.053627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbe70-8f5d-43cd-a253-52c673bdbd30 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:22.061555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:22.062993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.063314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.063518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] PATH_INFO: `/v3/projects/1ad482171307487ebc2d9c0804107ffd/users/557dadc03f0f4be5a5dd8b198c12d123/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.067156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad482171307487ebc2d9c0804107ffd, user_id=557dadc03f0f4be5a5dd8b198c12d123, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:22.069424 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2461/4904] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:21 2022] DELETE /identity/v3/services/78bc838151d94443b4bb754b56754a82 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:22.071127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.075806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.094480 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2444/4905] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:22 2022] PUT /identity/v3/projects/1ad482171307487ebc2d9c0804107ffd/users/557dadc03f0f4be5a5dd8b198c12d123/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:22.095946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.123539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b6713-6ea7-4a3b-8961-2794bb1f9ab0 tempest-EndPointGroupsTest-1653646066 tempest-EndPointGroupsTest-1653646066-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:22.227441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cb30f-572d-4a37-8ada-8629dc87d696 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:22.228126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cb30f-572d-4a37-8ada-8629dc87d696 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.228413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cb30f-572d-4a37-8ada-8629dc87d696 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.228770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cb30f-572d-4a37-8ada-8629dc87d696 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.229942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cb30f-572d-4a37-8ada-8629dc87d696 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:22.232253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9a46-9336-4bee-bd6d-a4ad81c123b5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:22.233096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cb30f-572d-4a37-8ada-8629dc87d696 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.253011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:22.253837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.254151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.254439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.255198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:22.260118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.282559 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2445/4906] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:22.286201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.286201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:22.306140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d0bd-a18e-4e9d-8e0a-3dbdf9593ee1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:22.313801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:22.314511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.314793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.315068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] PATH_INFO: `/v3/users/b295fe815513471cbcc60f5053e54e5f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.316346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b295fe815513471cbcc60f5053e54e5f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:22.318597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.396045 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2462/4907] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:14:22 2022] POST /identity/v3/domains => generated 276 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:22.397006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.397294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.397743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.434926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] MFA Rules not processed for user `557dadc03f0f4be5a5dd8b198c12d123`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:22.436712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:22.528774 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2463/4908] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:22.537365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.588531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b295fe815513471cbcc60f5053e54e5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:22.628695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138f84-47b2-4750-9d08-ce0791f9c10d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:22.633558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b295fe815513471cbcc60f5053e54e5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:22.638298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:22.639022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.639674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.640140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.640875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:22.643285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.646692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b295fe815513471cbcc60f5053e54e5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:22.647770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b295fe815513471cbcc60f5053e54e5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:22.649410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b295fe815513471cbcc60f5053e54e5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:22.663604 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2464/4909] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:22.665132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.667557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:22.828993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299073e9-bb30-4513-96da-b45bf493d31e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:22.842724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:22.843325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:22.843620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:22.843904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:22.844971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:22.849795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:22.876031 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2446/4910] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:22 2022] DELETE /identity/v3/users/b295fe815513471cbcc60f5053e54e5f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:22.882408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:22.882408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:23.018590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c3871-b729-4785-b50a-3a214b52d663 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.051571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.052217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.056156 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2465/4911] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:22 2022] POST /identity/v3/users => generated 346 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:23.056156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:23.056384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.056384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.056994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.058549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:23.061215 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:23.061215 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:23.061215 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:23.062935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf9d39-1755-4fbd-b085-800971faafcf tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.080489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e20fcc-55ad-41a6-ab3d-1880343cd13d tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.166518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.167372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.167664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.167940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] PATH_INFO: `/v3/projects/708261703ec141b5b2556c00a158db18/users/78464ddc392b4ba0bf0f5bc5a4bd0eaa/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.190091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708261703ec141b5b2556c00a158db18, user_id=78464ddc392b4ba0bf0f5bc5a4bd0eaa, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.194670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.225591 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2447/4912] 10.222.0.78 () {60 vars in 1185 bytes} [Sun Aug 28 20:14:22 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:23.225591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.225591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.225591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.264087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:23.265455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:23.302880 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2448/4913] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:23.304854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:23.311299 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2466/4914] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:23 2022] PUT /identity/v3/projects/708261703ec141b5b2556c00a158db18/users/78464ddc392b4ba0bf0f5bc5a4bd0eaa/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:23.314235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:23.390847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:23.405734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba07b8d-9b63-4a54-a4e6-82f489debafd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.434170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada4f3a-bf1f-4b28-8ea5-198892ace126 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.449998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.450954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.451519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.452339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a840f94e8501466f846bf412144716ff` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.453184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a840f94e8501466f846bf412144716ff)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.453666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:23.454624 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:23.454624 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:23.454624 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:23.455884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.470983 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2467/4915] 10.222.0.78 () {58 vars in 1263 bytes} [Sun Aug 28 20:14:23 2022] GET /identity/v3/OS-OAUTH1/consumers/a840f94e8501466f846bf412144716ff => generated 220 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:23.472224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:23.478318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:23.522881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c483907-7af8-48d7-a932-e21cafe6026e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.525135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c483907-7af8-48d7-a932-e21cafe6026e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.525537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c483907-7af8-48d7-a932-e21cafe6026e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.526682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c483907-7af8-48d7-a932-e21cafe6026e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.527418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c483907-7af8-48d7-a932-e21cafe6026e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.532836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c483907-7af8-48d7-a932-e21cafe6026e tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.620505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e2a0-b562-4bdf-9559-ecc1434f2035 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.628637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.629342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.629694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.630467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.656314 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2449/4916] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:23 2022] POST /identity/v3/groups => generated 325 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:23.658251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.658534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.658979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.735326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] MFA Rules not processed for user `78464ddc392b4ba0bf0f5bc5a4bd0eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:23.739373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:23.772307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.784738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.809823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2468/4917] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:23.811098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:23.834789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d66cde-88d1-44eb-ad30-417b9cb9b630 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.853143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.854268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.855351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.855843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a840f94e8501466f846bf412144716ff` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.856622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a840f94e8501466f846bf412144716ff)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.858188 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:23.858188 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:23.858188 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:23.860410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.861184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invalidating token cache because consumer a840f94e8501466f846bf412144716ff has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:23.861656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:23.862687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:23.881797 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2450/4918] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:23.883687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:23.902725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edb640-4d4e-4914-9063-44f229662db4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:23.909145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:23.910232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:23.910674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:23.911106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/c6ad43b64cc049d78824a529819b3381` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:23.912847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c6ad43b64cc049d78824a529819b3381)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:23.915093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:23.979332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c6ad43b64cc049d78824a529819b3381'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:23.982680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c6ad43b64cc049d78824a529819b3381'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:23.990512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a840f94e8501466f846bf412144716ff', 'request_id': 'req-ddd65c0b-3fee-41cf-9589-1366fa9e7387'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:24.066064 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2469/4919] 10.222.0.78 () {58 vars in 1266 bytes} [Sun Aug 28 20:14:23 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a840f94e8501466f846bf412144716ff => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:24.066623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:24.075642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:24.108523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd65c0b-3fee-41cf-9589-1366fa9e7387 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:24.118557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c6ad43b64cc049d78824a529819b3381'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:24.120560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c6ad43b64cc049d78824a529819b3381'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:24.125545 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2451/4920] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:23 2022] PATCH /identity/v3/domains/c6ad43b64cc049d78824a529819b3381 => generated 277 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:24.127533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:24.133619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:24.235182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:24.235813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:24.236096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:24.236372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:24.237020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:24.238986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:24.290039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8115a-5ab4-4aa1-abd0-7acc87f00e25 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:24.302024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:24.302726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:24.303380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:24.304383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:24.305036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:24.308817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:24.405967 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2452/4921] 10.222.0.78 () {60 vars in 1185 bytes} [Sun Aug 28 20:14:24 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:24.407157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:24.413408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:24.413771 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2470/4922] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:24 2022] POST /identity/v3/projects => generated 393 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:24.424438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:24.582554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eeb1a-7140-4b3b-a0a6-58b03c9ce60b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:24.591757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:24.592830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:24.593341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:24.594003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:24.594971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f5fd8c79a2b54d148d04c2e9cd075b02)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:24.596832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:24.605204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845460-202c-4818-8068-189d89e0667d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:24.610827 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2471/4923] 10.222.0.78 () {58 vars in 1263 bytes} [Sun Aug 28 20:14:24 2022] GET /identity/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02 => generated 219 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:24.612095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:24.619264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:24.705504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:24.707667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:24.708086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:24.710760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/c6ad43b64cc049d78824a529819b3381` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:24.716925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05954b9-8a9b-4cf9-bcc7-6e84a2524fe6 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:24.724006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:24.724629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:24.724915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:24.725524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:24.725655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c6ad43b64cc049d78824a529819b3381)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:24.725841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:24.727350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:24.727951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:24.765643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c6ad43b64cc049d78824a529819b3381'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:24.771782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c6ad43b64cc049d78824a529819b3381'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:24.874010 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2472/4924] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:24 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:24.874010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:24.880463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:24.898979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31e87-1c02-4fd5-a1cf-0823cdce75ed admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:24.904445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:24.905295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:24.907793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:24.907793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] PATH_INFO: `/v3/users/6e86c53843374b0b986e5141d078bb03` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:24.907793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e86c53843374b0b986e5141d078bb03)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:24.909929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:25.106482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e6d01f10904f21be3439c25ca6b306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.118587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e6d01f10904f21be3439c25ca6b306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.126618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e6d01f10904f21be3439c25ca6b306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.127470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e6d01f10904f21be3439c25ca6b306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.128561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e6d01f10904f21be3439c25ca6b306'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.190069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e86c53843374b0b986e5141d078bb03'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.191061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e86c53843374b0b986e5141d078bb03'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.241250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:25.299195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e86c53843374b0b986e5141d078bb03'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.307672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e86c53843374b0b986e5141d078bb03'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.308383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e86c53843374b0b986e5141d078bb03'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.331590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ad43b64cc049d78824a529819b3381', 'request_id': 'req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.335210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2473/4925] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:24 2022] DELETE /identity/v3/users/6e86c53843374b0b986e5141d078bb03 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:25.336762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.338329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ad43b64cc049d78824a529819b3381', 'request_id': 'req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.339702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.345781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ad43b64cc049d78824a529819b3381', 'request_id': 'req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.416033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202319d8-905b-4bfb-a89d-09ddc4f003dd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:25.422086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:25.422771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:25.423299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:25.423780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:25.424606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f5fd8c79a2b54d148d04c2e9cd075b02)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:25.426476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:25.426849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invalidating token cache because consumer f5fd8c79a2b54d148d04c2e9cd075b02 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:25.427307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.428207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.438699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project c6ad43b64cc049d78824a529819b3381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:25.439064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.439754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.449735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c6ad43b64cc049d78824a529819b3381', 'request_id': 'req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.451386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c6ad43b64cc049d78824a529819b3381', 'request_id': 'req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.454626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c6ad43b64cc049d78824a529819b3381', 'request_id': 'req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.464882 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2453/4926] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:24 2022] DELETE /identity/v3/domains/c6ad43b64cc049d78824a529819b3381 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:25.464882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.464882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.493236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f5fd8c79a2b54d148d04c2e9cd075b02', 'request_id': 'req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.555951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579274-bd75-4b7e-8e1f-75f0aa0f6ee4 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:25.627224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:25.627870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:25.628155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:25.628436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] PATH_INFO: `/v3/projects/8f278d1c14554c7f8d5ec84350865d23` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:25.629628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f278d1c14554c7f8d5ec84350865d23)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:25.631768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:25.651281 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2474/4927] 10.222.0.78 () {58 vars in 1266 bytes} [Sun Aug 28 20:14:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:25.652211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.660184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.685500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540c2a0-ebd3-4c08-aaba-d2ca2364ab81 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:25.691555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb47402-0a4e-44b9-8807-1b60cf442f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:25.692446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47402-0a4e-44b9-8807-1b60cf442f70 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:25.692796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47402-0a4e-44b9-8807-1b60cf442f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:25.693142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47402-0a4e-44b9-8807-1b60cf442f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:25.694558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb47402-0a4e-44b9-8807-1b60cf442f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:25.695676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb47402-0a4e-44b9-8807-1b60cf442f70 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:25.707235 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2475/4928] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:25.708764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:25.709060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:25.709421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:25.735522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:25.736781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.746468 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2476/4929] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:25.747271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.748562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.819914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f24d4-3744-4159-973d-fee468107d91 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:25.825373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:25.826121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:25.826410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:25.826689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/c6ad43b64cc049d78824a529819b3381` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:25.834399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=c6ad43b64cc049d78824a529819b3381)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:25.836263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find domain: c6ad43b64cc049d78824a529819b3381.: keystone.exception.DomainNotFound: Could not find domain: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:25.865956 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:25.867771 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:25.869148 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2477/4930] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:25 2022] GET /identity/v3/domains/c6ad43b64cc049d78824a529819b3381 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:25.874758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.874758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.874922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f278d1c14554c7f8d5ec84350865d23', 'request_id': 'req-06a4ed8e-108e-442e-84fb-2e6b487e2309'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.879226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f278d1c14554c7f8d5ec84350865d23', 'request_id': 'req-06a4ed8e-108e-442e-84fb-2e6b487e2309'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.886664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e1ab-7ce9-42a5-9469-950f8ed7e6ea tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:25.886925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f278d1c14554c7f8d5ec84350865d23', 'request_id': 'req-06a4ed8e-108e-442e-84fb-2e6b487e2309'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.948997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:25.948997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:25.948997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:25.949397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:25.949397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f5fd8c79a2b54d148d04c2e9cd075b02)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:25.950573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 28 20:14:25.965106 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 20:14:25.966484 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:25.970641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2478/4931] 10.222.0.78 () {58 vars in 1263 bytes} [Sun Aug 28 20:14:25 2022] GET /identity/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02 => generated 74 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:14:25.970641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.970641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:25.979466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] The token cache is being invalidate because project 8f278d1c14554c7f8d5ec84350865d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:25.979770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.980570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:25.982668 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2454/4932] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:25 2022] DELETE /identity/v3/projects/8f278d1c14554c7f8d5ec84350865d23 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:25.983308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:25.984825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.045053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d1c7-1d41-4f52-be1e-99257d16095c tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.050423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.052818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.052818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.052818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] PATH_INFO: `/v3/projects/faa6ce9a17e54431bb19ec7086af6671/users/6c9c428c17eb469187c9c5072709565a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.058900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4ed8e-108e-442e-84fb-2e6b487e2309 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.062493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.063107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.063384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.063711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.065764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.067770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa6ce9a17e54431bb19ec7086af6671, user_id=6c9c428c17eb469187c9c5072709565a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.070823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.079668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.081206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.093326 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2455/4933] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:26.094223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.095626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.100108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:26.171969 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2479/4934] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:25 2022] PUT /identity/v3/projects/faa6ce9a17e54431bb19ec7086af6671/users/6c9c428c17eb469187c9c5072709565a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:26.173232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.175468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.176621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac00729-b8e0-4fc7-add1-23311c546fdc service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.246686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.247854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.248124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.248643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/users/e2e6d01f10904f21be3439c25ca6b306` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.257326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:get_user(user_id=e2e6d01f10904f21be3439c25ca6b306)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.258937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f750434-e79f-45d3-873d-2b655a9b0979 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.259829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.265743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.266647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.267015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.267358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.268137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f5fd8c79a2b54d148d04c2e9cd075b02)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.269820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.270230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invalidating token cache because consumer f5fd8c79a2b54d148d04c2e9cd075b02 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:26.270517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.271242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find user: e2e6d01f10904f21be3439c25ca6b306.: keystone.exception.UserNotFound: Could not find user: e2e6d01f10904f21be3439c25ca6b306. Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 20:14:26.275925 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:26.277190 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e2e6d01f10904f21be3439c25ca6b306. Aug 28 20:14:26.278864 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:26.279917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2456/4935] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:14:26 2022] GET /identity/v3/users/e2e6d01f10904f21be3439c25ca6b306 => generated 110 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:26.281078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.283171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 28 20:14:26.290765 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 20:14:26.291922 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:26.292624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2480/4936] 10.222.0.78 () {58 vars in 1266 bytes} [Sun Aug 28 20:14:26 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f5fd8c79a2b54d148d04c2e9cd075b02 => generated 74 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:14:26.293390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.297644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.364775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc6ac-adae-4157-8285-09d5def5dc34 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.371745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.372837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.373311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.373767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] PATH_INFO: `/v3/users/f7d3471d03854208be3d0129e869186a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.375380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d3471d03854208be3d0129e869186a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.381173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.388151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:26.399553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd9b59-83b8-4321-804a-e1df69d03f2d tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.404899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.405648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.406115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.406571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.407123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.408899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.427252 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2481/4937] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:26.428265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.430540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.445603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34410e-5b02-446d-907e-0dd02e707ff2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.450435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.451088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.454152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.454525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/groups/fa25fb8f26734b1f92e07061a513c3f9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.460210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:get_group(group_id=fa25fb8f26734b1f92e07061a513c3f9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.462902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find group: fa25fb8f26734b1f92e07061a513c3f9.: keystone.exception.GroupNotFound: Could not find group: fa25fb8f26734b1f92e07061a513c3f9. Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 28 20:14:26.478941 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:26.479966 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fa25fb8f26734b1f92e07061a513c3f9. Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2482/4938] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:26 2022] GET /identity/v3/groups/fa25fb8f26734b1f92e07061a513c3f9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:26.481044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.482366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.502188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec100f-b7c5-45e0-ae69-c0b48a959953 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.507147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.508259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.508542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.508821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.509467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.510589 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:26.510589 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:26.510589 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:26.512747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.632969 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2483/4939] 10.222.0.78 () {60 vars in 1185 bytes} [Sun Aug 28 20:14:26 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:26.633179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d3471d03854208be3d0129e869186a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.634502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.649380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865ce2c-13b6-4748-be63-122e469d4dfa tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.652522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d3471d03854208be3d0129e869186a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.656483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.660858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.660858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.660858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] PATH_INFO: `/v3/projects/faa6ce9a17e54431bb19ec7086af6671/users/6c9c428c17eb469187c9c5072709565a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.661561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d3471d03854208be3d0129e869186a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.662390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d3471d03854208be3d0129e869186a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.663073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d3471d03854208be3d0129e869186a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:26.664341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa6ce9a17e54431bb19ec7086af6671, user_id=6c9c428c17eb469187c9c5072709565a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:26.668324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:26.684716 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2484/4940] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:26 2022] PUT /identity/v3/projects/faa6ce9a17e54431bb19ec7086af6671/users/6c9c428c17eb469187c9c5072709565a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:26.686468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.688422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.764105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2457/4941] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:26 2022] DELETE /identity/v3/users/f7d3471d03854208be3d0129e869186a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:26.765296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:26.770207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:26.890902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deede6dd-11a2-45f7-be14-64298cbbf544 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.971314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6adffa-263b-4304-a73e-4a5c51af4fc0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:26.983724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:26.984385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:26.984737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:26.985203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/groups/fa25fb8f26734b1f92e07061a513c3f9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:26.992793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find group: fa25fb8f26734b1f92e07061a513c3f9.: keystone.exception.GroupNotFound: Could not find group: fa25fb8f26734b1f92e07061a513c3f9. Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 28 20:14:27.013732 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:27.014902 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fa25fb8f26734b1f92e07061a513c3f9. Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:27.016088 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2458/4942] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:14:26 2022] DELETE /identity/v3/groups/fa25fb8f26734b1f92e07061a513c3f9 => generated 111 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:27.017178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.017178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.017359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.017359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.017359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.017359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] PATH_INFO: `/v3/projects/dbfadcbfe7c441b4b518a61f64b76f33` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.017704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfadcbfe7c441b4b518a61f64b76f33)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.020428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.129630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3af3-c86c-4518-8be8-a509081c32ac tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.135404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863375f-569c-4af8-a5dc-034360f35b10 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.136002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863375f-569c-4af8-a5dc-034360f35b10 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.136287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863375f-569c-4af8-a5dc-034360f35b10 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.136563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863375f-569c-4af8-a5dc-034360f35b10 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.137328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863375f-569c-4af8-a5dc-034360f35b10 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.138944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863375f-569c-4af8-a5dc-034360f35b10 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.160433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfadcbfe7c441b4b518a61f64b76f33', 'request_id': 'req-24f71acf-59d4-491a-be6b-1cb8ffe5f357'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.167645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfadcbfe7c441b4b518a61f64b76f33', 'request_id': 'req-24f71acf-59d4-491a-be6b-1cb8ffe5f357'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.176117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfadcbfe7c441b4b518a61f64b76f33', 'request_id': 'req-24f71acf-59d4-491a-be6b-1cb8ffe5f357'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.224221 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2459/4943] 10.222.0.78 () {60 vars in 1185 bytes} [Sun Aug 28 20:14:27 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:27.225598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.225928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.226295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.260241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] MFA Rules not processed for user `6c9c428c17eb469187c9c5072709565a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:27.261754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.281278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] The token cache is being invalidate because project dbfadcbfe7c441b4b518a61f64b76f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:27.281278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.282020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.287362 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2485/4944] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:26 2022] DELETE /identity/v3/projects/dbfadcbfe7c441b4b518a61f64b76f33 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:27.287362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.287362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.377321 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2460/4945] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:27.379727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.385267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.429437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71acf-59d4-491a-be6b-1cb8ffe5f357 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.435467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.436115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.436397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.436672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/users/e2e6d01f10904f21be3439c25ca6b306` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.446952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e2e6d01f10904f21be3439c25ca6b306)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.449048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-645724d9-c24a-4994-831b-a4e772eda26a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find user: e2e6d01f10904f21be3439c25ca6b306.: keystone.exception.UserNotFound: Could not find user: e2e6d01f10904f21be3439c25ca6b306. Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 28 20:14:27.470240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:27.472015 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: e2e6d01f10904f21be3439c25ca6b306. Aug 28 20:14:27.473061 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:27.474121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6731d5-2e20-439d-99bf-ed80c80da62c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.474208 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2486/4946] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:27 2022] DELETE /identity/v3/users/e2e6d01f10904f21be3439c25ca6b306 => generated 110 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:27.474208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad5ff4-76cb-45e7-ade1-8b38a739fd14 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.474536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad5ff4-76cb-45e7-ade1-8b38a739fd14 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.475024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad5ff4-76cb-45e7-ade1-8b38a739fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.484565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.485218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.485508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.485791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.486528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.487635 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:27.487635 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:27.487635 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:27.488556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.497217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-44ad5ff4-76cb-45e7-ade1-8b38a739fd14 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:27.498474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-44ad5ff4-76cb-45e7-ade1-8b38a739fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.520913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2461/4947] 10.222.0.78 () {58 vars in 1164 bytes} [Sun Aug 28 20:14:27 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:27.525713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.532235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.578743 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2487/4948] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:27.579469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c4f67-19d1-42de-be3c-a1ba04456d88 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.579756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c4f67-19d1-42de-be3c-a1ba04456d88 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.580024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c4f67-19d1-42de-be3c-a1ba04456d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.615902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534283-205e-4aec-8c95-3b5c71a0783b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.624025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.629045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.629045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.629045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.644454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.647169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.652009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d78c4f67-19d1-42de-be3c-a1ba04456d88 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:27.652009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d78c4f67-19d1-42de-be3c-a1ba04456d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.664086 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2462/4949] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:27.665256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.678365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fb8c-4aa0-402d-9a99-5058f5a35857 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.686514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.687164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.687461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.687722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/c6ad43b64cc049d78824a529819b3381` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.698692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find domain: c6ad43b64cc049d78824a529819b3381.: keystone.exception.DomainNotFound: Could not find domain: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:27.706808 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:27.707846 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:27.708890 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:27.709874 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2463/4950] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:27 2022] PATCH /identity/v3/domains/c6ad43b64cc049d78824a529819b3381 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:27.710632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.745433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7a6f-afe0-472a-a78c-578167ad2e71 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.755674 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2488/4951] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:14:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:27.758062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.758452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.758870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.760954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.761636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.761955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.762230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/35b1e8c25ca3422691905e4145721252` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.762833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=35b1e8c25ca3422691905e4145721252)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.764312 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:27.764312 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:27.764312 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:27.767365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.767654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invalidating token cache because consumer 35b1e8c25ca3422691905e4145721252 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:27.767950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.770566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:27.782524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:27.808581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:27.809290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.822014 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2489/4952] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:27.822014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:27.823893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:27.836710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d653-c8a0-48f1-b4fb-57efac27edf4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:27.843167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:27.843817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:27.844095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:27.844366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] PATH_INFO: `/v3/projects/bcf63b40037b4e67b370f74a996bb762` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:27.846118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf63b40037b4e67b370f74a996bb762)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:27.848024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:27.904316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '35b1e8c25ca3422691905e4145721252', 'request_id': 'req-2b0e5580-dc4b-47be-a965-459b31b91b14'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.001698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2464/4953] 10.222.0.78 () {58 vars in 1266 bytes} [Sun Aug 28 20:14:27 2022] DELETE /identity/v3/OS-OAUTH1/consumers/35b1e8c25ca3422691905e4145721252 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:28.003046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.003549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf63b40037b4e67b370f74a996bb762', 'request_id': 'req-a20ad73e-7201-45c9-9b52-b7d5d4810b74'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.005650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.009884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf63b40037b4e67b370f74a996bb762', 'request_id': 'req-a20ad73e-7201-45c9-9b52-b7d5d4810b74'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.017176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf63b40037b4e67b370f74a996bb762', 'request_id': 'req-a20ad73e-7201-45c9-9b52-b7d5d4810b74'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.022272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e5580-dc4b-47be-a965-459b31b91b14 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.055739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:28.094914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.095641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.095925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.096200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.097001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.098651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.124304 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2465/4954] 10.222.0.78 () {58 vars in 1128 bytes} [Sun Aug 28 20:14:28 2022] GET /identity/v3/domains => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:28.124855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.125187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] The token cache is being invalidate because project bcf63b40037b4e67b370f74a996bb762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:28.125502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.126574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.126958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.136390 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2490/4955] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:27 2022] DELETE /identity/v3/projects/bcf63b40037b4e67b370f74a996bb762 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:28.137319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.138781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.204703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df0b9-872e-403b-8d8c-e52aa674e538 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.209895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.211440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.215913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.215913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.215913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.229468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ad73e-7201-45c9-9b52-b7d5d4810b74 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.237247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.238405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.239258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.239801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.240784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:28.241251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.243507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.258019 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2491/4956] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:28.259165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.261204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.302258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.305233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.327891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2466/4957] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:28.329029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.331660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.416511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732fea1-a313-4c94-bea5-bed314b3b593 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.430920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.431631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.432210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.433540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.436086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.449241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:28.460330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58616d01-3b2f-4424-ad9d-15bb10f2e124 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.475152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.478455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.478706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.479000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/941acc36c3054e0f9e631f538147228d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.479626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=941acc36c3054e0f9e631f538147228d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.481692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.482405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invalidating token cache because consumer 941acc36c3054e0f9e631f538147228d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:28.482743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.486644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.552807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.554278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.564619 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2492/4958] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:14:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:14:28.565843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.568420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.590073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c8626-20ab-4a36-b131-6fd620bbb426 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.609339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.610154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.610461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.610756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.612119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:28.612439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.614643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a6f9-7a8c-463d-a940-fffb52a77c72 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.616804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '941acc36c3054e0f9e631f538147228d', 'request_id': 'req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:28.647490 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2493/4959] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:28 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:28.649630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.650005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.650385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.678562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:28.682550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.706173 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2494/4960] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:28.707356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.710062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.730214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf43e-1925-4c20-8f0a-d8084f31692a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.738519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.739280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.739653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.740221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.740929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.743655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.747632 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2467/4961] 10.222.0.78 () {58 vars in 1266 bytes} [Sun Aug 28 20:14:28 2022] DELETE /identity/v3/OS-OAUTH1/consumers/941acc36c3054e0f9e631f538147228d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:28.748796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.750282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.808336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caea5f-752c-4b4c-a7c5-ea2272ae4f5b tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:28.821950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:28.823259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.823581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.823864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.824831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-847401361) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:28.825263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:28.828613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc76451-5df7-4ef3-934a-dbec0ae4920f tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:28.861314 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2468/4962] 10.222.0.78 () {58 vars in 1197 bytes} [Sun Aug 28 20:14:28 2022] GET /identity/v3/domains?name=tempest-test_domain-847401361 => generated 407 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:28.863305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:28.864130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:28.864425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:28.872374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2495/4963] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:28 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:28.873576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:28.886358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:28.925599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:28.927829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:29.036159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae64a-4aac-45be-b6cf-5ac87e438479 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.041670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.042331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.042621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.042900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.043557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.046509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.068973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2469/4964] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:29.070282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.087460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467007c-ec28-4bd3-b886-10d19b9d69a3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.093625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.098466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.099037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.099545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.100560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.103207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.155328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2496/4965] 10.222.0.78 () {60 vars in 1185 bytes} [Sun Aug 28 20:14:28 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:29.155328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.198400 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2470/4966] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:29 2022] POST /identity/v3/users => generated 281 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:29.199772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.218257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f587e0-ea2b-4573-9bcb-f132d92a76b4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.237051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.238121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.238632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.239675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.240538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:29.241293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.245368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.267579 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2471/4967] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:29.268790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.276179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:29.289774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518b06-774a-419b-a021-11e2a9cd70f3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.296472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.297646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.298611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.299373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1da41bc08d5c4cb7ac86fb4011481be9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.300205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=1da41bc08d5c4cb7ac86fb4011481be9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.301553 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:29.301553 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:29.301553 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:29.302932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.313615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336841b-ef73-4251-ac06-6f9869d90a2f tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.324096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.326156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.326596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.327585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/c6ad43b64cc049d78824a529819b3381` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.337020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Could not find domain: c6ad43b64cc049d78824a529819b3381.: keystone.exception.DomainNotFound: Could not find domain: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:29.344576 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:29.345809 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c6ad43b64cc049d78824a529819b3381. Aug 28 20:14:29.347323 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:14:29.353939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2497/4968] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:29 2022] PATCH /identity/v3/domains/c6ad43b64cc049d78824a529819b3381 => generated 112 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:29.353939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.380493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58764fce-7ce7-4122-ac80-d26be45b6183 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.387481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.388384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.388742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.389110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.390189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.391973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.417043 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2498/4969] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:29.421867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.430831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6375ccd-24e1-47c6-91a5-6387ed91d158 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.437159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.437786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.438164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.438445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.439169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.441263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.462312 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2472/4970] 10.222.0.78 () {60 vars in 1285 bytes} [Sun Aug 28 20:14:29 2022] PATCH /identity/v3/OS-OAUTH1/consumers/1da41bc08d5c4cb7ac86fb4011481be9 => generated 221 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:29.462312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.489761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9f927-95c2-46a8-9156-b25b062eb754 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.532351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.532351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.532599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.532715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/b5f2a8fed3ef47b4974c665bf3fb6329` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.569715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b5f2a8fed3ef47b4974c665bf3fb6329)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.572250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.602766 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2499/4971] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:29 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:29.604102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.757214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2473/4972] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:29 2022] PATCH /identity/v3/domains/b5f2a8fed3ef47b4974c665bf3fb6329 => generated 277 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:29.775288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.810627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc05c-5ef6-40c6-8c0a-c9bb92808594 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.817802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e761379-b340-4aaf-a1ee-19985d688682 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.832490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.833024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.833317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.833616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.834356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.836469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.864999 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2500/4973] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:29.868528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:29.892323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6fcc6-823e-43f9-bc12-cfa7fe807cb9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:29.905437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.906604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.907128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.907420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.910492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.915484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:29.990173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:29.991009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:29.991312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:29.991761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1da41bc08d5c4cb7ac86fb4011481be9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:29.992674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=1da41bc08d5c4cb7ac86fb4011481be9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:29.994075 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:29.994075 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:29.994075 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:29.995299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:30.011134 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2474/4974] 10.222.0.78 () {58 vars in 1263 bytes} [Sun Aug 28 20:14:29 2022] GET /identity/v3/OS-OAUTH1/consumers/1da41bc08d5c4cb7ac86fb4011481be9 => generated 221 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:30.011134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:30.041922 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2501/4975] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:29 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:30.044736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:30.083164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b951f89-1866-41f5-a566-2e6737bdc50f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:30.108357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:30.108357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:30.108357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:30.109018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:30.109102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] PATH_INFO: `/v3/projects/7bde489733d74997bbf7cc07010591e3/users/f595c2f769814bcfaf1ff3429c0377d1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:30.139476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bde489733d74997bbf7cc07010591e3, user_id=f595c2f769814bcfaf1ff3429c0377d1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:30.142276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:30.245797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a0e8-c057-42fe-82f7-ed0385e8b524 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:30.258920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:30.261446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:30.263616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:30.263616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/b5f2a8fed3ef47b4974c665bf3fb6329` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:30.297213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b5f2a8fed3ef47b4974c665bf3fb6329)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:30.301029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:30.336655 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2502/4976] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:30 2022] PUT /identity/v3/projects/7bde489733d74997bbf7cc07010591e3/users/f595c2f769814bcfaf1ff3429c0377d1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:30.337900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:30.348464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.366680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.466694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7bc4-6b1f-43ec-af35-780bcb3211d9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:30.476186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557dadc03f0f4be5a5dd8b198c12d123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ad482171307487ebc2d9c0804107ffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:30.478392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:30.479280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:30.480267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1da41bc08d5c4cb7ac86fb4011481be9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:30.481490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1da41bc08d5c4cb7ac86fb4011481be9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:30.483396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:30.485020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invalidating token cache because consumer 1da41bc08d5c4cb7ac86fb4011481be9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:30.485491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.486706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.515489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329', 'request_id': 'req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.541210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329', 'request_id': 'req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.574335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329', 'request_id': 'req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.601871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-270f08fb-b737-4361-aad5-ac7568459a38 tempest-OAUTHConsumersV3Test-978317208 tempest-OAUTHConsumersV3Test-978317208-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1da41bc08d5c4cb7ac86fb4011481be9', 'request_id': 'req-270f08fb-b737-4361-aad5-ac7568459a38'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.716310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project b5f2a8fed3ef47b4974c665bf3fb6329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:30.716587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.722324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.734359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329', 'request_id': 'req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.735176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329', 'request_id': 'req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.744118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b5f2a8fed3ef47b4974c665bf3fb6329', 'request_id': 'req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:30.763017 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2475/4977] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:30 2022] DELETE /identity/v3/domains/b5f2a8fed3ef47b4974c665bf3fb6329 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:30.764142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:30.766145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:30.784809 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2503/4978] 10.222.0.78 () {58 vars in 1266 bytes} [Sun Aug 28 20:14:30 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1da41bc08d5c4cb7ac86fb4011481be9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:30.786763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:30.787048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:30.788593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:30.861533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] MFA Rules not processed for user `f595c2f769814bcfaf1ff3429c0377d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:30.865737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:30.955155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63171f-e1e1-4f41-95fb-c2112aa6b0f3 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:30.967364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:30.969616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:30.970298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:30.970577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:30.970849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:30.971514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:30.973150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:30.997315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2476/4979] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:30.998230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:31.001944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:31.049489 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2504/4980] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:31.049489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:31.049489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:31.064828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314cd2e-5a99-4e59-bcaf-e2682f45bfcf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:31.071075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:31.071717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:31.072309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:31.072820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] PATH_INFO: `/v3/users/3ee25ebeb4fc49ff9cf21310a256fdcf` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:31.074096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee25ebeb4fc49ff9cf21310a256fdcf)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:31.088463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:31.171737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a78e3-c8aa-4053-ad6a-391f446eeb7b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:31.176830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:31.177406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:31.177692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:31.178003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/122b1bd2e999425a868550ae274ca324` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:31.192236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=122b1bd2e999425a868550ae274ca324)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:31.195385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:31.226251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '122b1bd2e999425a868550ae274ca324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.227424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '122b1bd2e999425a868550ae274ca324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.401827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '122b1bd2e999425a868550ae274ca324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.405063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '122b1bd2e999425a868550ae274ca324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.425603 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2477/4981] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:30 2022] PATCH /identity/v3/domains/122b1bd2e999425a868550ae274ca324 => generated 276 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:31.432047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:31.451237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee25ebeb4fc49ff9cf21310a256fdcf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.453555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:31.454244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee25ebeb4fc49ff9cf21310a256fdcf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.540072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee25ebeb4fc49ff9cf21310a256fdcf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.560237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee25ebeb4fc49ff9cf21310a256fdcf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.563729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee25ebeb4fc49ff9cf21310a256fdcf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.576902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408ea6-6cbb-4e35-b6ca-c13c2d18792c tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:31.583525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:31.584191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:31.584478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:31.584759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:31.586002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:31.587986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:31.602760 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2478/4982] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:31.603792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:31.606397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:31.698469 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2505/4983] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:31 2022] DELETE /identity/v3/users/3ee25ebeb4fc49ff9cf21310a256fdcf => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:31.699720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:31.701401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:31.729133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4df20d-1a72-4ace-8a2c-29b9c18e482f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:31.783824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:31.784541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:31.784880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:31.785224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:31.787209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:31.799845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d4f4-6ac0-49f0-8820-24eae7e12918 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:31.807141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:31.809184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:31.809551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:31.810057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/122b1bd2e999425a868550ae274ca324` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:31.843745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=122b1bd2e999425a868550ae274ca324)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:31.846171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:31.865115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:31.877641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '122b1bd2e999425a868550ae274ca324'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.883676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '122b1bd2e999425a868550ae274ca324'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:31.950241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:31.953687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:31.973126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:31.993559 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2479/4984] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:31.996861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:31.999432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:32.052450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122b1bd2e999425a868550ae274ca324', 'request_id': 'req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.058397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122b1bd2e999425a868550ae274ca324', 'request_id': 'req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.075588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122b1bd2e999425a868550ae274ca324', 'request_id': 'req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.167379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project 122b1bd2e999425a868550ae274ca324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:32.167887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.172100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.208809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f351-9f46-430f-b266-6f003557bc0d service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:32.214847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '122b1bd2e999425a868550ae274ca324', 'request_id': 'req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.235160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '122b1bd2e999425a868550ae274ca324', 'request_id': 'req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.238840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '122b1bd2e999425a868550ae274ca324', 'request_id': 'req-1c56da2e-06b6-4fdb-abb2-e07a90e571d7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.262475 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2506/4985] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:31 2022] DELETE /identity/v3/domains/122b1bd2e999425a868550ae274ca324 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:32.269299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:32.269675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:32.269799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:32.297613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:32.298991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:32.345378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:32.346275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:32.346718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:32.347100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] PATH_INFO: `/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b/users/b87fa683cd264a309448d5cbb8ed3f68/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:32.381421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95d74f0b70343ea8e1b78518b3aed1b, user_id=b87fa683cd264a309448d5cbb8ed3f68, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:32.384461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:32.422096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2507/4986] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:32.422096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:32.422096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:32.440604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ef499-e9f8-421f-8e88-47c3f6c57945 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:32.454771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:32.455331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:32.457567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:32.458877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] PATH_INFO: `/v3/users/3a7700aca8a14e1bae6e45e5d52e439c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:32.462768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7700aca8a14e1bae6e45e5d52e439c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:32.468093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:32.494374 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2480/4987] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:31 2022] PUT /identity/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b/users/b87fa683cd264a309448d5cbb8ed3f68/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:32.495234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:32.505785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:32.626517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984861b5-1012-4fad-abc5-b447422a7583 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:32.640891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:32.641570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:32.641878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:32.642161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/f731b40e06c243f786cd5dc751da2d2a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:32.681240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f731b40e06c243f786cd5dc751da2d2a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:32.683267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:32.745788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.753523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.807229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7700aca8a14e1bae6e45e5d52e439c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.808148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7700aca8a14e1bae6e45e5d52e439c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.901988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.906978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.927340 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2481/4988] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:32 2022] PATCH /identity/v3/domains/f731b40e06c243f786cd5dc751da2d2a => generated 277 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:32.927340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:32.930726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:32.955330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7700aca8a14e1bae6e45e5d52e439c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.960894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7700aca8a14e1bae6e45e5d52e439c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:32.962897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bec1dc1b-9606-4c85-b601-746b536f8625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7700aca8a14e1bae6e45e5d52e439c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:33.114612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2508/4989] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:32 2022] DELETE /identity/v3/users/3a7700aca8a14e1bae6e45e5d52e439c => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:33.123314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:33.123942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:33.125246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:33.249751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef33b2-36ef-44f8-ba5f-53a9bcfad726 tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:33.251448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] MFA Rules not processed for user `b87fa683cd264a309448d5cbb8ed3f68`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:33.258886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:33.435531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:33.436125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:33.438036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:33.438271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:33.443049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:33.473582 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2509/4990] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:33.473582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:33.473582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:33.579839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5b6f-4f5c-4bef-990d-e1c3978cbc0c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:33.591750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4961e457f06a45aeb0f6005098124559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8710e956aa94bd28eca61fd82195283', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:33.592419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:33.592701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:33.592974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] PATH_INFO: `/v3/domains/f731b40e06c243f786cd5dc751da2d2a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:33.598391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:33.603232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:33.622716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f731b40e06c243f786cd5dc751da2d2a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:33.624631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:33.633596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2482/4991] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:33.634879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:33.639484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:33.671987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca596ba-fd72-42fe-bbb5-1e6973a70e4e service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:33.685164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:33.686609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:33.687112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:33.687623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:33.688560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:33.690596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:33.691054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:33.700459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:33.927446 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2483/4992] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:33 2022] POST /identity/v3/projects => generated 389 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:33.929767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:33.937115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a', 'request_id': 'req-074fbd2e-fe52-43cc-9736-03dda6327c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:33.937370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:33.963360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a', 'request_id': 'req-074fbd2e-fe52-43cc-9736-03dda6327c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.008410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a', 'request_id': 'req-074fbd2e-fe52-43cc-9736-03dda6327c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.117284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] The token cache is being invalidate because project f731b40e06c243f786cd5dc751da2d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:34.118046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.118953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.123547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf93a70-31ad-422e-9b16-38f8b51cd93b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:34.135752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a', 'request_id': 'req-074fbd2e-fe52-43cc-9736-03dda6327c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.141416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:34.142155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a', 'request_id': 'req-074fbd2e-fe52-43cc-9736-03dda6327c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.142967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f731b40e06c243f786cd5dc751da2d2a', 'request_id': 'req-074fbd2e-fe52-43cc-9736-03dda6327c8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.143353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:34.146510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:34.148044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:34.148497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] PATH_INFO: `/v3/projects/92dac742c70b4d3c93fa3d6707136cd2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:34.150236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92dac742c70b4d3c93fa3d6707136cd2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:34.152886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:34.155008 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2510/4993] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:33 2022] DELETE /identity/v3/domains/f731b40e06c243f786cd5dc751da2d2a => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:34.156799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:34.158824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:34.273005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbd2e-fe52-43cc-9736-03dda6327c8a tempest-DomainsTestJSON-1543836960 tempest-DomainsTestJSON-1543836960-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:34.281716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:34.282541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:34.282895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:34.283223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:34.283969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:34.286098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:34.569585 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2511/4994] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:34 2022] POST /identity/v3/users => generated 301 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:34.571255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:34.577909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92dac742c70b4d3c93fa3d6707136cd2', 'request_id': 'req-2d00270f-9bee-4d78-9a49-0c3005d08607'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.582617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:34.600467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92dac742c70b4d3c93fa3d6707136cd2', 'request_id': 'req-2d00270f-9bee-4d78-9a49-0c3005d08607'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.608644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2d259-a468-43a0-aa5b-dae579a7f610 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:34.610065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92dac742c70b4d3c93fa3d6707136cd2', 'request_id': 'req-2d00270f-9bee-4d78-9a49-0c3005d08607'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.743936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] The token cache is being invalidate because project 92dac742c70b4d3c93fa3d6707136cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:34.746099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.747218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:34.763453 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2484/4995] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:33 2022] DELETE /identity/v3/projects/92dac742c70b4d3c93fa3d6707136cd2 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:34.767953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:34.772312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:34.785315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:34.821281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:34.821971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:34.822257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:34.822535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] PATH_INFO: `/v3/users/da6d3e8883474a108c8aa226557045c3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:34.824158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6d3e8883474a108c8aa226557045c3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:34.826957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:34.940337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00270f-9bee-4d78-9a49-0c3005d08607 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:34.947692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:34.948672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:34.949165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:34.950663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:34.951412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:34.954055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:34.967094 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2485/4996] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:34.968180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:34.970154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:34.984599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1d216-183a-42fc-8a04-e18e5700687b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:34.990265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:34.991169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:34.991982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:34.992251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] PATH_INFO: `/v3/projects/3fab363395904e92a8e9935c83c780b0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:34.993429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fab363395904e92a8e9935c83c780b0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:34.995379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:35.175260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6d3e8883474a108c8aa226557045c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.175916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6d3e8883474a108c8aa226557045c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.181171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fab363395904e92a8e9935c83c780b0', 'request_id': 'req-8be212ea-b507-4b39-85ff-352994d456ee'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.193615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fab363395904e92a8e9935c83c780b0', 'request_id': 'req-8be212ea-b507-4b39-85ff-352994d456ee'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.204739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fab363395904e92a8e9935c83c780b0', 'request_id': 'req-8be212ea-b507-4b39-85ff-352994d456ee'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.328057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6d3e8883474a108c8aa226557045c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.357251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6d3e8883474a108c8aa226557045c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.366341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4a102d87-e9d4-4e55-b834-399a5bb305c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6d3e8883474a108c8aa226557045c3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.395627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2512/4997] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:34 2022] DELETE /identity/v3/users/da6d3e8883474a108c8aa226557045c3 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:35.398129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bc35-487e-4d9f-bf8a-896e44e91633 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:35.398423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bc35-487e-4d9f-bf8a-896e44e91633 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:35.398728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bc35-487e-4d9f-bf8a-896e44e91633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:35.427312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9323bc35-487e-4d9f-bf8a-896e44e91633 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:35.428590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9323bc35-487e-4d9f-bf8a-896e44e91633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:35.449465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] The token cache is being invalidate because project 3fab363395904e92a8e9935c83c780b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:35.462991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.463746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.467008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2486/4998] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:34 2022] DELETE /identity/v3/projects/3fab363395904e92a8e9935c83c780b0 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:35.467838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:35.477937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:35.564316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2513/4999] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:35.565899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:35.566173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:35.566446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:35.593689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:35.595438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:35.608980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2514/5000] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:35.610171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:35.611886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:35.631608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c41ab9-3cd8-4eef-9f65-6f65fc286cfc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:35.641118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:35.642070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:35.643409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:35.644620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] PATH_INFO: `/v3/users/557dadc03f0f4be5a5dd8b198c12d123` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:35.647320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=557dadc03f0f4be5a5dd8b198c12d123)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:35.649576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:35.661440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be212ea-b507-4b39-85ff-352994d456ee admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:35.676455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8366c7-6cf3-4aa2-923a-1fe39bd4a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:35.680078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8366c7-6cf3-4aa2-923a-1fe39bd4a918 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:35.680078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8366c7-6cf3-4aa2-923a-1fe39bd4a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:35.680078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8366c7-6cf3-4aa2-923a-1fe39bd4a918 admin admin] PATH_INFO: `/v3/projects/68fe8f65de994ad98abf5fffd1ff8363/users/5ad9ae15dae14e6ca42414dfecebd7ae/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:35.705086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8366c7-6cf3-4aa2-923a-1fe39bd4a918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fe8f65de994ad98abf5fffd1ff8363, user_id=5ad9ae15dae14e6ca42414dfecebd7ae, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:35.708870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8366c7-6cf3-4aa2-923a-1fe39bd4a918 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:35.787081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2487/5001] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:35 2022] PUT /identity/v3/projects/68fe8f65de994ad98abf5fffd1ff8363/users/5ad9ae15dae14e6ca42414dfecebd7ae/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:35.789682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:35.789682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:35.789942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:35.831724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:35.834004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:35.886404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557dadc03f0f4be5a5dd8b198c12d123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.889120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557dadc03f0f4be5a5dd8b198c12d123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:35.997380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2488/5002] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:35.999129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.002163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557dadc03f0f4be5a5dd8b198c12d123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:36.019322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557dadc03f0f4be5a5dd8b198c12d123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:36.019726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:36.020258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557dadc03f0f4be5a5dd8b198c12d123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:36.065756 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2515/5003] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:35 2022] DELETE /identity/v3/users/557dadc03f0f4be5a5dd8b198c12d123 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:36.067863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.086261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:36.205344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04fb45-5521-4cd1-b608-fc49a6afbccc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.282460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4356528-ed89-407e-af6e-7e498cc94aab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.291074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.294074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.300403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.304505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.304640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.304845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.305651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.306318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.308684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.315801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:36.317923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.354969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.362421 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2516/5004] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:36.362421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.362421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:36.364105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.390856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58197c7b-412b-44e5-8f41-dd9803f31f53 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.396784 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2489/5005] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:36.396784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.407253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.407901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.408189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.411779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.412520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:36.412844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.418042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.426811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fa041-eb9a-4500-a116-5d7f3d1272c4 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.447950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d759-2fab-45db-a777-8262cf62efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.448370 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2517/5006] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:36.449373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d759-2fab-45db-a777-8262cf62efa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.449915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d759-2fab-45db-a777-8262cf62efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.450900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d759-2fab-45db-a777-8262cf62efa9 admin admin] PATH_INFO: `/v3/projects/68fe8f65de994ad98abf5fffd1ff8363/users/5ad9ae15dae14e6ca42414dfecebd7ae/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.453439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.454488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d759-2fab-45db-a777-8262cf62efa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fe8f65de994ad98abf5fffd1ff8363, user_id=5ad9ae15dae14e6ca42414dfecebd7ae, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.457394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d759-2fab-45db-a777-8262cf62efa9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.471750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b60db-63a9-4eb5-a405-314039cf329b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.475610 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2490/5007] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:36 2022] PUT /identity/v3/projects/68fe8f65de994ad98abf5fffd1ff8363/users/5ad9ae15dae14e6ca42414dfecebd7ae/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:36.494627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.494930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.495220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.566726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] MFA Rules not processed for user `5ad9ae15dae14e6ca42414dfecebd7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:36.568306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:36.612166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.614358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.614837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.615827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.617452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.624015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.719173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2491/5008] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:36.724359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.737190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798c48d-d137-4359-b9af-2dbc6b6a0806 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.747830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:36.772829 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2518/5009] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:36 2022] POST /identity/v3/projects => generated 385 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:36.778662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.778662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.779089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.779173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.779173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.783972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:get_project(project_id=b95d74f0b70343ea8e1b78518b3aed1b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.794076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.801807 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2492/5010] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:36 2022] GET /identity/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b => generated 389 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:14:36.808095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:36.839568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd6b2-d80a-4d5d-974e-9e945c7d79fe tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.922877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:36.938556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.939292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.939791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.940329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.941491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.944379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:36.972271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765f43-f8cd-4c74-aa72-30783fda22cf admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:36.984411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:36.985213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:36.985568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:36.985989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:36.986885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:36.995165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.086162 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2493/5011] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:14:36 2022] POST /identity/v3/projects => generated 338 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:37.091018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.147006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2519/5012] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:36 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:37.152747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.206630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f26b-f908-494a-a459-ae4c33a20528 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.240034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c3ba-bc0f-49b3-92ed-bd4f85c6465e tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.255926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.256885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.257341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.257752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.258536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.260578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.298395 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2494/5013] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/projects => generated 7299 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:37.299464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.322262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541ba72-df96-4630-81aa-fd73e1960c3c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.338762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.339506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.340004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.340554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.344107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:get_project(project_id=b95d74f0b70343ea8e1b78518b3aed1b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.348700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.365962 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2495/5014] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b => generated 389 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:37.372948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.375840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.376996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.377473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.377756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.378846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.380754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.392024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b7958-3abc-48d1-8b11-f0cfb2c5d352 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.406705 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2520/5015] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:37.410316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.410659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.411326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.411629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.411893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects/220609c6b5b74ac9ac8c5380267c674f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.413177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:get_project(project_id=220609c6b5b74ac9ac8c5380267c674f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.415824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.417559 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2496/5016] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/projects/220609c6b5b74ac9ac8c5380267c674f => generated 338 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:14:37.428324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.447285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774d26-c607-44ed-8e32-a18c2a83e044 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.462961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23498217-ddaf-4106-a7da-502401cd41df admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.463643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.464478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.464920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.471321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.471321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.471321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.476808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.477919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.480210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.480609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.485019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.487260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.516800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2497/5017] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/projects => generated 7299 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:37.517225 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2521/5018] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:37.518204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.519579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.520423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:37.543723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a505-ea3f-4168-acdb-9be77438d96c tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.549730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.550741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.551185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.552231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] PATH_INFO: `/v3/projects/c235915b28034070bbac4df8bd9a1be6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.553940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c235915b28034070bbac4df8bd9a1be6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.558362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.587659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85094a-6160-4be1-8b4d-8785d9b9df22 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.595909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.596949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.597486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.598076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.599024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:37.599573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.602696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.638545 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2522/5019] 10.222.0.78 () {58 vars in 1166 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/projects?domain_id=default => generated 6968 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:37.639857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.667903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde66dc5-0fcd-41fa-a313-eee23b24a3be tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:37.677031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:37.677337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:37.677671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:37.678194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] PATH_INFO: `/v3/projects/89c95f91e3874db2bda39bfa0b90962b/users/38a9059e210e486aa34b724d5c497e5c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:37.716323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c95f91e3874db2bda39bfa0b90962b, user_id=38a9059e210e486aa34b724d5c497e5c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:37.722194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:37.756442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c235915b28034070bbac4df8bd9a1be6', 'request_id': 'req-ac4745f2-96bd-493e-97c0-02049e955509'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:37.763481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c235915b28034070bbac4df8bd9a1be6', 'request_id': 'req-ac4745f2-96bd-493e-97c0-02049e955509'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:37.779981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c235915b28034070bbac4df8bd9a1be6', 'request_id': 'req-ac4745f2-96bd-493e-97c0-02049e955509'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:37.853546 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2523/5020] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:37 2022] PUT /identity/v3/projects/89c95f91e3874db2bda39bfa0b90962b/users/38a9059e210e486aa34b724d5c497e5c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:37.855075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.859414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:37.872785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] The token cache is being invalidate because project c235915b28034070bbac4df8bd9a1be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:37.872785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:37.872785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:37.872785 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2498/5021] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:37 2022] DELETE /identity/v3/projects/c235915b28034070bbac4df8bd9a1be6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:37.872785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:37.874629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:37.949199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:38.009600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4745f2-96bd-493e-97c0-02049e955509 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:38.016480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686fad7-d7e4-4e1a-ba4f-ad37350d3970 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:38.025642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:38.027119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.027665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.028160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] PATH_INFO: `/v3/projects/1ad482171307487ebc2d9c0804107ffd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.030722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad482171307487ebc2d9c0804107ffd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:38.037579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:38.100245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37cde3-9941-4237-9221-c9dd7c3d8ea6 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:38.101562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37cde3-9941-4237-9221-c9dd7c3d8ea6 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.101974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37cde3-9941-4237-9221-c9dd7c3d8ea6 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.102331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37cde3-9941-4237-9221-c9dd7c3d8ea6 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.103083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37cde3-9941-4237-9221-c9dd7c3d8ea6 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:38.105093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37cde3-9941-4237-9221-c9dd7c3d8ea6 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:38.152718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2499/5022] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:14:37 2022] GET /identity/v3/projects => generated 6946 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:38.154364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.157672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.157672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.178388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:38.187243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:38.189184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:38.203331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad482171307487ebc2d9c0804107ffd', 'request_id': 'req-308e634d-67e8-43a0-8bfd-82b47e538eb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.220395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad482171307487ebc2d9c0804107ffd', 'request_id': 'req-308e634d-67e8-43a0-8bfd-82b47e538eb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.230197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad482171307487ebc2d9c0804107ffd', 'request_id': 'req-308e634d-67e8-43a0-8bfd-82b47e538eb9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.315896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2500/5023] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:38.318726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:38.320730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:38.358224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48846d42-9b3a-43c0-8b23-0f672803a6fc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:38.365780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:38.366550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.366946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.367310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] PATH_INFO: `/v3/users/4961e457f06a45aeb0f6005098124559` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.369492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4961e457f06a45aeb0f6005098124559)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:38.371794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:38.374466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] The token cache is being invalidate because project 1ad482171307487ebc2d9c0804107ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:38.374775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.375552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.380575 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2524/5024] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:37 2022] DELETE /identity/v3/projects/1ad482171307487ebc2d9c0804107ffd => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:38.385723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:38.390021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:38.557256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e634d-67e8-43a0-8bfd-82b47e538eb9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:38.562854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:38.563566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.563848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.564133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.564814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:38.565123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:38.567570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:38.615584 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2525/5025] 10.222.0.78 () {58 vars in 1166 bytes} [Sun Aug 28 20:14:38 2022] GET /identity/v3/projects?domain_id=default => generated 6252 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:38.615584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:38.615584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:38.641639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4961e457f06a45aeb0f6005098124559'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.673022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4961e457f06a45aeb0f6005098124559'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.687174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4961e457f06a45aeb0f6005098124559'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.690622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4961e457f06a45aeb0f6005098124559'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.692490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4961e457f06a45aeb0f6005098124559'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:38.764768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0f6a-9c41-4bc2-9a22-06f8d0daa4bc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:38.768261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:38.768959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.769311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.769656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.771878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:38.789806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:38.791542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5021c-22e4-47ff-b761-0fdc463f6a5d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:38.823721 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2526/5026] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:38.828748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60523a6-6fc5-4873-90c4-b4ade4475c32 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:38.829095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60523a6-6fc5-4873-90c4-b4ade4475c32 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:38.829382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60523a6-6fc5-4873-90c4-b4ade4475c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:38.842855 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2501/5027] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:38 2022] DELETE /identity/v3/users/4961e457f06a45aeb0f6005098124559 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:38.844060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:38.866075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:38.875649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f60523a6-6fc5-4873-90c4-b4ade4475c32 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:38.882592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f60523a6-6fc5-4873-90c4-b4ade4475c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:39.043506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5344c1e-9ddd-460f-a82e-69eddb7bdce5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.051908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.052607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.052959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.053215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.054583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.056790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.079072 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2527/5028] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:39.081234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.081234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.081706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.089093 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2502/5029] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:14:38 2022] GET /identity/v3/projects => generated 6583 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:39.093771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.113452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ff78-a371-4bf7-a2d3-b23aaf99482d tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.122015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.141386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.157967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.159252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.160244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1938565828) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:39.162462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:39.167274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.167452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:39.170194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.200683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2528/5030] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:14:39.200683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.217787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534be293-36c5-49b0-9c67-e2160bddae09 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.237309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.238078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.238428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.238768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.239512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:39.239886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.242357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.246751 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2503/5031] 10.222.0.78 () {58 vars in 1232 bytes} [Sun Aug 28 20:14:39 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1938565828 => generated 537 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:14:39.254969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.277681 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2529/5032] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:39.278830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.281733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce977-32ce-4216-b1c4-b356ce57bad5 tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.310554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977c66-1f09-45ee-8983-41dc525a5da4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.313278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad9ae15dae14e6ca42414dfecebd7ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68fe8f65de994ad98abf5fffd1ff8363', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.314140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.314481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.315405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] PATH_INFO: `/v3/projects/220609c6b5b74ac9ac8c5380267c674f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.317703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorizing `identity:delete_project(project_id=220609c6b5b74ac9ac8c5380267c674f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.323304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.339744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.340498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.342704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.344333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.345135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.353783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.442000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:39.529978 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2530/5033] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:39 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:39.534888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.602769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220609c6b5b74ac9ac8c5380267c674f', 'request_id': 'req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:39.617457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220609c6b5b74ac9ac8c5380267c674f', 'request_id': 'req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:39.639281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220609c6b5b74ac9ac8c5380267c674f', 'request_id': 'req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:39.731094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f3f6e-fe94-4a4e-a3cb-0792b8cc776a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.766498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:39.819427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] The token cache is being invalidate because project 220609c6b5b74ac9ac8c5380267c674f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:39.820296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:39.823814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.824367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.824661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.825166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.825285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:39.825599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.827806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.828044 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2504/5034] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:39 2022] DELETE /identity/v3/projects/220609c6b5b74ac9ac8c5380267c674f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:39.832245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.836027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:39.868810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f8cc-74bf-4d16-bec4-51b42991c6cc tempest-ListProjectsStaticTestJSON-1755637089 tempest-ListProjectsStaticTestJSON-1755637089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.878072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.878742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.879025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.879370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] PATH_INFO: `/v3/users/b87fa683cd264a309448d5cbb8ed3f68` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.883798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87fa683cd264a309448d5cbb8ed3f68)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.888499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:39.927783 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2531/5035] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:39 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:39.927783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:39.929474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:39.967121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b93f-966c-476e-82ec-c94b196a63fe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:39.973336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:39.974103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:39.974394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:39.974714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] PATH_INFO: `/v3/projects/b8710e956aa94bd28eca61fd82195283` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:39.976246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8710e956aa94bd28eca61fd82195283)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:39.978563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:40.236398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8710e956aa94bd28eca61fd82195283', 'request_id': 'req-ac314d4b-de74-47e6-a450-83f271d4602c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.237069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87fa683cd264a309448d5cbb8ed3f68'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.253236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8710e956aa94bd28eca61fd82195283', 'request_id': 'req-ac314d4b-de74-47e6-a450-83f271d4602c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.270485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87fa683cd264a309448d5cbb8ed3f68'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.273553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8710e956aa94bd28eca61fd82195283', 'request_id': 'req-ac314d4b-de74-47e6-a450-83f271d4602c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.286143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87fa683cd264a309448d5cbb8ed3f68'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.286998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87fa683cd264a309448d5cbb8ed3f68'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.287681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9cbb4166-91a4-4d16-839f-7624246161ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87fa683cd264a309448d5cbb8ed3f68'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.410632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] The token cache is being invalidate because project b8710e956aa94bd28eca61fd82195283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:40.411055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.411783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:40.413539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2532/5036] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:39 2022] DELETE /identity/v3/projects/b8710e956aa94bd28eca61fd82195283 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:40.414566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:40.426842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:40.500143 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2505/5037] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:39 2022] DELETE /identity/v3/users/b87fa683cd264a309448d5cbb8ed3f68 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:14:40.505358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7823b7-eeae-4f5d-a6c4-e9d67ef203ef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:40.509571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7823b7-eeae-4f5d-a6c4-e9d67ef203ef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:40.509571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7823b7-eeae-4f5d-a6c4-e9d67ef203ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:40.550098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0c7823b7-eeae-4f5d-a6c4-e9d67ef203ef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:40.556175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0c7823b7-eeae-4f5d-a6c4-e9d67ef203ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:40.598765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314d4b-de74-47e6-a450-83f271d4602c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:40.713843 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2506/5038] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:40.715718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24599e02-1c19-41cd-83a5-4fa425db7407 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:40.716031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24599e02-1c19-41cd-83a5-4fa425db7407 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:40.716315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24599e02-1c19-41cd-83a5-4fa425db7407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:40.742176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-24599e02-1c19-41cd-83a5-4fa425db7407 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:40.756079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-24599e02-1c19-41cd-83a5-4fa425db7407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:40.768452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:40.770054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:40.771563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:40.772140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:40.773820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:40.774006 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2507/5039] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:40.775759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:40.775908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:40.776291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:40.776610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:40.799916 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2533/5040] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:40.812239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:40.817519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:40.818867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:40.838302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e37b1-b8b5-49c0-8ca3-b5341b69855c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:40.839248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2508/5041] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:40.840274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:40.846293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:40.862746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:40.863992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:40.864417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:40.864784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:40.865627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:40.870773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:40.902746 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2534/5042] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:40.904235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:40.918052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e15c41-45d8-4c38-b38a-a38d7bdf2f84 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:40.924992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:40.930081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:40.939172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:40.940515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:40.943921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:40.945572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:40.950480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:41.001583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2535/5043] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:41.006587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:41.011809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c8284-7053-461f-b2ec-882ffa808dc9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:41.020985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:41.021360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:41.021714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:41.022026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:41.041301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:41.057207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bacb6c-e5ef-4267-aa27-f2dfb306a9e7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:41.069255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:41.072795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:41.075090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:41.075923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:41.078238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:41.079509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] PATH_INFO: `/v3/projects/c9f7dfe0a2c74dae90fea57caeb6d981/users/4950f4b524f746988ea353a1de885b92/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:41.088809 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2509/5044] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:41.090524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:41.101071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66ed8-d4b1-4472-afce-d64910fb6403 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:41.107814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:41.108581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:41.108870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:41.109168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:41.110102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:41.112829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:41.133371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f7dfe0a2c74dae90fea57caeb6d981, user_id=4950f4b524f746988ea353a1de885b92, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:41.139079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:41.269567 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2536/5045] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:41 2022] PUT /identity/v3/projects/c9f7dfe0a2c74dae90fea57caeb6d981/users/4950f4b524f746988ea353a1de885b92/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:41.270856 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2510/5046] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:41 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:41.272766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:41.280085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:41.297523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:41.481942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c65ff-486d-4aba-953c-1b3b26a8cea6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:41.541973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede785fb-3f72-4aa7-9ee4-ba5c6342f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:41.541973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede785fb-3f72-4aa7-9ee4-ba5c6342f462 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:41.541973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede785fb-3f72-4aa7-9ee4-ba5c6342f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:41.541973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede785fb-3f72-4aa7-9ee4-ba5c6342f462 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:41.542536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede785fb-3f72-4aa7-9ee4-ba5c6342f462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:41.544522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede785fb-3f72-4aa7-9ee4-ba5c6342f462 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:41.601337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314ddbd-a066-45d6-8433-f2c133cc5d88 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:41.603975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:41.613547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:41.614569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:41.615054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:41.615519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] PATH_INFO: `/v3/users/78464ddc392b4ba0bf0f5bc5a4bd0eaa` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:41.616946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78464ddc392b4ba0bf0f5bc5a4bd0eaa)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:41.620242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:42.073662 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2511/5047] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:41 2022] POST /identity/v3/users => generated 284 bytes in 801 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:42.086974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.089204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.089593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.145202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] MFA Rules not processed for user `4950f4b524f746988ea353a1de885b92`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:42.146623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:42.227392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78464ddc392b4ba0bf0f5bc5a4bd0eaa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:42.228191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78464ddc392b4ba0bf0f5bc5a4bd0eaa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:42.242219 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2512/5048] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:42.246264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:42.263255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d55ea6-410f-4665-aa3d-2f6fddf86d31 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:42.272223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:42.274230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.275141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.275885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.278273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:42.280656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:42.291765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78464ddc392b4ba0bf0f5bc5a4bd0eaa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:42.298046 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2513/5049] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:42.300787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:42.302447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78464ddc392b4ba0bf0f5bc5a4bd0eaa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:42.304615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78464ddc392b4ba0bf0f5bc5a4bd0eaa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:42.318946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389a97-21bf-491d-b1aa-f5b070118423 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:42.326512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb41d-81f3-4db2-9e9c-7fa50fb766e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:42.327267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb41d-81f3-4db2-9e9c-7fa50fb766e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.327642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb41d-81f3-4db2-9e9c-7fa50fb766e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.328474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb41d-81f3-4db2-9e9c-7fa50fb766e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.328771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb41d-81f3-4db2-9e9c-7fa50fb766e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:42.331325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb41d-81f3-4db2-9e9c-7fa50fb766e7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:42.359064 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2537/5050] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:41 2022] DELETE /identity/v3/users/78464ddc392b4ba0bf0f5bc5a4bd0eaa => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:42.360244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:42.361912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:42.486272 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2514/5051] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:42 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:42.488922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.489477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.491185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.504590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a94b-3be4-4c62-b8dc-0cda5317046a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:42.530442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:42.533776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:42.666961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:42.668492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.669032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.669731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.671065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:42.673299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:42.684996 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2515/5052] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:42.684996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:42.684996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:42.686941 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2538/5053] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:42.691173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:42.702237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4042a5-a22e-478b-9df3-86f58036d1eb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:42.711868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:42.712828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.713386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.714386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.715030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:42.717448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb87e41-76e6-4d0a-b207-0c3317a758db admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:42.720341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:42.727805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:42.728545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:42.729474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:42.729474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] PATH_INFO: `/v3/projects/2447b7d287a341d9b6efceb2284cb701/users/19e73e0e4b974c109a0de7a4621f07fd/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:42.781480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2447b7d287a341d9b6efceb2284cb701, user_id=19e73e0e4b974c109a0de7a4621f07fd, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:42.784801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:43.032914 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2516/5054] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:42 2022] POST /identity/v3/users => generated 300 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:43.034047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:43.036716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:43.115312 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2539/5055] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:42 2022] PUT /identity/v3/projects/2447b7d287a341d9b6efceb2284cb701/users/19e73e0e4b974c109a0de7a4621f07fd/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:43.115312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:43.150691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47f94-7a0f-4878-a29d-1a99962e31e7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:43.268986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:43.269969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:43.270946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:43.273796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:43.298185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39c98-0e93-4326-8c53-56fdbb883901 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:43.313776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:43.314147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:43.336799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:43.343575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafe5d5-a500-44e4-a779-338a3798a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:43.344250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe5d5-a500-44e4-a779-338a3798a9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:43.344539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe5d5-a500-44e4-a779-338a3798a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:43.344816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe5d5-a500-44e4-a779-338a3798a9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:43.345481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafe5d5-a500-44e4-a779-338a3798a9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:43.348824 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2517/5056] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:43.351685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafe5d5-a500-44e4-a779-338a3798a9c4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:43.358573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:43.362708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:43.384713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2540/5057] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:43.386234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:43.386529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:43.391119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:43.430780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed9a47-b6e7-4806-a410-0f75b24401d8 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:43.445114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:43.446188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:43.446496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:43.446778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] PATH_INFO: `/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:43.448636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95d74f0b70343ea8e1b78518b3aed1b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:43.451186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:43.495001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] MFA Rules not processed for user `19e73e0e4b974c109a0de7a4621f07fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:43.498436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:43.613507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95d74f0b70343ea8e1b78518b3aed1b', 'request_id': 'req-a65349af-fe83-497b-a23b-e94a8f192522'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:43.630541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95d74f0b70343ea8e1b78518b3aed1b', 'request_id': 'req-a65349af-fe83-497b-a23b-e94a8f192522'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:43.648810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95d74f0b70343ea8e1b78518b3aed1b', 'request_id': 'req-a65349af-fe83-497b-a23b-e94a8f192522'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:43.666478 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2541/5058] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:43.667684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:43.684087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fccce2-da7b-486b-b809-25489d1d32fc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:43.793099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:43.799272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] The token cache is being invalidate because project b95d74f0b70343ea8e1b78518b3aed1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:43.799723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:43.802289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:43.809689 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2518/5059] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:43 2022] DELETE /identity/v3/projects/b95d74f0b70343ea8e1b78518b3aed1b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:43.811676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:43.820360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:43.855083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:43.855983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:43.856111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:43.856378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] PATH_INFO: `/v3/projects/db8ceb4512c24cb18f3a9a90a4fa7da6/users/b048a6b635364ab9a149d2f4f6a26842/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:43.919940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8ceb4512c24cb18f3a9a90a4fa7da6, user_id=b048a6b635364ab9a149d2f4f6a26842, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:43.923157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:44.008666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65349af-fe83-497b-a23b-e94a8f192522 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:44.026599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:44.027302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:44.027632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:44.028004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:44.029115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:44.031569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:44.035823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2542/5060] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:43 2022] PUT /identity/v3/projects/db8ceb4512c24cb18f3a9a90a4fa7da6/users/b048a6b635364ab9a149d2f4f6a26842/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:44.037327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:44.054890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:44.197044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d402-fc01-4a2b-bb72-5be0513b7a08 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:44.200449 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2519/5061] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:43 2022] POST /identity/v3/projects => generated 367 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:44.201413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:44.209030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:44.318598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:44.319770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:44.320176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:44.320556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] PATH_INFO: `/v3/users/5ad9ae15dae14e6ca42414dfecebd7ae` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:44.322107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad9ae15dae14e6ca42414dfecebd7ae)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:44.324797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:44.364501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32303e1a-0c5d-4e3c-8013-2ac3ae85bbe1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:44.380263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:44.380903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:44.382306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:44.382306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:44.382762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:44.389548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:44.415433 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2520/5062] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:44.415433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:44.442049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57a9a-07a5-4791-aae5-2d7438fa27a7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:44.453041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:44.453717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:44.454723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:44.455167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:44.455826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:44.463320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:44.584522 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2521/5063] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:44 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:44.586609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:44.608965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad9ae15dae14e6ca42414dfecebd7ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:44.612807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad9ae15dae14e6ca42414dfecebd7ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:44.621890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17f39-ca49-4010-b643-a6780f0c86b3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:44.634578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:44.635714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:44.638369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:44.638873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] PATH_INFO: `/v3/projects/db8ceb4512c24cb18f3a9a90a4fa7da6/users/b048a6b635364ab9a149d2f4f6a26842/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:44.642344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8ceb4512c24cb18f3a9a90a4fa7da6, user_id=b048a6b635364ab9a149d2f4f6a26842, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:44.650650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:44.681299 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2522/5064] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:44 2022] PUT /identity/v3/projects/db8ceb4512c24cb18f3a9a90a4fa7da6/users/b048a6b635364ab9a149d2f4f6a26842/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:44.683998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:44.733558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad9ae15dae14e6ca42414dfecebd7ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:44.745428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad9ae15dae14e6ca42414dfecebd7ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:44.748580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad9ae15dae14e6ca42414dfecebd7ae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:44.815583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2543/5065] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:44 2022] DELETE /identity/v3/users/5ad9ae15dae14e6ca42414dfecebd7ae => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:44.818334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:44.823348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:44.828807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:44.833976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6242c9-9e4e-4029-b0a0-03c4b0f24388 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:44.972177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ac41e-551b-4e0c-9f57-2acf368913a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:44.972764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ac41e-551b-4e0c-9f57-2acf368913a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:44.973055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ac41e-551b-4e0c-9f57-2acf368913a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:44.973796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ac41e-551b-4e0c-9f57-2acf368913a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:44.974129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ac41e-551b-4e0c-9f57-2acf368913a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:44.976306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ac41e-551b-4e0c-9f57-2acf368913a5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:45.001737 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2523/5066] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:45.003467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:45.003754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:45.004032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:45.005242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad156-c903-4ea7-8af6-055e843f22c2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:45.025705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:45.031369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:45.031369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:45.031369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] PATH_INFO: `/v3/projects/708261703ec141b5b2556c00a158db18` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:45.031369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=708261703ec141b5b2556c00a158db18)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:45.032468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:45.071042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] MFA Rules not processed for user `b048a6b635364ab9a149d2f4f6a26842`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:45.072479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:45.178873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:45.240885 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2524/5067] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:45.241863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:45.245818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:45.275489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708261703ec141b5b2556c00a158db18', 'request_id': 'req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:45.277603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831e54-c820-4a26-b170-335ddaa11dc2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:45.302858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708261703ec141b5b2556c00a158db18', 'request_id': 'req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:45.330002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708261703ec141b5b2556c00a158db18', 'request_id': 'req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:45.432533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:45.434664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:45.434664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:45.434664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] PATH_INFO: `/v3/projects/e834036dce5d4015904f86cb2bb580d4/users/30229491ee664400900cf98a79062f41/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:45.477560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e834036dce5d4015904f86cb2bb580d4, user_id=30229491ee664400900cf98a79062f41, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:45.479758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:45.524656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] The token cache is being invalidate because project 708261703ec141b5b2556c00a158db18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:45.524966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:45.525677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:45.530374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2544/5068] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:44 2022] DELETE /identity/v3/projects/708261703ec141b5b2556c00a158db18 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:45.530374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:45.531799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:45.610801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2525/5069] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:45 2022] PUT /identity/v3/projects/e834036dce5d4015904f86cb2bb580d4/users/30229491ee664400900cf98a79062f41/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:45.611822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:45.614667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:45.666815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e761ce-7a04-4ef7-8be3-cd5e244b89b2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:45.798161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b67b26-6a1b-44bc-afc3-aae524d0d490 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:45.800775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:45.802990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:45.804709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:45.805570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:45.807574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:45.810415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:45.811096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:45.811375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:45.811647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] PATH_INFO: `/v3/users/6c9c428c17eb469187c9c5072709565a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:45.812844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9c428c17eb469187c9c5072709565a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:45.814831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:45.815772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:45.996457 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2545/5070] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:45 2022] POST /identity/v3/projects => generated 359 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:45.998683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:46.002078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:46.087861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9c428c17eb469187c9c5072709565a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:46.139096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9c428c17eb469187c9c5072709565a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:46.159740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9c428c17eb469187c9c5072709565a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:46.163546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9c428c17eb469187c9c5072709565a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:46.164867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9c428c17eb469187c9c5072709565a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:46.176897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:46.245361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612246-cffd-412e-b90c-1566392fbfbe tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:46.265305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:46.265979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:46.266269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:46.266548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:46.267217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:46.269048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:46.295155 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2546/5071] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:46.296338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:46.300178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:46.387012 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2526/5072] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:45 2022] DELETE /identity/v3/users/6c9c428c17eb469187c9c5072709565a => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:46.388451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:46.390589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:46.587794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa92e1-b890-40b1-a354-aa771c85ba0c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:46.602688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:46.603507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:46.603791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:46.604210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] PATH_INFO: `/v3/projects/e834036dce5d4015904f86cb2bb580d4/users/30229491ee664400900cf98a79062f41/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:46.612328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e834036dce5d4015904f86cb2bb580d4, user_id=30229491ee664400900cf98a79062f41, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:46.621157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:46.650356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:46.669156 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2527/5073] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:46 2022] PUT /identity/v3/projects/e834036dce5d4015904f86cb2bb580d4/users/30229491ee664400900cf98a79062f41/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:46.673666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:46.676206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:46.802074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaa9f0-a935-46c7-b632-2d356642eea6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:46.803462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e883ee-95ae-4469-934c-e54fc653190a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:46.828008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:46.828991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:46.829282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:46.829562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] PATH_INFO: `/v3/projects/68fe8f65de994ad98abf5fffd1ff8363` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:46.837319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fe8f65de994ad98abf5fffd1ff8363)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:46.840402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:46.998782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:46.999652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.000199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.000714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-1668730319` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.006165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=97462a772f4743a68dd8eb3e734151f0, value=tempest-tag-1668730319)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:47.006165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:47.140160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fe8f65de994ad98abf5fffd1ff8363', 'request_id': 'req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:47.154554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fe8f65de994ad98abf5fffd1ff8363', 'request_id': 'req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:47.167658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fe8f65de994ad98abf5fffd1ff8363', 'request_id': 'req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:47.207680 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-ba626a2d-0939-4943-b9df-eb85f0f2e2b6 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1668730319. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:14:47.207680 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:14:47.207680 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:47.219926 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2547/5074] 10.222.0.78 () {60 vars in 1333 bytes} [Sun Aug 28 20:14:46 2022] PUT /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-1668730319 => generated 0 bytes in 924 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Aug 28 20:14:47.225511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.225871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.226092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.277468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] The token cache is being invalidate because project 68fe8f65de994ad98abf5fffd1ff8363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:47.278000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:47.282862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:47.282862 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2528/5075] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:46 2022] DELETE /identity/v3/projects/68fe8f65de994ad98abf5fffd1ff8363 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:47.284416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:47.288782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:47.311996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] MFA Rules not processed for user `30229491ee664400900cf98a79062f41`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:47.313392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:47.478692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e409d-ea8a-4060-bc8b-95722b0ed6fb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:47.485977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcf3e-968c-45b4-9322-2d38b4ee02f3 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:47.488603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcf3e-968c-45b4-9322-2d38b4ee02f3 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.489117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcf3e-968c-45b4-9322-2d38b4ee02f3 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.489562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcf3e-968c-45b4-9322-2d38b4ee02f3 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-1668730319` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.513766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fcf3e-968c-45b4-9322-2d38b4ee02f3 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=97462a772f4743a68dd8eb3e734151f0, value=tempest-tag-1668730319)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:47.516415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fcf3e-968c-45b4-9322-2d38b4ee02f3 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:47.536345 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2529/5076] 10.222.0.78 () {58 vars in 1314 bytes} [Sun Aug 28 20:14:47 2022] GET /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-1668730319 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:47.539024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.539526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.540923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.546717 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2548/5077] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:47.547460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:47.577620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:47.580843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9b716-cde9-421c-8596-aae235d5ea09 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:47.582217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:47.586535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac64d33-3460-43b0-bb87-e3b5e6cf42ed tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:47.587189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac64d33-3460-43b0-bb87-e3b5e6cf42ed tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.587474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac64d33-3460-43b0-bb87-e3b5e6cf42ed tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.587749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac64d33-3460-43b0-bb87-e3b5e6cf42ed tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.598728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac64d33-3460-43b0-bb87-e3b5e6cf42ed tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=97462a772f4743a68dd8eb3e734151f0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:47.601462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac64d33-3460-43b0-bb87-e3b5e6cf42ed tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:47.682411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:47.693397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2530/5078] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:47.704570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:47.719290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd90254-379d-46a6-a0dc-ec8027ee00e0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:47.725149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:47.726838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.727402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.727838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.728837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:47.731910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:47.789188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:47.801548 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2549/5079] 10.222.0.78 () {60 vars in 1265 bytes} [Sun Aug 28 20:14:47 2022] PUT /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags => generated 141 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:47.801548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:47.801548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:47.803354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:47.857878 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2531/5080] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:14:47 2022] POST /identity/v3/domains => generated 276 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:47.860871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:47.915444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:47.917895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:48.071198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b41b6-f805-42fc-bc8c-fa320123922b tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.102880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.104071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.104582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.105968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.121981 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2550/5081] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:48.123653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.140569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=97462a772f4743a68dd8eb3e734151f0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.144155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.178996 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2532/5082] 10.222.0.78 () {58 vars in 1245 bytes} [Sun Aug 28 20:14:47 2022] GET /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags => generated 141 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:48.180529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.219137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3cb9-c88f-4c34-bfd3-e012d3608746 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.245335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.246398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.247248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.247809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.249007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:48.249633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.252920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.285714 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2533/5083] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:48.287312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.301281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeb162-bcde-437d-91a5-c93fdc651478 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.308557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.310174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.310715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.311244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-223188731` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.313126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=97462a772f4743a68dd8eb3e734151f0, value=tempest-tag-223188731)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.315900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.399644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7f50-13db-467c-b0f7-71d77a25ae7b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.405934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.407141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.409416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.409890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.410974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.416322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.622173 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-223188731. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:14:48.622173 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:14:48.622173 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:48.629658 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2551/5084] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:48 2022] POST /identity/v3/users => generated 347 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:48.630898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.666565 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2534/5085] 10.222.0.78 () {58 vars in 1314 bytes} [Sun Aug 28 20:14:48 2022] DELETE /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-223188731 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:48.666565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.666565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:48.682331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e028-c551-46d9-81d2-d8f493e86268 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.684650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7eaa8-03cb-444e-b89b-249dbdd26723 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.692695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.693354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.693634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.693995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] PATH_INFO: `/v3/projects/faa6ce9a17e54431bb19ec7086af6671` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.695887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa6ce9a17e54431bb19ec7086af6671)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.699525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.699525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.699525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.699525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.700038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.700146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.703901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.887851 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2552/5086] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:48 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:48.889134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.938350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa6ce9a17e54431bb19ec7086af6671', 'request_id': 'req-0036d51c-02f3-4eab-b3b4-0191da91df32'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:48.981376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa6ce9a17e54431bb19ec7086af6671', 'request_id': 'req-0036d51c-02f3-4eab-b3b4-0191da91df32'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:49.003749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa6ce9a17e54431bb19ec7086af6671', 'request_id': 'req-0036d51c-02f3-4eab-b3b4-0191da91df32'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:49.046439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2fcc-f22a-47ce-8dda-6532848fc30c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.162312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.164042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.164445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.164989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.167387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.169283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.278695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] The token cache is being invalidate because project faa6ce9a17e54431bb19ec7086af6671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:49.279518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:49.280859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:49.282691 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2535/5087] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:48 2022] DELETE /identity/v3/projects/faa6ce9a17e54431bb19ec7086af6671 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:49.283865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.286185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.391374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2553/5088] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:48 2022] POST /identity/v3/users => generated 323 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:49.395203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.395523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.451149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d51c-02f3-4eab-b3b4-0191da91df32 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.464470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.465212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.465818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.466192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-223188731` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.502722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=97462a772f4743a68dd8eb3e734151f0, value=tempest-tag-223188731)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.517093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-56860955-687e-4385-aac4-466096fced49 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Could not find project tag: tempest-tag-223188731.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-223188731. Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 28 20:14:49.548629 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 28 20:14:49.549663 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:14:49.549663 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:14:49.549663 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 28 20:14:49.549663 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 28 20:14:49.549663 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-223188731. Aug 28 20:14:49.549663 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:14:49.550372 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2536/5089] 10.222.0.78 () {58 vars in 1311 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags/tempest-tag-223188731 => generated 106 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:14:49.551812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.552094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.552432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.556548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7ee2-1842-4922-80af-50e33c089647 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.564090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.564897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.565326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.565799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.566647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.571615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.605836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:49.607155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.629651 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2537/5090] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:49.631631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.636349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.667910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8a232-f95d-4c66-92b7-a8e2941ef417 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.682030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8de8-2a62-4479-a42d-bf7c4b732fcd tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.682717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8de8-2a62-4479-a42d-bf7c4b732fcd tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.682994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8de8-2a62-4479-a42d-bf7c4b732fcd tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.683272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8de8-2a62-4479-a42d-bf7c4b732fcd tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users/a90bdec1f1c54e7f922eb0982676de67` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.705368 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2554/5091] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:49 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:49.706278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.732734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8de8-2a62-4479-a42d-bf7c4b732fcd tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:get_user(user_id=a90bdec1f1c54e7f922eb0982676de67)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.735101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8de8-2a62-4479-a42d-bf7c4b732fcd tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.752430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b345cd-05f5-426e-8585-669c49e5e1ca admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.752709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2538/5092] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/users/a90bdec1f1c54e7f922eb0982676de67 => generated 347 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:49.752709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.752709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.752709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.768656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.769325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.769622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.769955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.771391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=97462a772f4743a68dd8eb3e734151f0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.773597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.789972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:49.792016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.804139 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2539/5093] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:49.805573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.820123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e4e25-b4e2-42ad-b89e-d37e12a3fb0b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.828985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.829977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.830562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.831142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.832224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.837630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.839443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:49.854518 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2540/5094] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:49.856007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.876420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad228a49-2e4a-418b-a582-d91322f8cee2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.890801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.891992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.894074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.894663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.895884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Adding query filter params (domain_id=3c912b2d7d4647218893f30db7780d2c) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:49.896659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.899844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.915696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2541/5095] 10.222.0.78 () {58 vars in 1207 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/users?domain_id=3c912b2d7d4647218893f30db7780d2c => generated 484 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:49.919747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.937720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828e47-799f-4af6-891e-229a8d4ac42d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.940531 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2555/5096] 10.222.0.78 () {58 vars in 1248 bytes} [Sun Aug 28 20:14:49 2022] DELETE /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:49.940531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.958459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.961393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.962034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.962575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.963617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:49.964185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.966425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.979873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c00d-abbe-4ac5-84f3-0b75bc8f0a86 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.982640 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2542/5097] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:49.984039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.989921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:50.001308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.001978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.002330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.002525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.003258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.004918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.006187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77a771-d74f-49d4-8e9e-590396c1392a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.021758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.022916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.023270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.023672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.024429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.028163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.044316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2556/5098] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:50.045988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:50.097367 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2543/5099] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/users => generated 8584 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:50.098573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:50.102646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf84f-debd-47d2-bfa5-7fec8b68b793 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.114445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.115115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.115403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.116209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.119484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fdf4a-9979-4a40-b4c3-0c2977d731c8 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.125466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.126909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.127556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.128120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.129369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.134474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.141807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=97462a772f4743a68dd8eb3e734151f0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.144193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.156360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2557/5100] 10.222.0.78 () {58 vars in 1245 bytes} [Sun Aug 28 20:14:50 2022] GET /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0/tags => generated 66 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 20:14:50.157290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:50.171617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3658c-213c-41dd-a726-0063f7bbf5b8 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.183050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.183748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.184034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.184321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] PATH_INFO: `/v3/projects/a6ed209ca2354f9cb7ebf9ab4ed532f4/users/ecefa5c6363641b3bb59483f12c95f17/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.267938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ed209ca2354f9cb7ebf9ab4ed532f4, user_id=ecefa5c6363641b3bb59483f12c95f17, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.271009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.274760 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2544/5101] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:50 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:50.277176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:50.437082 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2558/5102] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:50 2022] PUT /identity/v3/projects/a6ed209ca2354f9cb7ebf9ab4ed532f4/users/ecefa5c6363641b3bb59483f12c95f17/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:50.438372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:50.508910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527bd7f-392a-4dcd-8c7e-1e7f66739d34 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.593881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76697f49-1c5f-4b8f-a404-9138d6dba895 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.605548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b048a6b635364ab9a149d2f4f6a26842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.606247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.606575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.606893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] PATH_INFO: `/v3/projects/97462a772f4743a68dd8eb3e734151f0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.609958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97462a772f4743a68dd8eb3e734151f0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.614342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.638990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.640359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.641009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.641512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.642551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1026362786) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:50.643099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.649260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.706081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2545/5103] 10.222.0.78 () {58 vars in 1189 bytes} [Sun Aug 28 20:14:50 2022] GET /identity/v3/users?name=tempest-test_user-1026362786 => generated 475 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:50.707523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:50.791731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8717b-644d-4d2d-be1a-b5154e3e970f tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:50.808562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97462a772f4743a68dd8eb3e734151f0', 'request_id': 'req-a56ab46c-3388-4a20-a724-1ae32d410b28'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:50.823263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97462a772f4743a68dd8eb3e734151f0', 'request_id': 'req-a56ab46c-3388-4a20-a724-1ae32d410b28'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:50.840740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97462a772f4743a68dd8eb3e734151f0', 'request_id': 'req-a56ab46c-3388-4a20-a724-1ae32d410b28'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:50.874167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:50.875441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.875585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.875755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:50.877088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:50.879695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:50.966764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] The token cache is being invalidate because project 97462a772f4743a68dd8eb3e734151f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:50.967359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:50.968565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a56ab46c-3388-4a20-a724-1ae32d410b28 tempest-IdentityV3ProjectTagsTest-1919915236 tempest-IdentityV3ProjectTagsTest-1919915236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:50.977178 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2559/5104] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:50 2022] DELETE /identity/v3/projects/97462a772f4743a68dd8eb3e734151f0 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:50.977178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:50.977178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:50.977178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:51.013448 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2546/5105] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:50 2022] POST /identity/v3/users => generated 288 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:51.013731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:51.017874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:51.069729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] MFA Rules not processed for user `ecefa5c6363641b3bb59483f12c95f17`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:51.071554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:51.131233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf69f-afef-46a2-83d1-791b4b23fcc6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:51.142313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:51.143729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:51.144234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:51.144769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:51.146302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:51.146782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:51.153434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:51.196699 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2560/5106] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:51.200242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:51.203930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:51.238703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4edee-2a62-4b0d-bffb-e7705c0a2f96 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:51.250853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:51.251915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:51.252599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:51.253209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] PATH_INFO: `/v3/users/4950f4b524f746988ea353a1de885b92` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:51.258804 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2547/5107] 10.222.0.78 () {58 vars in 1149 bytes} [Sun Aug 28 20:14:51 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:51.260442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:51.260577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4950f4b524f746988ea353a1de885b92)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:51.263087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:51.263447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:51.317599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce279-1334-4bc5-bd1f-81e00e09bf9d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:51.344944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:51.347349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:51.348190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:51.351453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:51.353626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:51.360448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:51.388602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:51.401918 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2548/5108] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:51.403657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:51.408047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:51.426376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da675b-8fd6-418e-87e8-1fe7c942ac0d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:51.432613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:51.433241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:51.433575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:51.433881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:51.434561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:51.437092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:51.636703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4950f4b524f746988ea353a1de885b92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:51.637424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4950f4b524f746988ea353a1de885b92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:51.660861 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2549/5109] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:51 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:51.663537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:51.754649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4950f4b524f746988ea353a1de885b92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:51.769554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4950f4b524f746988ea353a1de885b92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:51.770633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4950f4b524f746988ea353a1de885b92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:51.783549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d09e-ea18-4e3a-a15f-c2bd72e75ca3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:51.792541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:51.793737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:51.794148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:51.794554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users/52acdc94a1d2446b9b697af813b5ed82` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:51.816344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:delete_user(user_id=52acdc94a1d2446b9b697af813b5ed82)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:51.825665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:51.827662 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2561/5110] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:51 2022] DELETE /identity/v3/users/4950f4b524f746988ea353a1de885b92 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:51.829131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:51.833894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.032546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52acdc94a1d2446b9b697af813b5ed82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.052972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b30fc-75d6-44f7-9bc4-1506045e9c1d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:52.054960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52acdc94a1d2446b9b697af813b5ed82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.058682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:52.060799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.061355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.061784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.062659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:52.064896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:52.073029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52acdc94a1d2446b9b697af813b5ed82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.076013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52acdc94a1d2446b9b697af813b5ed82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.076013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fb0ebcf-b3cb-4829-be7e-29e371967b36 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52acdc94a1d2446b9b697af813b5ed82'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.081975 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2562/5111] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:52.083212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:52.087252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.140767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d6fd-e411-48d9-99eb-35f5a25ff4ca admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:52.152609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:52.153553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.154082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.155394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.156295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:52.161082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:52.206430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2550/5112] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:51 2022] DELETE /identity/v3/users/52acdc94a1d2446b9b697af813b5ed82 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:52.208944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.209692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.210944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.257576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:52.260087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.294060 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2563/5113] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:52 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:52.294060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:52.298851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.314002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e660-f298-4515-9527-c0d12e10185c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:52.415446 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2551/5114] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:52.415446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:52.419690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.436541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:52.437451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.437922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.438350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] PATH_INFO: `/v3/projects/457a5891b549434d9f71572c03585131/users/691a5a982e364bb3afbda53229b8926f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.455823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457a5891b549434d9f71572c03585131, user_id=691a5a982e364bb3afbda53229b8926f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:52.459100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:52.523292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c9f5-8141-4bd0-92bf-95524721a979 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:52.542917 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2564/5115] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:52 2022] PUT /identity/v3/projects/457a5891b549434d9f71572c03585131/users/691a5a982e364bb3afbda53229b8926f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:52.547134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:52.547655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:52.547655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.547655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.548049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/users/a90bdec1f1c54e7f922eb0982676de67` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.548984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a90bdec1f1c54e7f922eb0982676de67)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:52.551933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:52.569753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:52.650127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fdc47-1a97-4e0d-ad30-f53e482c5181 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:52.656152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:52.657090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.657569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.658324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.659621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:52.663185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:52.680276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2565/5116] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:52.681745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:52.686369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.744013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90bdec1f1c54e7f922eb0982676de67'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.775740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90bdec1f1c54e7f922eb0982676de67'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.790719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90bdec1f1c54e7f922eb0982676de67'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.792277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cca92d-5914-437a-b113-16ae1a661812 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:52.793258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90bdec1f1c54e7f922eb0982676de67'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.794307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90bdec1f1c54e7f922eb0982676de67'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:52.798183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:52.799309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.799774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.800309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.802565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.819380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:52.821075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f597c-0057-480e-9a99-7f84ed3eae34 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:52.834936 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2566/5117] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:52.836700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:52.837183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:52.837647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:52.878737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] MFA Rules not processed for user `691a5a982e364bb3afbda53229b8926f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:52.881106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:52.890954 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2552/5118] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:52 2022] DELETE /identity/v3/users/a90bdec1f1c54e7f922eb0982676de67 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:52.893158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:52.896524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:53.004601 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2567/5119] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:53.007196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:53.012699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:53.053680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817727a-490e-4e5d-a2bc-1e48826a4676 tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:53.059844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:53.060806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:53.061249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:53.061684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] PATH_INFO: `/v3/projects/c4421302e7a341838e0d34fa850cb994/users/d016b21d98334d76ab19ff61abe22d10/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:53.092774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4421302e7a341838e0d34fa850cb994, user_id=d016b21d98334d76ab19ff61abe22d10, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:53.096407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:53.128864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79de27-c16c-49e1-93a1-f90b334b975f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:53.207472 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2553/5120] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:52 2022] PUT /identity/v3/projects/c4421302e7a341838e0d34fa850cb994/users/d016b21d98334d76ab19ff61abe22d10/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:53.207472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:53.213281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:53.232514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:53.233830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:53.234768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:53.235415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/domains/3c912b2d7d4647218893f30db7780d2c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:53.237103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3c912b2d7d4647218893f30db7780d2c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:53.240287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:53.308560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3c912b2d7d4647218893f30db7780d2c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.309370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3c912b2d7d4647218893f30db7780d2c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.409141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110a72-725a-466f-bcc4-7392be9755e3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:53.432187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3c912b2d7d4647218893f30db7780d2c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.433103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3c912b2d7d4647218893f30db7780d2c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.436116 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2568/5121] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:14:53 2022] PATCH /identity/v3/domains/3c912b2d7d4647218893f30db7780d2c => generated 277 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:53.437120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:53.438742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:53.554940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:53.555762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:53.556200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:53.556800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:53.557564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:53.560097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:53.572774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc60ec-4071-439e-b904-ce3df43b146d tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:53.582766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:53.583616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:53.586367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:53.586367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:53.587751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:53.594998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:53.612133 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2569/5122] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:53.617525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:53.617525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:53.681026 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2554/5123] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:53 2022] POST /identity/v3/projects => generated 375 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:53.683545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:53.686912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:53.736418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f850e-cac2-4ba2-9337-9c0ecb880a76 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:53.796259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f868f0-98ea-44f0-857f-d340fa5c2743 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:53.806490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:53.807452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:53.807927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:53.808416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] PATH_INFO: `/v3/projects/c9f7dfe0a2c74dae90fea57caeb6d981` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:53.810864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f7dfe0a2c74dae90fea57caeb6d981)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:53.817494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30229491ee664400900cf98a79062f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e834036dce5d4015904f86cb2bb580d4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:53.817494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:53.817494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:53.817810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:53.817933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] PATH_INFO: `/v3/domains/3c912b2d7d4647218893f30db7780d2c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:53.830994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3c912b2d7d4647218893f30db7780d2c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:53.832642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:53.863389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3c912b2d7d4647218893f30db7780d2c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.866633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3c912b2d7d4647218893f30db7780d2c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.970199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f7dfe0a2c74dae90fea57caeb6d981', 'request_id': 'req-92eda6d9-40e4-4df0-bf0a-f78625de4cff'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.981401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f7dfe0a2c74dae90fea57caeb6d981', 'request_id': 'req-92eda6d9-40e4-4df0-bf0a-f78625de4cff'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.990296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f7dfe0a2c74dae90fea57caeb6d981', 'request_id': 'req-92eda6d9-40e4-4df0-bf0a-f78625de4cff'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:53.997757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c912b2d7d4647218893f30db7780d2c', 'request_id': 'req-b739c5b0-eadc-431d-b0df-4dfb71e149ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.010098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c912b2d7d4647218893f30db7780d2c', 'request_id': 'req-b739c5b0-eadc-431d-b0df-4dfb71e149ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.022470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c912b2d7d4647218893f30db7780d2c', 'request_id': 'req-b739c5b0-eadc-431d-b0df-4dfb71e149ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.072961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] The token cache is being invalidate because project c9f7dfe0a2c74dae90fea57caeb6d981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:54.072961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.073715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.076407 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2555/5124] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:53 2022] DELETE /identity/v3/projects/c9f7dfe0a2c74dae90fea57caeb6d981 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:54.080876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:54.082297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:54.179982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:54.183565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] The token cache is being invalidate because project 3c912b2d7d4647218893f30db7780d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:54.183874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.185233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.199741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3c912b2d7d4647218893f30db7780d2c', 'request_id': 'req-b739c5b0-eadc-431d-b0df-4dfb71e149ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.205154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eda6d9-40e4-4df0-bf0a-f78625de4cff admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:54.209131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3c912b2d7d4647218893f30db7780d2c', 'request_id': 'req-b739c5b0-eadc-431d-b0df-4dfb71e149ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.210901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3c912b2d7d4647218893f30db7780d2c', 'request_id': 'req-b739c5b0-eadc-431d-b0df-4dfb71e149ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.217836 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2570/5125] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:14:53 2022] DELETE /identity/v3/domains/3c912b2d7d4647218893f30db7780d2c => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:54.219166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:54.221188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:54.289813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907423b-7ce4-4da4-a076-e9c3f7ceb821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:54.290718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907423b-7ce4-4da4-a076-e9c3f7ceb821 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.291193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907423b-7ce4-4da4-a076-e9c3f7ceb821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.291570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907423b-7ce4-4da4-a076-e9c3f7ceb821 admin admin] PATH_INFO: `/v3/projects/c4421302e7a341838e0d34fa850cb994/users/d016b21d98334d76ab19ff61abe22d10/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:54.294181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907423b-7ce4-4da4-a076-e9c3f7ceb821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4421302e7a341838e0d34fa850cb994, user_id=d016b21d98334d76ab19ff61abe22d10, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:54.298016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907423b-7ce4-4da4-a076-e9c3f7ceb821 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:54.308487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739c5b0-eadc-431d-b0df-4dfb71e149ea tempest-UsersV3TestJSON-1541199089 tempest-UsersV3TestJSON-1541199089-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:54.315488 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2556/5126] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:54 2022] PUT /identity/v3/projects/c4421302e7a341838e0d34fa850cb994/users/d016b21d98334d76ab19ff61abe22d10/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:54.317433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.317433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.317705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:54.356760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] MFA Rules not processed for user `38a9059e210e486aa34b724d5c497e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:54.358280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:54.407261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:54.407879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.408203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.408492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:54.409129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:54.411148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:54.439889 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2557/5127] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:54.440759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:54.450329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:54.465118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da404482-388f-4e90-8728-dac97f0e5c48 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:54.469830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:54.470498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.470783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.471075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] PATH_INFO: `/v3/users/b048a6b635364ab9a149d2f4f6a26842` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:54.472213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b048a6b635364ab9a149d2f4f6a26842)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:54.474199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:54.584738 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2571/5128] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:54 2022] POST /identity/v3/users => generated 288 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:54.585884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:54.588068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:54.616741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb423-6d25-49cc-98aa-7b8dd39e0a38 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:54.618452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:54.619215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.619523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.619865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] PATH_INFO: `/v3/users/19e73e0e4b974c109a0de7a4621f07fd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:54.621051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e73e0e4b974c109a0de7a4621f07fd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:54.623168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:54.702938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b048a6b635364ab9a149d2f4f6a26842'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.720120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b048a6b635364ab9a149d2f4f6a26842'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.727840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b048a6b635364ab9a149d2f4f6a26842'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.728590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b048a6b635364ab9a149d2f4f6a26842'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.729375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2fe5fdef-1773-4f76-865e-ce546838ea32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b048a6b635364ab9a149d2f4f6a26842'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.832275 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2558/5129] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:54 2022] DELETE /identity/v3/users/b048a6b635364ab9a149d2f4f6a26842 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:54.833965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.834330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.834611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:54.858367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e73e0e4b974c109a0de7a4621f07fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.859359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e73e0e4b974c109a0de7a4621f07fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.873349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] MFA Rules not processed for user `d016b21d98334d76ab19ff61abe22d10`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:54.882258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:54.922500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:54.944548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e73e0e4b974c109a0de7a4621f07fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.956044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e73e0e4b974c109a0de7a4621f07fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.958931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-79c7be9c-b559-4e8a-97dc-44d12a01d630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e73e0e4b974c109a0de7a4621f07fd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:54.988870 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2572/5130] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:54 2022] DELETE /identity/v3/users/19e73e0e4b974c109a0de7a4621f07fd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:54.988870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a208-7df3-495a-b020-a1badceffd4d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:54.988870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a208-7df3-495a-b020-a1badceffd4d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:54.989329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a208-7df3-495a-b020-a1badceffd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.018464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a666a208-7df3-495a-b020-a1badceffd4d None None] MFA Rules not processed for user `38a9059e210e486aa34b724d5c497e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:55.019705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a666a208-7df3-495a-b020-a1badceffd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.066200 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2559/5131] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:55.066607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.068428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.175481 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2573/5132] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:55.177270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.177556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.177830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.234196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:55.236388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.243483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b5e27-8ba3-4991-9c17-9d3d2d48a1e2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.347835 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2574/5133] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:55.349065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.366612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.367850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.368235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.368621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.371821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.377435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.404252 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2560/5134] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:55.406674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.410936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.479219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d3af-31f2-424d-8e02-b7df4a1ed112 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.484134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.484826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.485083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.485358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.486066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.488137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.546886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95554c07-4bf1-4648-b81d-71baac6b1063 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.557370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.569221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.569221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.569221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.572517 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2575/5135] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:14:55 2022] POST /identity/v3/roles => generated 234 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:55.574384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.583467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.585498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.601301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.613033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.627065 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2561/5136] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:55.629955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.653325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c94d-1277-46bb-8e3f-3269df49f82e service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.658973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.659594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.660868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.660868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.661158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.663173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.685840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2562/5137] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:55 2022] GET /identity/v3/roles => generated 1645 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:55.694803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.697140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:55.726669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1216-fe56-4dd3-a03a-36833f9d3d51 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.738411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.739586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.740498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.741525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] PATH_INFO: `/v3/projects/db8ceb4512c24cb18f3a9a90a4fa7da6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.744147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8ceb4512c24cb18f3a9a90a4fa7da6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.745662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e6c6-beab-4729-a4b7-652aa935f90a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.746829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.751001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.751702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.752041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.755157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.773717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.775808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.796607 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2576/5138] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:55.797807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.813590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f89f-e6c4-48f7-b414-17908f176c30 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:55.821698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:55.822747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:55.823199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:55.823586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:55.824638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:55.826584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:55.943333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'request_id': 'req-7d2f3e10-fad1-44aa-bc01-df810813d65a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:55.954607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'request_id': 'req-7d2f3e10-fad1-44aa-bc01-df810813d65a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:55.964866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8ceb4512c24cb18f3a9a90a4fa7da6', 'request_id': 'req-7d2f3e10-fad1-44aa-bc01-df810813d65a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:55.970928 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2577/5139] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:14:55 2022] POST /identity/v3/roles => generated 235 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:55.972812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:55.984736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffa034-f4dd-40ff-b72a-76fd1c3937e8 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:56.060479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:56.060947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.061704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.061976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] PATH_INFO: `/v3/projects/27b1890a4a6644569c728faf20190ab4/users/45ae7e6181c24740ae052cd2260f074c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.077982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] The token cache is being invalidate because project db8ceb4512c24cb18f3a9a90a4fa7da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:56.079517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:56.081088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:56.096468 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2563/5140] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:55 2022] DELETE /identity/v3/projects/db8ceb4512c24cb18f3a9a90a4fa7da6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:56.097984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:56.101138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.110327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b1890a4a6644569c728faf20190ab4, user_id=45ae7e6181c24740ae052cd2260f074c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:56.117937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:56.206705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f3e10-fad1-44aa-bc01-df810813d65a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:56.214718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:56.215343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.215643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.215918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.217871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.246691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2578/5141] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:55 2022] PUT /identity/v3/projects/27b1890a4a6644569c728faf20190ab4/users/45ae7e6181c24740ae052cd2260f074c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:56.247871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:56.250179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.257278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:56.262090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:56.265000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae4f85-692f-4ad9-8623-ab5e999b1500 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:56.297129 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2564/5142] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:56.297129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.297129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.297129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.319025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:56.320274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.344136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f704-5847-4163-a648-72b8554ecf40 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:56.359192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad14458-6ee7-465f-9204-4abd0ff4918b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:56.359876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad14458-6ee7-465f-9204-4abd0ff4918b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.360169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad14458-6ee7-465f-9204-4abd0ff4918b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.360456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad14458-6ee7-465f-9204-4abd0ff4918b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.361519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad14458-6ee7-465f-9204-4abd0ff4918b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:56.363265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad14458-6ee7-465f-9204-4abd0ff4918b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:56.386721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:56.467427 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2579/5143] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/roles => generated 235 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:56.468548 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2565/5144] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:56.471313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95ff4-606c-4948-9286-90df1464febf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.471817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95ff4-606c-4948-9286-90df1464febf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.472256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95ff4-606c-4948-9286-90df1464febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.472632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:56.495077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4600ed-e001-44b2-8d1e-f16f9c1d5f17 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:56.504312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:56.505949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.508259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.508925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.510562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:56.515907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:56.527704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f0e95ff4-606c-4948-9286-90df1464febf None None] MFA Rules not processed for user `45ae7e6181c24740ae052cd2260f074c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:56.531766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0e95ff4-606c-4948-9286-90df1464febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.646805 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2580/5145] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:56.646805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.646805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.647876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.672958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:56.674604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.679229 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2566/5146] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/domains => generated 277 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:56.679229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:56.688200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.768228 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2581/5147] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:56.768985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:56.771482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:56.778850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5260e8-894c-40a5-9197-9e2dc202eb7a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:56.784871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:56.785227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bfbe1-3861-4e8c-bb58-fc344a590966 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:56.789934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.789934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.789934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] PATH_INFO: `/v3/projects/2447b7d287a341d9b6efceb2284cb701` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.789934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2447b7d287a341d9b6efceb2284cb701)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:56.790906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:56.791239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:56.791663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:56.792010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:56.792355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:56.793067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:56.795407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:56.988136 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2582/5148] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:56.989249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.066666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e894-45f1-4fd4-81c1-bc1266065354 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.073784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.074525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.074813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.075258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.076318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.078628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.103847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2447b7d287a341d9b6efceb2284cb701', 'request_id': 'req-e569f6b4-71f2-4d33-98ef-0f388bd4e051'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.119127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2447b7d287a341d9b6efceb2284cb701', 'request_id': 'req-e569f6b4-71f2-4d33-98ef-0f388bd4e051'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.135093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2447b7d287a341d9b6efceb2284cb701', 'request_id': 'req-e569f6b4-71f2-4d33-98ef-0f388bd4e051'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.244994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] The token cache is being invalidate because project 2447b7d287a341d9b6efceb2284cb701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:57.245296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.246006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.247577 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2567/5149] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:56 2022] DELETE /identity/v3/projects/2447b7d287a341d9b6efceb2284cb701 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:57.248468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.249815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:57.290383 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2583/5150] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:56 2022] POST /identity/v3/projects => generated 401 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:57.291330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.297726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:57.352499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f6b4-71f2-4d33-98ef-0f388bd4e051 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.430944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c26f-dfd5-4e62-b400-daa83fc16223 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.437437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.438449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.438901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.439486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.440376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.442613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.456920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.457801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.458117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.458435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.459737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:57.460259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.465110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.484205 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2568/5151] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:57.484205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.484205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:57.598692 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2584/5152] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:57 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:57.599510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaff80-47bf-4c01-9fbd-720fe6778af5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.606063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.606325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.607175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.607748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.608518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.611694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:57.614157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:57.636230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.638279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.640564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69733-2829-4fbb-8af8-da893207f3b8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.647416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.648081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.648361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.648637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] PATH_INFO: `/v3/users/30229491ee664400900cf98a79062f41` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.650652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30229491ee664400900cf98a79062f41)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.652768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.656290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2569/5153] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:57.657328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.659256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:57.687943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:57.778896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bdeb-bc11-43fc-b2d7-05bacf746a44 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.801241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.802424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.803498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.803988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.806114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.811096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.929607 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2570/5154] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:14:57 2022] POST /identity/v3/groups => generated 300 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:57.934957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:57.938660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30229491ee664400900cf98a79062f41'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.939323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30229491ee664400900cf98a79062f41'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:57.968892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51eed9-f5dd-4b96-b4b7-4a18565a571f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:57.973775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:57.974486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:57.975458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:57.978443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:57.978443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:57.978443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:57.995173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30229491ee664400900cf98a79062f41'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:58.002901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30229491ee664400900cf98a79062f41'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:58.003560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30229491ee664400900cf98a79062f41'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:58.026736 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2585/5155] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:57 2022] DELETE /identity/v3/users/30229491ee664400900cf98a79062f41 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:58.026736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.026736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:58.115149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5dfe-efc0-4b57-97aa-f11158f99fd0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.124592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.125310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.125598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.125900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.126570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.128188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.134139 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2571/5156] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:14:57 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:58.134139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.135677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:58.157114 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2586/5157] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:58 2022] GET /identity/v3/roles => generated 2097 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:58.157114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.157114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:58.182581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba762bf-83de-49a3-9328-2f85901a591e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.225522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75adf9-ad5d-413c-985a-1ffd688ddf5e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.236816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.237757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.238101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.238387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.239130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.241044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.275856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.276862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.277410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.277950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.279249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.281889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.353020 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2572/5158] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:14:58 2022] POST /identity/v3/roles => generated 235 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:58.353020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.378602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795a1f-3279-49aa-a013-e76079dc225e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.384127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.384693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.384974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.385247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] PATH_INFO: `/v3/projects/9ce4158048ab4f7288f709120bb2a381/users/8b980965953d4640b9e85fce120425b3/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.406281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce4158048ab4f7288f709120bb2a381, user_id=8b980965953d4640b9e85fce120425b3, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.409496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.429968 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2587/5159] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:58 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:58.429968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.441711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537bd7-4307-4561-a27e-c2fb33487733 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.451744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.451744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.451744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.452134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.452134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.453172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.539492 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2573/5160] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:58 2022] PUT /identity/v3/projects/9ce4158048ab4f7288f709120bb2a381/users/8b980965953d4640b9e85fce120425b3/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:58.540329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.607950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9e55-7232-4642-b69d-09d31ff7a858 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.613004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.613614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.613919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.614194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.614837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.616824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.629013 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2574/5161] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:58 2022] GET /identity/v3/roles => generated 2323 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:58.630113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.641388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e4127-8976-42d9-9ef4-f6d57613adb5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.648377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.649014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.649295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.649602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.653718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.653837 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2588/5162] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:14:58 2022] POST /identity/v3/users => generated 439 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:58.653837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.654444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.664675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496090-1855-4d06-a5ba-93a47c4cf7e4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.670204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.670986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2575/5163] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:58 2022] GET /identity/v3/roles => generated 2323 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:58.672468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.677772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.678247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.678823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.679560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.682312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.700097 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2589/5164] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:14:58 2022] GET /identity/v3/roles => generated 2323 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:14:58.701012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.715430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056357e3-0804-45d5-9fb4-09bfd669a64b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.745975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.748858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.749186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.749417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] PATH_INFO: `/v3/projects/9ce4158048ab4f7288f709120bb2a381/users/8b980965953d4640b9e85fce120425b3/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.753515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce4158048ab4f7288f709120bb2a381, user_id=8b980965953d4640b9e85fce120425b3, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.757525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.774121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2590/5165] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:58 2022] PUT /identity/v3/projects/9ce4158048ab4f7288f709120bb2a381/users/8b980965953d4640b9e85fce120425b3/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:58.774978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:58.778128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0630-6770-465a-a313-319f1170dcab admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.876051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.877475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.877774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.878087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.878769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.879805 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:58.879805 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:14:58.879805 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:14:58.880693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.888131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef65b9-5461-4402-afd0-31fb26ff02c1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:58.898055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57c590-d46f-4c83-81f8-c36a52c2cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:58.898476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c590-d46f-4c83-81f8-c36a52c2cb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:58.898763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c590-d46f-4c83-81f8-c36a52c2cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:58.899044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c590-d46f-4c83-81f8-c36a52c2cb3c admin admin] PATH_INFO: `/v3/projects/e8e65d600dc0453db0f34284a150d54c/users/61f740187e544e56851257bfc3eadae7/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:58.920981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57c590-d46f-4c83-81f8-c36a52c2cb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e65d600dc0453db0f34284a150d54c, user_id=61f740187e544e56851257bfc3eadae7, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:58.924998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57c590-d46f-4c83-81f8-c36a52c2cb3c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:58.987960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:58.997210 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2576/5166] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:14:58 2022] POST /identity/v3/roles => generated 270 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:14:58.998668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.000453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.016775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc09cb-cb4f-4f95-b64d-d7dddc9899b7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.040499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.040499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.040499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.040499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] PATH_INFO: `/v3/projects/e834036dce5d4015904f86cb2bb580d4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.041249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e834036dce5d4015904f86cb2bb580d4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.041249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:59.115798 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2591/5167] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:58 2022] PUT /identity/v3/projects/e8e65d600dc0453db0f34284a150d54c/users/61f740187e544e56851257bfc3eadae7/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:59.117206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.117503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.117784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.165493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] MFA Rules not processed for user `8b980965953d4640b9e85fce120425b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:59.167605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.178567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e834036dce5d4015904f86cb2bb580d4', 'request_id': 'req-6fa4e4de-8688-485d-983a-5d06a72768a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:59.185954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e834036dce5d4015904f86cb2bb580d4', 'request_id': 'req-6fa4e4de-8688-485d-983a-5d06a72768a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:59.196963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e834036dce5d4015904f86cb2bb580d4', 'request_id': 'req-6fa4e4de-8688-485d-983a-5d06a72768a8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:59.255075 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2592/5168] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:59.263560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.320618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] The token cache is being invalidate because project e834036dce5d4015904f86cb2bb580d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:14:59.321387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:59.323738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6fa4e4de-8688-485d-983a-5d06a72768a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:14:59.328572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2577/5169] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:14:58 2022] DELETE /identity/v3/projects/e834036dce5d4015904f86cb2bb580d4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:59.328572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.328572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.328572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.350893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bf81f-6414-4302-a43f-00e1edd58b0f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.372928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] MFA Rules not processed for user `61f740187e544e56851257bfc3eadae7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:59.374702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.376261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51427f-d08e-4d73-89e3-4e641ad3fc18 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.379095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51427f-d08e-4d73-89e3-4e641ad3fc18 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.379440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51427f-d08e-4d73-89e3-4e641ad3fc18 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.379732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51427f-d08e-4d73-89e3-4e641ad3fc18 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a1a143d5ed554136917b07845118cdf5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.432164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51427f-d08e-4d73-89e3-4e641ad3fc18 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a1a143d5ed554136917b07845118cdf5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.434923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51427f-d08e-4d73-89e3-4e641ad3fc18 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:59.490646 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2578/5170] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:59.496304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.497820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.555776 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2593/5171] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:14:59 2022] PUT /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a1a143d5ed554136917b07845118cdf5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:14:59.557621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.558134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.558604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.582594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:59.583712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe80bd-0972-456a-b9e0-d61e47d8b75d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.583863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.668944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.669627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.670295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.670635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.673006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.685914 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2594/5172] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:59.686931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.751464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.753032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:59.763582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2579/5173] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:59.764434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.764992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a4de-83c9-4ecb-8f57-5037d8a5987c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.765749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.772542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61f740187e544e56851257bfc3eadae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e65d600dc0453db0f34284a150d54c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.773679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.774187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.774838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] PATH_INFO: `/v3/domains/default` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.777185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.780235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:59.783410 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2595/5174] 10.222.0.78 () {58 vars in 1152 bytes} [Sun Aug 28 20:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:14:59.784927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.787900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.870690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a499a18-8db3-44fa-90a1-54eb583eac89 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.878844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.878844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.878844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.878844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.880114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fcc3-dca9-4d02-a032-37ae7e81bdd1 tempest-DefaultDomainTestJSON-1250806352 tempest-DefaultDomainTestJSON-1250806352-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.881921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.886573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.887200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.887519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.887780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.888538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Adding query filter params (scope.project.id=a1d123f8ac9f4efe984b528e940e00d4, user.id=ef8e232d2d13402f90327385bd4ae400) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:14:59.888842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.889940 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:14:59.889940 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:14:59.889940 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:14:59.891118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:59.899173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.901137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c1d61-0c72-4e28-8307-f7d78f96ac3f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:59.914558 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2580/5175] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:14:59.916065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.919155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.919155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.938256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:59.939860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.953593 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2581/5176] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:59.955061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.956680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:59.973268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1defa-f2a3-49d5-9353-a6e88d5e5d08 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.981199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.982207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.982795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.983511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] PATH_INFO: `/v3/users/61f740187e544e56851257bfc3eadae7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.985126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f740187e544e56851257bfc3eadae7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:59.996351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.008773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2596/5177] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:14:59 2022] GET /identity/v3/role_assignments?scope.project.id=a1d123f8ac9f4efe984b528e940e00d4&user.id=ef8e232d2d13402f90327385bd4ae400&effective => generated 228 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:00.011039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.035363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf28a8-cf24-46f7-9845-e01c72ed438f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.044596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.045840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.046367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.046911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.047993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:00.048530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.051540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.069442 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2597/5178] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:00.070857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.087039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11990146-0ac7-4e8c-8bcb-8839c48be9ad admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.094656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.095504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.095992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.096465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a1a143d5ed554136917b07845118cdf5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.099386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a1a143d5ed554136917b07845118cdf5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.103652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.112351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:00.120044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a1a143d5ed554136917b07845118cdf5 was removed from user ef8e232d2d13402f90327385bd4ae400 on project a1d123f8ac9f4efe984b528e940e00d4. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:00.120396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.122399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.177935 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2598/5179] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:15:00 2022] DELETE /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a1a143d5ed554136917b07845118cdf5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:00.178926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.197221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.226391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f740187e544e56851257bfc3eadae7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.239443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f740187e544e56851257bfc3eadae7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.247716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f740187e544e56851257bfc3eadae7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.248538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f740187e544e56851257bfc3eadae7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.249120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f740187e544e56851257bfc3eadae7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.281981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5aa12-25f6-4098-b1ee-876b46b3b71d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.286822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4ce96-49a7-4398-9075-9219d987447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.287521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ce96-49a7-4398-9075-9219d987447b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.287799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ce96-49a7-4398-9075-9219d987447b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.288213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ce96-49a7-4398-9075-9219d987447b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.288855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4ce96-49a7-4398-9075-9219d987447b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.290997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4ce96-49a7-4398-9075-9219d987447b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.347473 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2582/5180] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:14:59 2022] DELETE /identity/v3/users/61f740187e544e56851257bfc3eadae7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:00.347473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.347473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.435192 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2599/5181] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:00 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:00.435192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.435192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.435192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.437269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1057-184c-465c-a0e1-cef5e71e3b1c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.454778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:00.456048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.529381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.530157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.530541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.530913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/a1a143d5ed554136917b07845118cdf5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.532347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a1a143d5ed554136917b07845118cdf5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.533432 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:00.533432 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:00.533432 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:00.533830 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2600/5182] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:00.534428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.534708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.536461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.688755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344cf6-c669-4c3a-a009-932208364c64 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.698518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.699271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.699619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.699994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.702173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.719692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a1a143d5ed554136917b07845118cdf5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:00.725089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.725089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:00.725089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2583/5183] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:00 2022] DELETE /identity/v3/roles/a1a143d5ed554136917b07845118cdf5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:00.725089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.726272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.814252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.819719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.846279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2601/5184] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:00.847425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.850230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.869933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc123d-4dab-4e23-9d2f-2371bbe7c78a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.877372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.878051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.878339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.878618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.879274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.881648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.938240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05699-8e31-4e7c-8b30-870fad9bdb94 service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.003253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.004129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.004820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.004940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.008449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.014119 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2584/5185] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:00 2022] POST /identity/v3/users => generated 285 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:01.015323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:01.018491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.033720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.037757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.050953 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2602/5186] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:01.051892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:01.054545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.072020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a02f-9623-48d8-bf69-1d3f35f54382 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.079512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.080315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.080620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.081079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] PATH_INFO: `/v3/users/f595c2f769814bcfaf1ff3429c0377d1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.082282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f595c2f769814bcfaf1ff3429c0377d1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.085235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.165419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c2bdd-1390-4f17-936c-0808bcee7d50 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.171807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.172507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.172800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.173251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/8c00f05e6c3f4c5ba3198474ae2a6844` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.182144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=8c00f05e6c3f4c5ba3198474ae2a6844)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.202790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.379852 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2585/5187] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:01 2022] PUT /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/8c00f05e6c3f4c5ba3198474ae2a6844 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:01.386328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:01.446402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f595c2f769814bcfaf1ff3429c0377d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:01.447371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f595c2f769814bcfaf1ff3429c0377d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:01.481127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699539bd-ce4c-4246-bb56-96da2d3f130a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.490024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.491336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.491749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.492204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.492879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.494559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.515466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2586/5188] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:01 2022] GET /identity/v3/roles => generated 2323 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:01.516757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:01.520004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.549635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f595c2f769814bcfaf1ff3429c0377d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:01.560479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f595c2f769814bcfaf1ff3429c0377d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:01.566575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f595c2f769814bcfaf1ff3429c0377d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:01.612797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:01.622683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2603/5189] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:01 2022] DELETE /identity/v3/users/f595c2f769814bcfaf1ff3429c0377d1 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:01.626121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:01.631742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.661561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6014409-73c0-4bcb-b964-06df411a2f27 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.791262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.791931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.792216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.792563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.797021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.820601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.823133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.848303 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2587/5190] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:01.849943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:01.855517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:01.856017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf797f-ec0d-4710-b25f-976a4e0513a6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.862091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.862674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.862962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.863262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.865296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.866701 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:01.866701 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:01.866701 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:01.867632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.962062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763156d-5f1a-457d-b4f3-1dc1e3e91706 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:01.967584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bf48a-45d0-4d00-b380-896561b280ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:01.968224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf48a-45d0-4d00-b380-896561b280ce admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.968504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf48a-45d0-4d00-b380-896561b280ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.968777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf48a-45d0-4d00-b380-896561b280ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.969437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bf48a-45d0-4d00-b380-896561b280ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:01.971291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bf48a-45d0-4d00-b380-896561b280ce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:01.990994 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2588/5191] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:01 2022] GET /identity/v3/roles => generated 2323 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:01.992582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:01.992878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:01.993161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:01.996632 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2604/5192] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:01 2022] PUT /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 520 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:01.998323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:02.022430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:02.024060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:02.113987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2589/5193] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:02.117349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:02.195939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfed05-4c2a-45b2-880e-0e3e37372049 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:02.204939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:02.207003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.207770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.208338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] PATH_INFO: `/v3/projects/fa969f40156c4a1c93825374d9cff8a1/users/0e517bd77ba94098849be6c07f0fd1ab/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.235805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa969f40156c4a1c93825374d9cff8a1, user_id=0e517bd77ba94098849be6c07f0fd1ab, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:02.245631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:02.251395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f539-ba6e-43b5-89da-3373241ce1de None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:02.265533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:02.269599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.269599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.269599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.269599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Adding query filter params (scope.project.id=a1d123f8ac9f4efe984b528e940e00d4, user.id=ef8e232d2d13402f90327385bd4ae400) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:02.270019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:02.270821 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:02.270821 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:02.270821 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:02.272828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:02.313646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:02.351227 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2605/5194] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:01 2022] PUT /identity/v3/projects/fa969f40156c4a1c93825374d9cff8a1/users/0e517bd77ba94098849be6c07f0fd1ab/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:02.353015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:02.367384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:02.371722 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2590/5195] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:15:02 2022] GET /identity/v3/role_assignments?scope.project.id=a1d123f8ac9f4efe984b528e940e00d4&user.id=ef8e232d2d13402f90327385bd4ae400&effective => generated 1061 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:02.371722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:02.379185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:02.402213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cace5b-659a-4022-963c-cb4f4535a6fb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:02.475569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915fadb-1153-4414-857c-72435262f590 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:02.484455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679468-e7dd-4919-9d27-629004f0f1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:02.484455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679468-e7dd-4919-9d27-629004f0f1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.484455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679468-e7dd-4919-9d27-629004f0f1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.484455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679468-e7dd-4919-9d27-629004f0f1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.495378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:02.496204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.496506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.496744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] PATH_INFO: `/v3/projects/e8e65d600dc0453db0f34284a150d54c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.498239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e65d600dc0453db0f34284a150d54c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:02.500052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:02.570486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679468-e7dd-4919-9d27-629004f0f1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:02.572078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679468-e7dd-4919-9d27-629004f0f1b0 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:02.583046 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2606/5196] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:02.584582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.585005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.585266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.619682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] MFA Rules not processed for user `0e517bd77ba94098849be6c07f0fd1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:02.620834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:02.671982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e65d600dc0453db0f34284a150d54c', 'request_id': 'req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:02.683908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e65d600dc0453db0f34284a150d54c', 'request_id': 'req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:02.697076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e65d600dc0453db0f34284a150d54c', 'request_id': 'req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:02.729452 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2607/5197] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:02.729452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:02.830833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] The token cache is being invalidate because project e8e65d600dc0453db0f34284a150d54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:02.831909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:02.833140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:02.835310 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2591/5198] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:02 2022] DELETE /identity/v3/projects/e8e65d600dc0453db0f34284a150d54c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:02.836408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:02.842728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:02.868648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:02.879937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa777b2-be83-4d8a-b1bb-6fc709983e39 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:02.939792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef8fd-eda5-4519-be6f-ff65b38ca4fe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:02.946659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:02.947761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.948194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.948627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.949493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:02.951684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:02.965526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:02.965526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:02.965526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:02.965901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:02.965901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:02.966890 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:02.966890 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:02.966890 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:02.968011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0b90-d639-4d04-bcf5-9bf60dc6d28d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.116608 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2608/5199] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:02 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:03.117915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.118211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.122994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.128420 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2592/5200] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:02 2022] POST /identity/v3/projects => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:03.129357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.135703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.155910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:03.157574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.283210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2609/5201] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:03.283210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.284532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d49e-9273-4ee7-9d3c-a1b7842bb2df admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.288941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.299952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.300615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.301149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.301149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] PATH_INFO: `/v3/projects/7bde489733d74997bbf7cc07010591e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.302423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bde489733d74997bbf7cc07010591e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.304926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.389718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50c17-d8ab-4ac1-997c-f635fd28bce2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.404628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.405315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.405609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.405921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.406683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Adding query filter params (scope.project.id=a1d123f8ac9f4efe984b528e940e00d4, user.id=ef8e232d2d13402f90327385bd4ae400) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:03.407183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.409471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.448457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bde489733d74997bbf7cc07010591e3', 'request_id': 'req-5911faf8-7d4e-4e00-8556-d162cce48eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:03.462440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bde489733d74997bbf7cc07010591e3', 'request_id': 'req-5911faf8-7d4e-4e00-8556-d162cce48eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:03.479295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bde489733d74997bbf7cc07010591e3', 'request_id': 'req-5911faf8-7d4e-4e00-8556-d162cce48eb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:03.481973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2610/5202] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:15:03 2022] GET /identity/v3/role_assignments?scope.project.id=a1d123f8ac9f4efe984b528e940e00d4&user.id=ef8e232d2d13402f90327385bd4ae400&effective => generated 577 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:03.482653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.494787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd95d-0736-4d2c-8bff-9b3c05db87b1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.521191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:03.569073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687e934-c822-415c-88e4-5042d218fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.569648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e934-c822-415c-88e4-5042d218fa3b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.569963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e934-c822-415c-88e4-5042d218fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.570245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e934-c822-415c-88e4-5042d218fa3b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.570928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687e934-c822-415c-88e4-5042d218fa3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.572867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687e934-c822-415c-88e4-5042d218fa3b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.611129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] The token cache is being invalidate because project 7bde489733d74997bbf7cc07010591e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:03.611432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:03.612088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:03.613664 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2593/5203] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:03 2022] DELETE /identity/v3/projects/7bde489733d74997bbf7cc07010591e3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:03.614469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.615789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.686462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911faf8-7d4e-4e00-8556-d162cce48eb2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.690235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.690875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.691155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.691431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.693830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.713061 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2611/5204] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:03 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:03.715466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793a06-182f-4473-b424-e22a352ee49d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.716038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793a06-182f-4473-b424-e22a352ee49d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.716372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793a06-182f-4473-b424-e22a352ee49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.739556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-99793a06-182f-4473-b424-e22a352ee49d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:03.740857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-99793a06-182f-4473-b424-e22a352ee49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.751973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2612/5205] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:03.758154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99793a06-182f-4473-b424-e22a352ee49d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.758154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-99793a06-182f-4473-b424-e22a352ee49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.772841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.774437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30318756-cb23-4831-a85e-70d11a7aeaa7 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.821380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2594/5206] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:03.821380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.821380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.821380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.913969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99793a06-182f-4473-b424-e22a352ee49d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.922335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.923666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.924101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.924528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.927719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.936348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2.: keystone.exception.ImpliedRoleNotFound: 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2. Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = query.one() Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:03.947357 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 20:15:03.948714 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 20:15:03.949898 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 20:15:03.949898 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 20:15:03.949898 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 20:15:03.949898 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2. Aug 28 20:15:03.949898 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:03.952216 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2613/5207] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:03 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 137 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:03.953574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.957266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.978030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059323c9-da9e-410e-8729-94090515e5d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.983626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:03.984152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.984881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.985094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.986752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.986752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.986973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.989041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.998698 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2595/5208] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:03.999976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.013641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2614/5209] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:03 2022] GET /identity/v3/roles => generated 2323 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:04.014100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960779f-4fd0-4ffe-868a-723e0e25cd0f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.015180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.020497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.021119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.021438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.022547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.023219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:04.023537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.025243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a770cf4-4bae-4273-b6de-643b244727b5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.031668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc025b-dc66-406f-b853-4c5c689bb0bc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.039293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.040691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.041159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.041594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/8c00f05e6c3f4c5ba3198474ae2a6844` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.042707 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2596/5210] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:04.044113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.044538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.045499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.046304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=8c00f05e6c3f4c5ba3198474ae2a6844)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.049977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.061180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role 8c00f05e6c3f4c5ba3198474ae2a6844 was removed from user ef8e232d2d13402f90327385bd4ae400 on project a1d123f8ac9f4efe984b528e940e00d4. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:04.061180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:04.061180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:04.069102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:04.070386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:04.078565 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2597/5211] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:04.079925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.082907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:04.097568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e9a22-1c70-4b44-93f7-588f25a7752f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.103472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.104223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.104578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.104815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] PATH_INFO: `/v3/projects/09a4f285b35e49c29e8d3219d3f356b3/users/2bada644becc445bb6cf785fc54ffd1f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.121703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a4f285b35e49c29e8d3219d3f356b3, user_id=2bada644becc445bb6cf785fc54ffd1f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.124616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.232545 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2615/5212] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:15:04 2022] DELETE /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/8c00f05e6c3f4c5ba3198474ae2a6844 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:04.234228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.236936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:04.255550 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2598/5213] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:04 2022] PUT /identity/v3/projects/09a4f285b35e49c29e8d3219d3f356b3/users/2bada644becc445bb6cf785fc54ffd1f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:04.259187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.352349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c310fb6-7a5d-421e-90a5-128f38dbb45d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.355540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ef0c8-e6d6-4465-830d-e626de387723 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.365795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.366693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.367334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.367620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.367894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.368545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.370139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.370435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.370692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.371361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:04.371664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.373285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.376406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.404084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2599/5214] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:04.404084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.408339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:04.497428 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2616/5215] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:04 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:04.498804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.539142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea9a8-443e-41ee-a4e2-7416197ae4c3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.605672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:04.615921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8579630-558c-48f8-9d70-7f6c8d4847b6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.624820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.625412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.625551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.625766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.626219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.626896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.627012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.627359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.627797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.628676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.629607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.630730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.647359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2617/5216] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:04 2022] GET /identity/v3/roles => generated 2323 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:04.648733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.661347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3938a6d-c7b0-4987-9ba0-3d19f21229f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.676754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.677573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.678483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.678764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.679501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.681754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.764942 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2600/5217] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:04 2022] POST /identity/v3/roles => generated 271 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:04.764942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.778991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229da35-af79-472d-8c1f-2f9412a100db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.793254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2618/5218] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:04 2022] POST /identity/v3/projects => generated 351 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:04.794235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.799248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.799737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.803423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.803748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.804452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.807707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.890116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8234c-7dae-4887-9a35-79522e6292a1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:04.895593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:04.896793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:04.897081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:04.897392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] PATH_INFO: `/v3/projects/09a4f285b35e49c29e8d3219d3f356b3/users/2bada644becc445bb6cf785fc54ffd1f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:04.899509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a4f285b35e49c29e8d3219d3f356b3, user_id=2bada644becc445bb6cf785fc54ffd1f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:04.902180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:04.923174 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2619/5219] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:04 2022] PUT /identity/v3/projects/09a4f285b35e49c29e8d3219d3f356b3/users/2bada644becc445bb6cf785fc54ffd1f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:04.924180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:04.990844 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2601/5220] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:04 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:04.992334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.020270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f714c36-11cf-413d-a48c-fd73764f8a5d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.022135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59577-0db3-49c1-b2c7-bd904cf40fda admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.028339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.029037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.029386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.029650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.030351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Adding query filter params (domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:05.030686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.031729 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:05.031729 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:05.031729 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:05.032768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a4857-3f56-45a1-af8b-b66fa6b94e39 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.047484 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2620/5221] 10.222.0.78 () {58 vars in 1207 bytes} [Sun Aug 28 20:15:04 2022] GET /identity/v3/roles?domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a => generated 408 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:05.051172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.051172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.051581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.088663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] MFA Rules not processed for user `2bada644becc445bb6cf785fc54ffd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:05.090176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:05.165741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.167047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.167678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.168269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.169583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.173141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.191692 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2621/5222] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:05.193869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.205390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8bb1-1d22-48ec-a8f5-7258518b972d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.211148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.211911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.212205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.213143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.213143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.215197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.240828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2622/5223] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:05 2022] GET /identity/v3/roles => generated 2323 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:05.240828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.240828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f10d-4de2-4d8b-a32b-b10e3e731cd2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.247330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.247992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.248283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.248567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/eb663ca3c81a4c46895a9d52e6f7782b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.249873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=eb663ca3c81a4c46895a9d52e6f7782b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.251316 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:05.251316 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:05.251316 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:05.251783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.336932 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2602/5224] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:04 2022] POST /identity/v3/users => generated 276 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:05.336932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.354535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28eca8-eed8-4349-829b-f0240cd6b05e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.365351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.366690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.367370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.367976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.369360 n-d-854121-7 devstack@keystone.service[82299]: WARNING oslo_log.versionutils [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:05.370547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.372468 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:05.372468 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:05.372468 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:05.374071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.414505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role eb663ca3c81a4c46895a9d52e6f7782b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:05.425185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:05.426583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:05.433738 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2623/5225] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:05 2022] DELETE /identity/v3/roles/eb663ca3c81a4c46895a9d52e6f7782b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:05.436467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.437363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:05.491579 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2603/5226] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:15:05 2022] POST /identity/v3/policies => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:05.494273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.496824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:05.515919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351f90-d79f-404a-8eb3-f95da6356c5c tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.535414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af60e-da8e-4b8c-97c4-5f8dfe1e6334 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.541506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.542265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.543036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.543036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.543727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.546308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.558033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:05.572152 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2624/5227] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:05 2022] GET /identity/v3/roles => generated 2323 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:05.572152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.572152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:05.608423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.608968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.609262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.609534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.610256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.612072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.627328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2604/5228] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:05 2022] GET /identity/v3/roles => generated 2323 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:05.632325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.634564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:05.666648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdec1e6-ca96-4bb8-9982-07b27fae29df admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.686585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.687263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.687561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.687839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.688521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Adding query filter params (domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:05.688863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.690521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.698066 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2625/5229] 10.222.0.78 () {58 vars in 1207 bytes} [Sun Aug 28 20:15:05 2022] GET /identity/v3/roles?domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a => generated 148 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:05.698929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.710768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf646-5615-4bb5-b401-54b63174fe5b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.716215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.717018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.717229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.717503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] PATH_INFO: `/v3/projects/492094632bc947e2966d52089e50c1e6/users/c02da698cfd645a69a9acc47f703a6f3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.719266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8335d-bc8e-42c8-be82-21a90f271495 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.725694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.726904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.726904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.727263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies/85f902dec05543e0996353288da3bdd0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.728045 n-d-854121-7 devstack@keystone.service[82299]: WARNING oslo_log.versionutils [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:05.728613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=85f902dec05543e0996353288da3bdd0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.730172 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:05.730172 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:05.730172 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:05.731944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.738606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492094632bc947e2966d52089e50c1e6, user_id=c02da698cfd645a69a9acc47f703a6f3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.746802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.925898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2605/5230] 10.222.0.78 () {60 vars in 1252 bytes} [Sun Aug 28 20:15:05 2022] PATCH /identity/v3/policies/85f902dec05543e0996353288da3bdd0 => generated 236 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:05.926904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.946315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fac38-8743-41c1-8298-28634d61bba1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:05.953287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:05.953287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:05.953287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:05.953287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:05.953933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:05.955897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:05.965918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2626/5231] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:05 2022] PUT /identity/v3/projects/492094632bc947e2966d52089e50c1e6/users/c02da698cfd645a69a9acc47f703a6f3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:05.965918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.973973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2606/5232] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:05 2022] GET /identity/v3/roles => generated 2323 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:05.975075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:05.978613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:06.061743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1b31-c064-46f3-a03c-cc98c857d396 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.135545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69331565-8885-4bab-80b7-7b4e93d70468 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.149985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.150743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.153026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.153986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/eb663ca3c81a4c46895a9d52e6f7782b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.157280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.158029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.158387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.158912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.160880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:06.173881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Could not find role: eb663ca3c81a4c46895a9d52e6f7782b.: keystone.exception.RoleNotFound: Could not find role: eb663ca3c81a4c46895a9d52e6f7782b. Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 28 20:15:06.180664 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application with Lock( Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:15:06.181684 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: eb663ca3c81a4c46895a9d52e6f7782b. Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:06.182688 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2627/5233] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:05 2022] DELETE /identity/v3/roles/eb663ca3c81a4c46895a9d52e6f7782b => generated 110 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:06.186075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.246481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.247996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d91d-08fb-4607-b0a2-0f781b662d38 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.258509 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2607/5234] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:06.259875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.260159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.260431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.263144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc52fb5-8a05-4500-90b7-943a763156df tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.270027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.272336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.272336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.272336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies/85f902dec05543e0996353288da3bdd0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.272806 n-d-854121-7 devstack@keystone.service[82298]: WARNING oslo_log.versionutils [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:06.273381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=85f902dec05543e0996353288da3bdd0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.275157 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:06.275157 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:06.275157 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:06.276066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.291303 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2628/5235] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:15:06 2022] GET /identity/v3/policies/85f902dec05543e0996353288da3bdd0 => generated 236 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:06.292481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.297374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] MFA Rules not processed for user `c02da698cfd645a69a9acc47f703a6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:06.298271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:06.374084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787a086-98d7-455b-af31-53731075a6c2 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.375806 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2608/5236] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:06.376669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.382403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.382989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.383357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.383734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] PATH_INFO: `/v3/projects/38e9c09f929e4e57939e6a6c55a714ce/users/99394aecbfed4f8ebfb2f6351084208f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.389882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c5486-cd85-4f0a-bd8a-e2cefd1374f1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.395038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.395722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.396016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.396904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.402706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e9c09f929e4e57939e6a6c55a714ce, user_id=99394aecbfed4f8ebfb2f6351084208f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.404900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.405785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.407611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.503742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2629/5237] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:06 2022] PUT /identity/v3/projects/38e9c09f929e4e57939e6a6c55a714ce/users/99394aecbfed4f8ebfb2f6351084208f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:06.504631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.557950 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2609/5238] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:06 2022] PUT /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:06.559085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.578963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579ad1-3001-4c81-a251-f08c72011990 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.612914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:06.637213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e01f9-2dae-4400-ae4f-e63e2f2e6148 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.642360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.643196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.643583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.643967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.644709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.646964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.672952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.674341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.674705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.675063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies/85f902dec05543e0996353288da3bdd0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.675969 n-d-854121-7 devstack@keystone.service[82298]: WARNING oslo_log.versionutils [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:06.676675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=85f902dec05543e0996353288da3bdd0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.678120 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:06.678120 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:06.678120 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:06.679141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac365-2810-4e59-b63f-01594f3257fc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.785624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2630/5239] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:06 2022] DELETE /identity/v3/policies/85f902dec05543e0996353288da3bdd0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:06.787235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.787715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.790145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.799625 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2610/5240] 10.222.0.78 () {60 vars in 1299 bytes} [Sun Aug 28 20:15:06 2022] POST /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2 => generated 367 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:06.799625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.835118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] MFA Rules not processed for user `99394aecbfed4f8ebfb2f6351084208f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:06.838149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:06.909273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f1f2-26b5-434b-8395-237d401ab7cf tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.915484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.916524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.916969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.917532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.920013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, group_id=47b81ef605044600aea50035915755fe)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.922219 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:06.922219 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:06.922219 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:06.925335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.932162 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2631/5241] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:06.932162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.947514 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2611/5242] 10.222.0.78 () {58 vars in 1365 bytes} [Sun Aug 28 20:15:06 2022] GET /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles => generated 410 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:06.953137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:06.953286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4770374-792d-411f-9adb-b1c97fcb55b1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.959032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.959747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.960101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.960442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.961510 n-d-854121-7 devstack@keystone.service[82298]: WARNING oslo_log.versionutils [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:06.962156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.962919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94b5e-0715-494b-a079-ae39f5b686db tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:06.963850 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:06.963850 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:06.963850 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:06.964921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:06.970363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:06.971340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:06.971793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:06.972504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/0df22d4ec3d34c57a13682e50f99f810` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:06.974967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c02da698cfd645a69a9acc47f703a6f3, credential_id=0df22d4ec3d34c57a13682e50f99f810)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:06.976883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.036781 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2632/5243] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:15:06 2022] POST /identity/v3/policies => generated 226 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:07.036781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.039277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:07.062220 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2612/5244] 10.222.0.78 () {58 vars in 1380 bytes} [Sun Aug 28 20:15:06 2022] DELETE /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/0df22d4ec3d34c57a13682e50f99f810 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:07.063454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.079193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942e602-42bb-44f6-8f04-3bfdfadf5f8b tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.084775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.085824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.086362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.086896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.089684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.091512 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:07.091512 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:07.091512 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:07.098580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.101478 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2613/5245] 10.222.0.78 () {58 vars in 1465 bytes} [Sun Aug 28 20:15:07 2022] HEAD /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:07.105595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.124062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:07.129470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cfad1-66d3-4913-a543-5746f781256a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.137189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3570-3f73-416c-bcdd-5fac5c4277bc tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.139576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.140775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.141333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.142507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.142981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.143637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.144283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.144283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.144988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.150143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.156100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.156800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.169127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2633/5246] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:07.170421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.181538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df3a2-907a-4b96-a38d-c32189342edd service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.186461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.187176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.187557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.187929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.188729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.192250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.258001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2614/5247] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:15:07 2022] POST /identity/v3/policies => generated 230 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:07.259305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.273971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098ea1-3293-418b-9593-e920f7416ea7 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.279762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.280518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.280814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.281091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.283723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.286541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.294384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a17bc4e2c2a54271b895dcd6e6f018d5 was removed from group 47b81ef605044600aea50035915755fe on domain 76bde4e569ea49a7b0a73a65dd7f5f0a. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:07.294939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:07.295754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:07.341532 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2634/5248] 10.222.0.78 () {60 vars in 1299 bytes} [Sun Aug 28 20:15:07 2022] POST /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2 => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:07.349563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.353791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:07.382409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2615/5249] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:15:07 2022] DELETE /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:07.384739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e8d19-2de5-46ba-b0f7-9b12087415bb tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.386990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.391643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:07.516948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.518385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.525370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.525370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.525370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.525702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.547904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7423-97b2-4491-87b6-f3f897ad58ac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.552467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.553398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.553664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.554057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/a6822e2178684b22afb94142084943ab` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.559052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c02da698cfd645a69a9acc47f703a6f3, credential_id=a6822e2178684b22afb94142084943ab)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.559052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.655389 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2635/5250] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:15:07 2022] POST /identity/v3/policies => generated 229 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:07.655389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.658924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:07.718397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2616/5251] 10.222.0.78 () {58 vars in 1380 bytes} [Sun Aug 28 20:15:07 2022] DELETE /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/a6822e2178684b22afb94142084943ab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:07.719690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.738901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8cc7-2400-422b-b50a-b1e0bed3a947 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.750381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93e52-42e3-4d3f-8859-4dee96f50732 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.761940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.762861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.763312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.764053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.765233 n-d-854121-7 devstack@keystone.service[82299]: WARNING oslo_log.versionutils [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:07.765798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.770378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.770907 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:07.770907 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:07.770907 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:07.771507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.771507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.771507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.772047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.772154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.773638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.780762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2617/5252] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:15:07 2022] GET /identity/v3/policies => generated 761 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:07.782415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.797745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6868727-8e41-483c-aa58-6c6babea7dd1 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.811393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.811393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.811393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.812105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/a6822e2178684b22afb94142084943ab` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Could not find credential: 216a9c64d0d5bdf0277c13c10e10d06807294068bb824fe78ae038bba4221d58.: keystone.exception.CredentialNotFound: Could not find credential: 216a9c64d0d5bdf0277c13c10e10d06807294068bb824fe78ae038bba4221d58. Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 28 20:15:07.845120 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:15:07.846426 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 216a9c64d0d5bdf0277c13c10e10d06807294068bb824fe78ae038bba4221d58. Aug 28 20:15:07.847646 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:07.850731 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2618/5253] 10.222.0.78 () {58 vars in 1377 bytes} [Sun Aug 28 20:15:07 2022] GET /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/a6822e2178684b22afb94142084943ab => generated 148 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:07.852636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:07.871965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300bca-c45c-457a-bd6d-dd603bf8eef7 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:07.885919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:07.885919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:07.885919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:07.886284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies/7ac3b20df35b49199ad49ca4c6051582` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:07.886284 n-d-854121-7 devstack@keystone.service[82299]: WARNING oslo_log.versionutils [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 20:15:07.886284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=7ac3b20df35b49199ad49ca4c6051582)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:07.886284 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:07.886284 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:07.886284 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:07.886765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:07.928665 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2636/5254] 10.222.0.78 () {60 vars in 1486 bytes} [Sun Aug 28 20:15:07 2022] PUT /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:07.937463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.001766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010bd7e-3824-433a-8da9-69e8f82560da tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.007189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.007840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.011789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.011789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.011789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.011789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.046857 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2619/5255] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:07 2022] DELETE /identity/v3/policies/7ac3b20df35b49199ad49ca4c6051582 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:08.046857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.053733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da27211-247c-4e0f-814e-0ddb54154278 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.114093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2637/5256] 10.222.0.78 () {60 vars in 1299 bytes} [Sun Aug 28 20:15:07 2022] POST /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2 => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:08.114093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.164549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.165694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.166273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.168373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.183652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_grants(project_id=a1d123f8ac9f4efe984b528e940e00d4, group_id=47b81ef605044600aea50035915755fe)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.188682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.205895 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2620/5257] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:15:08 2022] GET /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:08.205895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.210645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aeaed-5ad8-450a-b961-110ddcdc2870 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.218672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512abf-70c3-4d9c-814b-86dc7785cc8c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.223153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.223496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.223824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.224104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.224775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.224999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies/c9d24d7da6514a47bbe8e9325f8e154f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.225103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.225272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.225926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.226251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c9d24d7da6514a47bbe8e9325f8e154f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.227628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.228155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.373377 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2638/5258] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:08 2022] DELETE /identity/v3/policies/c9d24d7da6514a47bbe8e9325f8e154f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:08.374594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.388810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f459-7d9c-4852-b1d0-7623fc11e437 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.393887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.395341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.395341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.395341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/groups/47b81ef605044600aea50035915755fe/users/ef8e232d2d13402f90327385bd4ae400` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.397003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=47b81ef605044600aea50035915755fe, user_id=ef8e232d2d13402f90327385bd4ae400)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.399257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.451724 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2621/5259] 10.222.0.78 () {60 vars in 1299 bytes} [Sun Aug 28 20:15:08 2022] POST /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2 => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:08.451724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.466632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b9ba-370c-4aa1-9d77-f0de1562ccb2 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.472492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf462e-bc29-4778-b1f8-b55e116bff40 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bada644becc445bb6cf785fc54ffd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a4f285b35e49c29e8d3219d3f356b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.473744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf462e-bc29-4778-b1f8-b55e116bff40 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.474124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf462e-bc29-4778-b1f8-b55e116bff40 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.480098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf462e-bc29-4778-b1f8-b55e116bff40 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] PATH_INFO: `/v3/policies/20e5fc899bf54aa89c2b4979785f893b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.480098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf462e-bc29-4778-b1f8-b55e116bff40 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=20e5fc899bf54aa89c2b4979785f893b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.480098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf462e-bc29-4778-b1f8-b55e116bff40 tempest-PoliciesTestJSON-267884373 tempest-PoliciesTestJSON-267884373-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.541926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:08.550028 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2639/5260] 10.222.0.78 () {60 vars in 1360 bytes} [Sun Aug 28 20:15:08 2022] PUT /identity/v3/groups/47b81ef605044600aea50035915755fe/users/ef8e232d2d13402f90327385bd4ae400 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:08.554455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.596292 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2622/5261] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:08 2022] DELETE /identity/v3/policies/20e5fc899bf54aa89c2b4979785f893b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:08.600549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.600755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.600965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.713033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] MFA Rules not processed for user `ef8e232d2d13402f90327385bd4ae400`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:08.715064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:08.730463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37958da-2399-4bcf-9b90-35048eb4e84c tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.746281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.747002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.747295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.747578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.748243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.763366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.783499 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2640/5262] 10.222.0.78 () {58 vars in 1278 bytes} [Sun Aug 28 20:15:08 2022] GET /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2 => generated 865 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:08.783499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.795834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:08.928139 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2623/5263] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:08 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:08.928139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:08.951304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5ed8-af85-4876-aa22-b4d2a8dac482 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.956754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74f67a-c8a0-497c-b22c-116f380ec896 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:08.956958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.957613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.957919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.958293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] PATH_INFO: `/v3/users/0e517bd77ba94098849be6c07f0fd1ab` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.966228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e517bd77ba94098849be6c07f0fd1ab)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.966993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:08.967777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:08.968066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:08.968328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:08.968444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/3e921598c47f40cfa58c01deefa2dfc5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:08.974689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c02da698cfd645a69a9acc47f703a6f3, credential_id=3e921598c47f40cfa58c01deefa2dfc5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:08.977303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:09.053201 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2624/5264] 10.222.0.78 () {58 vars in 1380 bytes} [Sun Aug 28 20:15:08 2022] DELETE /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/3e921598c47f40cfa58c01deefa2dfc5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:09.056962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:09.075830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:09.198367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d989f2-5363-4c3b-8cbf-7868245d55db tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:09.205840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:09.206912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:09.207296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:09.207674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:09.215056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:09.226085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:09.240956 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2625/5265] 10.222.0.78 () {58 vars in 1468 bytes} [Sun Aug 28 20:15:09 2022] HEAD /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:09.240956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:09.243386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e517bd77ba94098849be6c07f0fd1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.250380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e517bd77ba94098849be6c07f0fd1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.263607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d678a-9e9a-4c1d-b1a2-9a5fc767dba0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:09.273129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:09.276838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:09.276838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:09.276838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/fe8a837d2bde4f07bdff142881562278` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:09.279282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c02da698cfd645a69a9acc47f703a6f3, credential_id=fe8a837d2bde4f07bdff142881562278)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:09.282359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:09.336713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:09.450641 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2626/5266] 10.222.0.78 () {58 vars in 1380 bytes} [Sun Aug 28 20:15:09 2022] DELETE /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/fe8a837d2bde4f07bdff142881562278 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:09.451979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:09.499268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c926956-c86e-4a76-b6e2-7cfe25bfc84a tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:09.509310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e517bd77ba94098849be6c07f0fd1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.518365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:09.518365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:09.518365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:09.518664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:09.519344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:09.523689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:09.524154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e517bd77ba94098849be6c07f0fd1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.525510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e517bd77ba94098849be6c07f0fd1ab'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.531716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a17bc4e2c2a54271b895dcd6e6f018d5 was removed from group 47b81ef605044600aea50035915755fe on project a1d123f8ac9f4efe984b528e940e00d4. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:09.532087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.532947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0898a68-19e7-43ba-bdb8-d4e43444254f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:09.559212 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2641/5267] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:08 2022] DELETE /identity/v3/users/0e517bd77ba94098849be6c07f0fd1ab => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:09.560609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:09.563091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:09.688430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2627/5268] 10.222.0.78 () {58 vars in 1470 bytes} [Sun Aug 28 20:15:09 2022] DELETE /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:09.689959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:09.690247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:09.695072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:09.703217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be5f15-9e08-46b3-a173-58fb49d73ff0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:09.753445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:09.756605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:09.852784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:09.853468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:09.853756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:09.854055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:09.854933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:09.856541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:09.910811 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2628/5269] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:09.912173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:09.916866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:09.987998 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2642/5270] 10.222.0.78 () {60 vars in 1299 bytes} [Sun Aug 28 20:15:09 2022] POST /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2 => generated 367 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:09.987998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:09.989627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:10.132401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b787da-1dd7-462b-b926-3d58d756fad2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:10.139450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:10.140522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:10.141340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:10.141909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/groups/47b81ef605044600aea50035915755fe/users/ef8e232d2d13402f90327385bd4ae400` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:10.154810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=47b81ef605044600aea50035915755fe, user_id=ef8e232d2d13402f90327385bd4ae400)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:10.157510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:10.209940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800835d-cf56-4c46-8d61-e3e4e180cb24 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:10.215299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:10.216544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:10.217386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:10.217917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:10.232076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:10.234704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:10.262921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ef8e232d2d13402f90327385bd4ae400'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:10.282490 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2643/5271] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:10.292174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:10.296503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:10.348819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242cae-c445-4da5-a460-39f656cd39be service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:10.385490 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2629/5272] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:15:09 2022] DELETE /identity/v3/groups/47b81ef605044600aea50035915755fe/users/ef8e232d2d13402f90327385bd4ae400 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:10.388670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:10.391323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:10.396744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:10.397752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:10.399832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/11ae318d01b640ce8ba60e596029865d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:10.411559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=c02da698cfd645a69a9acc47f703a6f3, credential_id=11ae318d01b640ce8ba60e596029865d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:10.418595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:10.435136 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2644/5273] 10.222.0.78 () {58 vars in 1377 bytes} [Sun Aug 28 20:15:10 2022] GET /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/11ae318d01b640ce8ba60e596029865d => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:10.440971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:10.469448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95987b-6a24-43b4-97f5-216b8cd378a9 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:10.706940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961734b2-4ee5-412a-8f47-061f3e16a81f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:10.721725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c02da698cfd645a69a9acc47f703a6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '492094632bc947e2966d52089e50c1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:10.722155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:10.722155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:10.722481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:10.722647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:10.722803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:10.722950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:10.723092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/11ae318d01b640ce8ba60e596029865d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:10.727221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c02da698cfd645a69a9acc47f703a6f3, credential_id=11ae318d01b640ce8ba60e596029865d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:10.730557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:10.732299 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:10.732299 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:10.732299 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:10.736974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:10.738376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:10.930154 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2630/5274] 10.222.0.78 () {60 vars in 1381 bytes} [Sun Aug 28 20:15:10 2022] PUT /identity/v3/system/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:10.931248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:10.945155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cff7c4-53ef-4f64-9090-27fe13e2f3e2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:10.952006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:10.952679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:10.952965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:10.953410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/groups/47b81ef605044600aea50035915755fe/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:10.955094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=47b81ef605044600aea50035915755fe)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:10.956341 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:10.956341 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:10.956341 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:10.957409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:10.992097 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2631/5275] 10.222.0.78 () {58 vars in 1263 bytes} [Sun Aug 28 20:15:10 2022] GET /identity/v3/system/groups/47b81ef605044600aea50035915755fe/roles => generated 376 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:10.993225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.020929 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2645/5276] 10.222.0.78 () {58 vars in 1380 bytes} [Sun Aug 28 20:15:10 2022] DELETE /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3/credentials/OS-EC2/11ae318d01b640ce8ba60e596029865d => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:11.025426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3611b4-bb28-4dfb-92a6-77f40a6be359 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:11.027881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.030106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:11.030822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:11.031114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:11.031400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:11.033605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:11.035975 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:11.035975 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:11.035975 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:11.037062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:11.037540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:11.051546 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2632/5277] 10.222.0.78 () {58 vars in 1363 bytes} [Sun Aug 28 20:15:10 2022] HEAD /identity/v3/system/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:11.058911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.068822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfdf7-eda8-4453-b566-e7ce3aa28265 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:11.093312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:11.095506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:11.096199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:11.096496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:11.101682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:11.103224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=47b81ef605044600aea50035915755fe, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:11.103826 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:11.103826 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:11.103826 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:11.114996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:11.276627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64164b7-8f6a-43f7-a079-525f313d7244 tempest-EC2CredentialsTest-1760088823 tempest-EC2CredentialsTest-1760088823-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:11.283206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:11.284742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:11.285278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:11.285798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] PATH_INFO: `/v3/users/c02da698cfd645a69a9acc47f703a6f3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:11.287264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2633/5278] 10.222.0.78 () {58 vars in 1365 bytes} [Sun Aug 28 20:15:11 2022] DELETE /identity/v3/system/groups/47b81ef605044600aea50035915755fe/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:11.288700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02da698cfd645a69a9acc47f703a6f3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:11.292281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.302919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:11.309268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce84ad-8dbd-4171-ad57-8e92609e68c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:11.330410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:11.330828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:11.331100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:11.331383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:11.344586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:11.347275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:11.492267 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2634/5279] 10.222.0.78 () {60 vars in 1480 bytes} [Sun Aug 28 20:15:11 2022] PUT /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:11.502064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.590128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02da698cfd645a69a9acc47f703a6f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:11.591039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02da698cfd645a69a9acc47f703a6f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:11.650724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:11.692274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02da698cfd645a69a9acc47f703a6f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:11.703814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c30f0-bb5b-4042-9ad5-5aa96065b562 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:11.716127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02da698cfd645a69a9acc47f703a6f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:11.719146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02da698cfd645a69a9acc47f703a6f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:11.721156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:11.722723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:11.723145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:11.723535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:11.727325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, user_id=ef8e232d2d13402f90327385bd4ae400)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:11.731460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:11.801908 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2635/5280] 10.222.0.78 () {58 vars in 1362 bytes} [Sun Aug 28 20:15:11 2022] GET /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles => generated 409 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:15:11.803193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.811371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:11.824643 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2646/5281] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:11 2022] DELETE /identity/v3/users/c02da698cfd645a69a9acc47f703a6f3 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:11.824643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:11.830258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.020696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0da43-54e0-4c96-b401-e7b4394a6d59 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:12.026599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd20f5-d52b-44c6-9142-5715ac3a809e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:12.035485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:12.040556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.040556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.040556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.040556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:12.043325 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:12.043325 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:12.043325 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:12.048117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b7e44-b4ad-48ad-8599-c8f1228ab318 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:12.062243 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2647/5282] 10.222.0.78 () {58 vars in 1462 bytes} [Sun Aug 28 20:15:11 2022] HEAD /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:12.064673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.065622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.065622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.094235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:12.096319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.123698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:12.125013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.125456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.126058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] PATH_INFO: `/v3/projects/fa969f40156c4a1c93825374d9cff8a1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.127525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa969f40156c4a1c93825374d9cff8a1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:12.131418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:12.182017 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2648/5283] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:12.187809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:12.203559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bc8c5-c8e2-46b9-bc1b-ffd57b19d92a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:12.212316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:12.213324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.213812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.215102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.220547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:12.227830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:12.236686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a17bc4e2c2a54271b895dcd6e6f018d5 was removed from user ef8e232d2d13402f90327385bd4ae400 on domain 76bde4e569ea49a7b0a73a65dd7f5f0a. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:12.237544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.238786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.328130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa969f40156c4a1c93825374d9cff8a1', 'request_id': 'req-1ff68c29-e03e-492a-91e5-cd137af21ffd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.337887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa969f40156c4a1c93825374d9cff8a1', 'request_id': 'req-1ff68c29-e03e-492a-91e5-cd137af21ffd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.346390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa969f40156c4a1c93825374d9cff8a1', 'request_id': 'req-1ff68c29-e03e-492a-91e5-cd137af21ffd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.382656 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2649/5284] 10.222.0.78 () {58 vars in 1464 bytes} [Sun Aug 28 20:15:12 2022] DELETE /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:12.382656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:12.386451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.450783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] The token cache is being invalidate because project fa969f40156c4a1c93825374d9cff8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:12.451148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.453507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:12.455388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2636/5285] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:11 2022] DELETE /identity/v3/projects/fa969f40156c4a1c93825374d9cff8a1 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:12.456729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:12.460645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.549496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b7f7a-53f6-4519-8f1c-08c75945768d tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:12.555057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:12.556352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.557248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.557797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.560077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.567148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff68c29-e03e-492a-91e5-cd137af21ffd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:12.663343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:12.664148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.664598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.664983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.667959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:12.672622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:12.676933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:12.680835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:12.699828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2650/5286] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:12.701304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:12.703645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.727805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29cd7-549d-4368-b7b3-5e1d6557ba08 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:12.736317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:12.737423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:12.738110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:12.738546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] PATH_INFO: `/v3/users/2bada644becc445bb6cf785fc54ffd1f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:12.741279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bada644becc445bb6cf785fc54ffd1f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:12.744999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:12.851944 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2637/5287] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:12 2022] PUT /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:12.853627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:12.866743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:12.993069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64d370-03b5-4dcd-9328-053b4176f5be tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:13.004904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:13.004904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.004904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.004904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] PATH_INFO: `/v3/users/99394aecbfed4f8ebfb2f6351084208f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.005767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99394aecbfed4f8ebfb2f6351084208f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:13.008539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:13.151983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bada644becc445bb6cf785fc54ffd1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.153014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bada644becc445bb6cf785fc54ffd1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.237312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bada644becc445bb6cf785fc54ffd1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.244851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bada644becc445bb6cf785fc54ffd1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.245722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bada644becc445bb6cf785fc54ffd1f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.279167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2651/5288] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:12 2022] DELETE /identity/v3/users/2bada644becc445bb6cf785fc54ffd1f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:13.279167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:13.279757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:13.355993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99394aecbfed4f8ebfb2f6351084208f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.371948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7f178-5457-4179-a748-507787ba2cbb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:13.372330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99394aecbfed4f8ebfb2f6351084208f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.379654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:13.380692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.381156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.381619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.383071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99394aecbfed4f8ebfb2f6351084208f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.383928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99394aecbfed4f8ebfb2f6351084208f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.384087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_grants(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:13.385077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99394aecbfed4f8ebfb2f6351084208f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.385200 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:13.385200 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:13.385200 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:13.387070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:13.405775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2652/5289] 10.222.0.78 () {58 vars in 1365 bytes} [Sun Aug 28 20:15:13 2022] GET /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles => generated 410 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:13.410489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:13.413337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:13.430285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560e5d1-b57e-45d3-af00-314494a980d4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:13.439761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:13.440810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.441321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.441792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.445317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:13.449529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:13.459827 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2653/5290] 10.222.0.78 () {58 vars in 1465 bytes} [Sun Aug 28 20:15:13 2022] HEAD /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:13.463997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:13.482933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038577-e338-4ea8-9f35-ae89fbc73b6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:13.491031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:13.491827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.492187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.492538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.495467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a1d123f8ac9f4efe984b528e940e00d4, user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:13.498429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:13.506210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a17bc4e2c2a54271b895dcd6e6f018d5 was removed from user ef8e232d2d13402f90327385bd4ae400 on project a1d123f8ac9f4efe984b528e940e00d4. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:13.506589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.507985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fee11fa-b158-42c7-ab3a-508961389203 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:13.523870 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2638/5291] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:12 2022] DELETE /identity/v3/users/99394aecbfed4f8ebfb2f6351084208f => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:13.525161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:13.526862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:13.641173 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2654/5292] 10.222.0.78 () {58 vars in 1467 bytes} [Sun Aug 28 20:15:13 2022] DELETE /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:13.645897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.645897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.645897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.649621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d366c-42f6-4462-8a3b-faeb71548843 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:13.674885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:13.676433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:13.801328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2655/5293] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:13.803716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:13.806626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:13.835851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:13.835851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.835851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.835851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] PATH_INFO: `/v3/projects/492094632bc947e2966d52089e50c1e6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.836181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=492094632bc947e2966d52089e50c1e6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:13.837680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:13.937415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574697f4-f3d1-493a-a194-4ca13c0e432e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:13.953509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:13.954891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:13.954891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:13.955228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:13.957518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:13.959361 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:13.959361 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:13.959361 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:13.961974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:14.126641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492094632bc947e2966d52089e50c1e6', 'request_id': 'req-f39f6143-37e6-49f1-8303-ec44109946ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.136352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492094632bc947e2966d52089e50c1e6', 'request_id': 'req-f39f6143-37e6-49f1-8303-ec44109946ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.144608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492094632bc947e2966d52089e50c1e6', 'request_id': 'req-f39f6143-37e6-49f1-8303-ec44109946ea'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.211502 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2656/5294] 10.222.0.78 () {60 vars in 1378 bytes} [Sun Aug 28 20:15:13 2022] PUT /identity/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:14.211502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:14.215506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:14.272826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] The token cache is being invalidate because project 492094632bc947e2966d52089e50c1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:14.273147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.275423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.281377 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2639/5295] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:13 2022] DELETE /identity/v3/projects/492094632bc947e2966d52089e50c1e6 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:14.282506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:14.295253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:14.418965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf347-c7c1-4abb-8867-04dd10d749e6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:14.445904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f6143-37e6-49f1-8303-ec44109946ea admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:14.454744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:14.455883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:14.456397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:14.456893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] PATH_INFO: `/v3/projects/09a4f285b35e49c29e8d3219d3f356b3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:14.460128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a4f285b35e49c29e8d3219d3f356b3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:14.463596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:14.464790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:14.513616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:14.514666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:14.514959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:14.515299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:14.517930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:14.548603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:14.550807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:14.564811 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2657/5296] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:14.566010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:14.568432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:14.656354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a4f285b35e49c29e8d3219d3f356b3', 'request_id': 'req-41c27d30-24ee-461b-90d3-936e9ff11530'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.675977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a4f285b35e49c29e8d3219d3f356b3', 'request_id': 'req-41c27d30-24ee-461b-90d3-936e9ff11530'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.690443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a4f285b35e49c29e8d3219d3f356b3', 'request_id': 'req-41c27d30-24ee-461b-90d3-936e9ff11530'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.748360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3183-6d1e-460a-a640-74997ca3930a service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:14.829231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:14.829978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:14.830275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:14.830558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:14.831835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=ef8e232d2d13402f90327385bd4ae400)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:14.833023 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:14.833023 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:14.833023 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:14.834018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980e78-c4ce-4d40-a231-b4f7211f8f55 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:14.843981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:14.850284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] The token cache is being invalidate because project 09a4f285b35e49c29e8d3219d3f356b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:14.850587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.851316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41c27d30-24ee-461b-90d3-936e9ff11530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:14.853165 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2640/5297] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:14 2022] DELETE /identity/v3/projects/09a4f285b35e49c29e8d3219d3f356b3 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:14.859947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9d8d-4f4f-4f9f-8342-e777fcd219c5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:14.859947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9d8d-4f4f-4f9f-8342-e777fcd219c5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:14.859947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9d8d-4f4f-4f9f-8342-e777fcd219c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:14.866519 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2658/5298] 10.222.0.78 () {58 vars in 1260 bytes} [Sun Aug 28 20:15:14 2022] GET /identity/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles => generated 375 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:14.867561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:14.867561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:14.867561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:14.888682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9a4c9d8d-4f4f-4f9f-8342-e777fcd219c5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:14.890756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9a4c9d8d-4f4f-4f9f-8342-e777fcd219c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:14.891514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:14.893239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.030840 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2659/5299] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:15.030840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.032752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.067569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40683c6-5d50-4a02-9081-e5541fbf0b4e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.075600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.076548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.077105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.077458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.080196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.081107 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:15.081107 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:15.081107 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:15.085088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.093909 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2660/5300] 10.222.0.78 () {58 vars in 1360 bytes} [Sun Aug 28 20:15:15 2022] HEAD /identity/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:15.094996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.097825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.116832 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2641/5301] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:15.118517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.119040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.119497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.133891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd074-f962-4770-9588-e01a55bb6f6f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.141691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.142954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.143193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.143590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] PATH_INFO: `/v3/projects/38e9c09f929e4e57939e6a6c55a714ce` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.146743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e9c09f929e4e57939e6a6c55a714ce)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.148860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.166607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:15.171355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.190963 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2642/5302] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:15.192431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.205769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c032471-a25f-48eb-9cb8-961b0b733d70 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.211789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.212546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.213062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.213348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.215242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=ef8e232d2d13402f90327385bd4ae400, role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.216517 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:15.216517 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:15.216517 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:15.217408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c545e-0140-4dae-b6b3-e9bb27c51d8f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.395307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e9c09f929e4e57939e6a6c55a714ce', 'request_id': 'req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:15.402501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e9c09f929e4e57939e6a6c55a714ce', 'request_id': 'req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:15.411355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e9c09f929e4e57939e6a6c55a714ce', 'request_id': 'req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:15.412622 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2643/5303] 10.222.0.78 () {58 vars in 1362 bytes} [Sun Aug 28 20:15:15 2022] DELETE /identity/v3/system/users/ef8e232d2d13402f90327385bd4ae400/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:15.414218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad7e3-a197-4a1a-b28e-a923020821f7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.416072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad7e3-a197-4a1a-b28e-a923020821f7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.416072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad7e3-a197-4a1a-b28e-a923020821f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.440563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f5fad7e3-a197-4a1a-b28e-a923020821f7 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:15.441796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f5fad7e3-a197-4a1a-b28e-a923020821f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.513931 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2644/5304] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:15.513931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.513931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.513931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.539125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:15.541819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.611904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] The token cache is being invalidate because project 38e9c09f929e4e57939e6a6c55a714ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:15.612607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:15.613363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:15.620511 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2661/5305] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:15 2022] DELETE /identity/v3/projects/38e9c09f929e4e57939e6a6c55a714ce => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:15.621562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.623782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.636106 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2645/5306] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:15.659684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.659684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.708061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812f2f-ec2a-4d4e-99a3-c06d38bbf937 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.713706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.714182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.714560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.714933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.715718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:15.716107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.717834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.725763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800ecee-70f0-4cb1-9101-36ba4d47af82 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.732400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030353b6-3810-4ffb-b66a-ee7453f50268 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.733068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030353b6-3810-4ffb-b66a-ee7453f50268 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.733486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030353b6-3810-4ffb-b66a-ee7453f50268 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.733791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030353b6-3810-4ffb-b66a-ee7453f50268 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.734544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030353b6-3810-4ffb-b66a-ee7453f50268 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.740976 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2662/5307] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:15.741180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030353b6-3810-4ffb-b66a-ee7453f50268 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.741266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.741266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.858330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2646/5308] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/roles => generated 270 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:15.859851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.860162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.860445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.885432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:15.886735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.890463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233292-a3f5-4592-8f6f-df2a2f1bebed admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.907359 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2647/5309] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:15.907359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.914822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.917265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.917738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.918587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.921722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:15.923039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f242e-66a4-403e-82e3-70b754548e77 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:15.935942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:15.936963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:15.937423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:15.937900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:15.939195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:15.939721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.944770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.951196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:15.954448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:15.983985 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2663/5310] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:15:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:15:15.986477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:15.993589 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2648/5311] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:15.995146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:16.022780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925715d-7876-400e-8e46-28128a55ad22 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:16.039130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:16.040353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:16.040937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:16.041529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:16.042007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e26a-ee86-4ff3-bc5c-c40f9ec4309e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:16.043153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:16.048096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:16.072765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54225ef7-d62c-4350-9499-9e92c4de52c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:16.073771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225ef7-d62c-4350-9499-9e92c4de52c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:16.074281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225ef7-d62c-4350-9499-9e92c4de52c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:16.074770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225ef7-d62c-4350-9499-9e92c4de52c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:16.075962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54225ef7-d62c-4350-9499-9e92c4de52c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:16.079599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54225ef7-d62c-4350-9499-9e92c4de52c9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:16.212259 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2649/5312] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/roles => generated 270 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:16.214929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:16.215318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:16.215784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:16.238419 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2664/5313] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:15 2022] POST /identity/v3/projects => generated 389 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:16.240710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:16.282300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:16.285570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:16.439852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e941f-8bde-4087-93ee-d4a89fce06fe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:16.450347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:16.451164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:16.451518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:16.457927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:16.457927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:16.457927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:16.581670 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2665/5314] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:16 2022] POST /identity/v3/projects => generated 357 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:16.587832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:16.606601 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2650/5315] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:16.610266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:16.654396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859cadf-79ba-4936-b48f-98f7c3b2fa2f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:16.828915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:16.834554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437d9bf-4b3b-48b1-8070-466a332ebafe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:16.865945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:16.866791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:16.872631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:16.872943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:16.872943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:16.872943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61/implies/03da70b75531404c887dd51bc1e4a2ac` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:16.873198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:16.873198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:16.873198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:16.874951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6e2802fe6071412caab8277c33031b61, implied_role_id=03da70b75531404c887dd51bc1e4a2ac)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:16.876776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:16.880913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.051304 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2651/5316] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:16 2022] POST /identity/v3/users => generated 295 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:17.052717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.073473 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2666/5317] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:16 2022] PUT /identity/v3/roles/6e2802fe6071412caab8277c33031b61/implies/03da70b75531404c887dd51bc1e4a2ac => generated 531 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:17.074723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.086855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d27b-4340-4ce3-8ab2-946d24a02f00 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.169030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:17.227077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.228267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.228563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.228818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.229473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.231604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.239674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9653-0ad1-4aef-8a51-0d6c6b95c722 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.254138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.255779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.256483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.257066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.258028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:17.258611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.260723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.282889 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2667/5318] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:17.284803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.298372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e708-2d92-4f04-a7a5-aaef181ce0e9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.308417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.310192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.310923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.311593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.313307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.318561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.340966 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2668/5319] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:17 2022] GET /identity/v3/roles => generated 2323 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:17.342284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.499151 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2652/5320] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:17 2022] POST /identity/v3/users => generated 279 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:17.500286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.509979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c5ba-8f79-4dd7-9c51-a6299441967b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.525460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.531726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.532401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.532928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.534240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.536150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006f46-73fa-4c74-8574-024df32d1c7b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.542569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.565245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.565245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.565245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.565245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.565983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.565983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.738485 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2669/5321] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:15:17 2022] POST /identity/v3/domains => generated 276 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:17.741615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.787392 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2653/5322] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:17 2022] POST /identity/v3/projects => generated 371 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:17.787392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.841974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46c06-4f19-41d5-b87a-25db7da37790 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.911835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265985b-d61a-4071-9c4f-7de8f1558660 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:17.920421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.921482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.921734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.922211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.923242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.926497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:17.947011 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2654/5323] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:17 2022] GET /identity/v3/roles => generated 2323 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:17.956350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:17.985119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:17.988435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:17.988864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:17.990189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:17.991041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:17.999395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.034586 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2670/5324] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:17 2022] GET /identity/v3/roles => generated 2323 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:18.035650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.077294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2dee6-2430-4650-a339-c16d17167bdc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.087508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.088316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.088705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.089084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.090378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.092685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.156202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d7bb-a9ed-4f34-a503-24ee400a7da7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.165487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.166659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.167246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.167917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.169183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.171965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.209367 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2671/5325] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:18 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:18.211246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.230742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab19d4-964e-494b-aa9b-05ba4db96270 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.240870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.241779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.242184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.242483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.243236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.247382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.270057 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2672/5326] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:18 2022] GET /identity/v3/roles => generated 2323 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:18.270057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.279421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63aba9-2e3b-49ee-a104-822e833c0549 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.285132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.286060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.286368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.286662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] PATH_INFO: `/v3/projects/1daba0f46a8349d28dda69dad1203b82/users/58e1edee84d14e25b981214faec83a8e/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.312641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1daba0f46a8349d28dda69dad1203b82, user_id=58e1edee84d14e25b981214faec83a8e, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.319096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.363433 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2655/5327] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:15:17 2022] POST /identity/v3/roles => generated 270 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:18.365344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.417119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317e2f1-855f-4464-b415-240db56c3ead tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.417119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.417119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.417613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.417613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.417613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.417613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.436964 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2656/5328] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:18 2022] GET /identity/v3/roles => generated 2323 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:18.438857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.456572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2673/5329] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:18 2022] PUT /identity/v3/projects/1daba0f46a8349d28dda69dad1203b82/users/58e1edee84d14e25b981214faec83a8e/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:18.457777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.479403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b56f4-a563-41a2-a131-64ce8be4f77c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.577578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.579259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.579773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.580235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] PATH_INFO: `/v3/projects/8e8dfc2fe00a4fe880e5cc54c9ee38d2/users/6a01c77785754eec8b211bb79ca012ed/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.601426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8dfc2fe00a4fe880e5cc54c9ee38d2, user_id=6a01c77785754eec8b211bb79ca012ed, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.606665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.611384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cd6b9-4579-4e4e-bf18-a4564f06f36a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.618918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44079d9d-93b2-490e-82dd-201766326048 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:18.619188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079d9d-93b2-490e-82dd-201766326048 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.619564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079d9d-93b2-490e-82dd-201766326048 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.619865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079d9d-93b2-490e-82dd-201766326048 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61/implies/abe1ba04669d4f319cf115a2bbe236f5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.623130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44079d9d-93b2-490e-82dd-201766326048 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6e2802fe6071412caab8277c33031b61, implied_role_id=abe1ba04669d4f319cf115a2bbe236f5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:18.625685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44079d9d-93b2-490e-82dd-201766326048 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:18.645799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:18.740586 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2657/5330] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:18 2022] PUT /identity/v3/projects/8e8dfc2fe00a4fe880e5cc54c9ee38d2/users/6a01c77785754eec8b211bb79ca012ed/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:18.741469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:18.783403 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2674/5331] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:18 2022] PUT /identity/v3/roles/6e2802fe6071412caab8277c33031b61/implies/abe1ba04669d4f319cf115a2bbe236f5 => generated 531 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:18.785156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457f4b-3e7c-4b12-9594-11a5edbf33de None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.785589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457f4b-3e7c-4b12-9594-11a5edbf33de None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.786934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457f4b-3e7c-4b12-9594-11a5edbf33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:18.856519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e8457f4b-3e7c-4b12-9594-11a5edbf33de None None] MFA Rules not processed for user `58e1edee84d14e25b981214faec83a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:18.857942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e8457f4b-3e7c-4b12-9594-11a5edbf33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:18.863245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f615e7c-1d29-406e-92b9-5171b84d80c6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:18.957087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:18.978839 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2675/5332] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:18.980431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:18.990522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:18.990522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.007455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:19.008309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:19.008755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:19.009271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.010162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:19.011955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:19.034237 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2658/5333] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:18 2022] GET /identity/v3/roles => generated 2323 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:19.034465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] MFA Rules not processed for user `6a01c77785754eec8b211bb79ca012ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:19.034595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:19.034679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:19.193538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2e2f-101c-4a77-a647-29cf8423248c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:19.210600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:19.211297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:19.211642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:19.212074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61/implies/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.215302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6e2802fe6071412caab8277c33031b61, implied_role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:19.216407 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:19.216407 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:19.216407 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:19.217407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:19.229108 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2676/5334] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:19.230215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:19.254327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3907fb-1bfd-48e5-993f-0d39760c6bf3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:19.261559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:19.262516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:19.262999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:19.263698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.264444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:19.266763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:19.339169 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2659/5335] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:19 2022] PUT /identity/v3/roles/6e2802fe6071412caab8277c33031b61/implies/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 526 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:19.340201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:19.403655 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2677/5336] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:19 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:19.404568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:19.427841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:19.502566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f19a4-51a1-4792-aea6-7bd3347c698f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:19.564432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f5d2-020a-4b5d-81ef-f0ed63a420e1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:19.571219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:19.571995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:19.572368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:19.572702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] PATH_INFO: `/v3/users/691a5a982e364bb3afbda53229b8926f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.575970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691a5a982e364bb3afbda53229b8926f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:19.586918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:19.589559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f230-9676-4b72-badd-8127cafc7790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:19.592645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f230-9676-4b72-badd-8127cafc7790 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:19.592645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f230-9676-4b72-badd-8127cafc7790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:19.592645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f230-9676-4b72-badd-8127cafc7790 admin admin] PATH_INFO: `/v3/projects/2448bb065cbe4220b31aee7fc873b066/users/838bfffecb0a4939a4713a2835b6af45/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.643305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f230-9676-4b72-badd-8127cafc7790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2448bb065cbe4220b31aee7fc873b066, user_id=838bfffecb0a4939a4713a2835b6af45, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:19.646333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f230-9676-4b72-badd-8127cafc7790 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:19.783877 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2660/5337] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:19 2022] PUT /identity/v3/projects/2448bb065cbe4220b31aee7fc873b066/users/838bfffecb0a4939a4713a2835b6af45/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:19.785185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:19.785476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:19.785758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:19.836098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] MFA Rules not processed for user `6a01c77785754eec8b211bb79ca012ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:19.839293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:19.846468 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2661/5338] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:19 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:15:19.848816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:19.927796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:19.937108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691a5a982e364bb3afbda53229b8926f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:19.938748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691a5a982e364bb3afbda53229b8926f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:20.024943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d050c2-6451-4bc6-a808-94b927a45132 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:20.030847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:20.032024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.032645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.033251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/a17bc4e2c2a54271b895dcd6e6f018d5/implies/6e2802fe6071412caab8277c33031b61` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.035451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a17bc4e2c2a54271b895dcd6e6f018d5, implied_role_id=6e2802fe6071412caab8277c33031b61)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:20.038439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:20.041464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691a5a982e364bb3afbda53229b8926f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:20.067326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691a5a982e364bb3afbda53229b8926f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] 6e2802fe6071412caab8277c33031b61 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 6e2802fe6071412caab8277c33031b61 cannot be an implied roles. Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 28 20:15:20.068933 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 28 20:15:20.071164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:20.071164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:20.071164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 28 20:15:20.071164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 28 20:15:20.071164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 6e2802fe6071412caab8277c33031b61 cannot be an implied roles. Aug 28 20:15:20.071164 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:20.071966 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2662/5339] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:19 2022] PUT /identity/v3/roles/a17bc4e2c2a54271b895dcd6e6f018d5/implies/6e2802fe6071412caab8277c33031b61 => generated 116 bytes in 224 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:20.072476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:20.079483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-98d8118c-1518-4c69-9b91-f204e0f5f473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691a5a982e364bb3afbda53229b8926f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:20.132114 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2678/5340] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:19 2022] DELETE /identity/v3/users/691a5a982e364bb3afbda53229b8926f => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:20.132114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671766c5-979f-4bef-bf03-72df5f067e0d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.132114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671766c5-979f-4bef-bf03-72df5f067e0d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.132114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671766c5-979f-4bef-bf03-72df5f067e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.185248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-671766c5-979f-4bef-bf03-72df5f067e0d None None] MFA Rules not processed for user `838bfffecb0a4939a4713a2835b6af45`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:20.187014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-671766c5-979f-4bef-bf03-72df5f067e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.279346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18872fe-eb04-4f12-8fee-a0398611c627 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:20.310662 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2679/5341] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:20.310662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.310662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.310662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.357896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] MFA Rules not processed for user `6a01c77785754eec8b211bb79ca012ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:20.359442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.373673 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2680/5342] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:20 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:15:20.373673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:20.373673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.374789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc56a-6c22-4170-a859-6dad1515642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:20.374789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc56a-6c22-4170-a859-6dad1515642d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.374789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc56a-6c22-4170-a859-6dad1515642d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.374789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc56a-6c22-4170-a859-6dad1515642d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.375194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bc56a-6c22-4170-a859-6dad1515642d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:20.375194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bc56a-6c22-4170-a859-6dad1515642d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:20.497150 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2663/5343] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:20 2022] POST /identity/v3/users => generated 299 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:20.498438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.498729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.499006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.499402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520c2ec-8e17-4cf0-b110-f61c4ad5058b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:20.507811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:20.508727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.509094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.509492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61/implies/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.512009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6e2802fe6071412caab8277c33031b61, implied_role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:20.519824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:20.535472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:20.538194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.561040 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2664/5344] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:20.562537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:20.567019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.596747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76e83-c79a-43ff-9a66-cc7ee76b90b1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:20.611538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:20.612614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.613150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.613590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.615553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:20.622791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:20.743890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2681/5345] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:20 2022] DELETE /identity/v3/roles/6e2802fe6071412caab8277c33031b61/implies/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:20.745075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:20.751126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.835141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a5cc-bd29-4061-add5-9ecf658acf25 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:20.841724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:20.843106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:20.843773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:20.844477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:20.865388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2665/5346] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:20 2022] POST /identity/v3/projects => generated 373 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:20.866123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorizing `identity:check_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:20.867270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:20.869762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:20.878274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:20.883351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2682/5347] 10.222.0.78 () {56 vars in 1264 bytes} [Sun Aug 28 20:15:20 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 28 20:15:20.887937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:20.894790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:21.003721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4329c2-9f6c-4726-8b32-a4540e4404fe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.009228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.010079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.011613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.011613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.011613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.013489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.022835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151e4a-c80b-4eee-b158-db68e5f493fd tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.033418 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2666/5348] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:20 2022] GET /identity/v3/roles => generated 2323 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:21.034527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.125508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.126634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.127126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.127712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.150530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ca839-7f7b-4125-87e7-3ea984b445a4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.150939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.152913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.154250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:21.163711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.163711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.163711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.164151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61/implies/abe1ba04669d4f319cf115a2bbe236f5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.164151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6e2802fe6071412caab8277c33031b61, implied_role_id=abe1ba04669d4f319cf115a2bbe236f5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.166006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2683/5349] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:21.167808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.180317 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:21.180317 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:21.180317 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:21.183078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea9b8-4de7-4f4c-9b0c-23d7838a73d7 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.183929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.189543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.198670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.198670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.198670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.198670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.198670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.304410 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2667/5350] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:21 2022] DELETE /identity/v3/roles/6e2802fe6071412caab8277c33031b61/implies/abe1ba04669d4f319cf115a2bbe236f5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:21.306237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.362533 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2684/5351] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:21 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:21.363766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.391119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391f6b0-ac74-48c6-b945-f28efeea4802 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.413063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70112995-e365-4a5d-ba1a-b73297f6faac tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.419801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.420434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.420718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.421067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.440054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:21.452984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.455386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.470650 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2668/5352] 10.222.0.78 () {56 vars in 1263 bytes} [Sun Aug 28 20:15:21 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 20:15:21.478919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.542585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.543369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.543666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.544366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] PATH_INFO: `/v3/projects/9407f08c3ca14f9695c0b91871460b6b/users/60f9883a6278439ebe68221960febafd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.599405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9407f08c3ca14f9695c0b91871460b6b, user_id=60f9883a6278439ebe68221960febafd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.603504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.651285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15dac5-db04-4905-96d8-98511daba29e tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.660684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.674310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.674310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.674310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/abe1ba04669d4f319cf115a2bbe236f5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.682749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=abe1ba04669d4f319cf115a2bbe236f5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.682749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.713724 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2685/5353] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:21 2022] PUT /identity/v3/projects/9407f08c3ca14f9695c0b91871460b6b/users/60f9883a6278439ebe68221960febafd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:21.713724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.836499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role abe1ba04669d4f319cf115a2bbe236f5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:21.836499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:21.837029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:21.843357 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2669/5354] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:21 2022] DELETE /identity/v3/roles/abe1ba04669d4f319cf115a2bbe236f5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:21.844314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.849608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:21.948157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96585ce-53f8-4ad4-aaaf-7a7e1e268676 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.024121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2763b01-38b1-475a-8db4-91cb80e0ad0a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.038488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.042069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.042578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.043026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.046499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.061803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.064700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.117479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.118486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.118964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.119742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.120960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.124563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.151756 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2686/5355] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:21 2022] GET /identity/v3/roles => generated 2323 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:22.154649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.157365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.182423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ebb1-0182-4a9e-94df-b6c1228d1fe2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.191058 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2670/5356] 10.222.0.78 () {56 vars in 1266 bytes} [Sun Aug 28 20:15:21 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:22.193077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.200464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.201407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.201827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.202102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.202680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.203701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.206230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.224673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:22.226046 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2687/5357] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:22 2022] GET /identity/v3/roles => generated 2323 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:22.227916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.231127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.252889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c1bad-f627-43f5-b7c5-09728da4a856 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.260898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.262216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.262838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.263363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] PATH_INFO: `/v3/projects/457a5891b549434d9f71572c03585131` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.265564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457a5891b549434d9f71572c03585131)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.269905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.309319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c5d6-ab00-4b9b-acd8-21315ab628fa tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.315320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.316389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.316899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.318009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/7f1d7fba0dd240f68d340d1cfd63c255` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.332774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7f1d7fba0dd240f68d340d1cfd63c255)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.335041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.372755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.373429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.435876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457a5891b549434d9f71572c03585131', 'request_id': 'req-39a6517e-a3f2-4449-9820-1f57bf9f4e82'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.451107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457a5891b549434d9f71572c03585131', 'request_id': 'req-39a6517e-a3f2-4449-9820-1f57bf9f4e82'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.467955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457a5891b549434d9f71572c03585131', 'request_id': 'req-39a6517e-a3f2-4449-9820-1f57bf9f4e82'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.492419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.494753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.502386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2671/5358] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:15:22 2022] PATCH /identity/v3/domains/7f1d7fba0dd240f68d340d1cfd63c255 => generated 277 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:22.502386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.502386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.592401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69220da3-a09a-4e56-9a2c-5f1acc1e6f51 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.595083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] The token cache is being invalidate because project 457a5891b549434d9f71572c03585131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:22.595350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.596123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:22.600865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2688/5359] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:22 2022] DELETE /identity/v3/projects/457a5891b549434d9f71572c03585131 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:22.602169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.603606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.717407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6517e-a3f2-4449-9820-1f57bf9f4e82 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.719944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.720707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.720933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.721210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] PATH_INFO: `/v3/projects/1c8f728c1cda461b9db76dba7a92265e/users/6e4ff6cbda604aa6afacf6dcc7f94d96/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.727922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.729834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.729834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.729834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.732475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.752817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8f728c1cda461b9db76dba7a92265e, user_id=6e4ff6cbda604aa6afacf6dcc7f94d96, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.756206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 28 20:15:22.766914 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 20:15:22.768134 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 20:15:22.769433 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:22.769433 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:22.769433 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 20:15:22.769433 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 20:15:22.769433 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 20:15:22.769433 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:22.775641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2689/5360] 10.222.0.78 () {56 vars in 1264 bytes} [Sun Aug 28 20:15:22 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 28 20:15:22.775641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.777816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.799249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada6b2c-628c-4538-a09f-16c7b0860eed tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.805641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:22.806529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:22.813720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:22.813720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] PATH_INFO: `/v3/projects/9407f08c3ca14f9695c0b91871460b6b/users/60f9883a6278439ebe68221960febafd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:22.813720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:22.816634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9407f08c3ca14f9695c0b91871460b6b, user_id=60f9883a6278439ebe68221960febafd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:22.818196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:22.842694 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2690/5361] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:22 2022] PUT /identity/v3/projects/9407f08c3ca14f9695c0b91871460b6b/users/60f9883a6278439ebe68221960febafd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:22.843807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.854690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.882099 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2672/5362] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:22 2022] PUT /identity/v3/projects/1c8f728c1cda461b9db76dba7a92265e/users/6e4ff6cbda604aa6afacf6dcc7f94d96/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:22.883299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:22.887051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:22.957255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ac48-0d83-4df0-877d-ced9c0f4b4f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:22.995975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7838f70-c7ff-4837-85f8-fcc5bfd778c0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:23.018724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:23.025994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:23.025994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:23.025994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] PATH_INFO: `/v3/users/45ae7e6181c24740ae052cd2260f074c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:23.027631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ae7e6181c24740ae052cd2260f074c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:23.032877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:23.051307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:23.051307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:23.051307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:23.052028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/7f1d7fba0dd240f68d340d1cfd63c255` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:23.070133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7f1d7fba0dd240f68d340d1cfd63c255)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:23.072177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:23.117760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.130917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.326036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ae7e6181c24740ae052cd2260f074c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.327107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255', 'request_id': 'req-5b8c1965-2230-44c2-aa25-93f553580912'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.335746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255', 'request_id': 'req-5b8c1965-2230-44c2-aa25-93f553580912'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.341756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ae7e6181c24740ae052cd2260f074c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.346761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255', 'request_id': 'req-5b8c1965-2230-44c2-aa25-93f553580912'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.357546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ae7e6181c24740ae052cd2260f074c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.358461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ae7e6181c24740ae052cd2260f074c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.359246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ae7e6181c24740ae052cd2260f074c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.503372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] The token cache is being invalidate because project 7f1d7fba0dd240f68d340d1cfd63c255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:23.503742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.504537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.518666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255', 'request_id': 'req-5b8c1965-2230-44c2-aa25-93f553580912'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.528738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255', 'request_id': 'req-5b8c1965-2230-44c2-aa25-93f553580912'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.530300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5b8c1965-2230-44c2-aa25-93f553580912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7f1d7fba0dd240f68d340d1cfd63c255', 'request_id': 'req-5b8c1965-2230-44c2-aa25-93f553580912'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:23.540202 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2691/5363] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:15:22 2022] DELETE /identity/v3/domains/7f1d7fba0dd240f68d340d1cfd63c255 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:23.542347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507102ef-ba82-4b57-a172-0fa5facafce3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:23.542929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507102ef-ba82-4b57-a172-0fa5facafce3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:23.543480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507102ef-ba82-4b57-a172-0fa5facafce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:23.569221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-507102ef-ba82-4b57-a172-0fa5facafce3 None None] MFA Rules not processed for user `6a01c77785754eec8b211bb79ca012ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:23.570411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-507102ef-ba82-4b57-a172-0fa5facafce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:23.573868 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2692/5364] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:23 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:15:23.575230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:23.575521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:23.575795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:23.613374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] MFA Rules not processed for user `60f9883a6278439ebe68221960febafd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:23.614690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:23.744021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2693/5365] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:23.745574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:23.756852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:23.798056 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2673/5366] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:22 2022] DELETE /identity/v3/users/45ae7e6181c24740ae052cd2260f074c => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:23.838573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:23.838573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:23.881767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6544d-8be5-43fd-ba47-08aae0a528cf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:23.975001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961a62-3467-4000-bc34-c371817084d1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:24.001206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.003035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.004772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.005160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61/implies/03da70b75531404c887dd51bc1e4a2ac` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.025177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.026294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6e2802fe6071412caab8277c33031b61, implied_role_id=03da70b75531404c887dd51bc1e4a2ac)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.026468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.026468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.026675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.027459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.031333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.032542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.051531 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2694/5367] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:23 2022] GET /identity/v3/roles => generated 2323 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:24.051531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:24.053113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:24.136788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143130-e79d-4840-a563-aa6e0a7d1f5f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:24.142503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.143147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.143519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.143794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.153351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.155303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.168011 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2695/5368] 10.222.0.78 () {56 vars in 1263 bytes} [Sun Aug 28 20:15:24 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 20:15:24.168011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:24.170267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:24.190635 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2674/5369] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:23 2022] DELETE /identity/v3/roles/6e2802fe6071412caab8277c33031b61/implies/03da70b75531404c887dd51bc1e4a2ac => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:24.195627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:24.317033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a5fc-b55a-421f-97e1-d1b056c04c95 tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:24.411469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a0be-2ab8-4174-be6e-9a040840d3a6 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:24.422538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.433368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.433368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.433368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.433976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.433976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.433976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.433976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] PATH_INFO: `/v3/projects/1c8f728c1cda461b9db76dba7a92265e/users/6e4ff6cbda604aa6afacf6dcc7f94d96/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.434710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:24.434886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8f728c1cda461b9db76dba7a92265e, user_id=6e4ff6cbda604aa6afacf6dcc7f94d96, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.446530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.475207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2675/5370] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:24 2022] PUT /identity/v3/projects/1c8f728c1cda461b9db76dba7a92265e/users/6e4ff6cbda604aa6afacf6dcc7f94d96/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:24.478041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:24.488611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:24.583355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.585205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.598236 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2696/5371] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:24.600953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:24.602994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:24.655943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7cd57-31ea-47d1-8478-406f49fb072a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:24.674435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa96a45-2497-4d69-b112-4c856174f2ae tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.675082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa96a45-2497-4d69-b112-4c856174f2ae tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.675359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa96a45-2497-4d69-b112-4c856174f2ae tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.675652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa96a45-2497-4d69-b112-4c856174f2ae tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.694277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa96a45-2497-4d69-b112-4c856174f2ae tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.696083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa96a45-2497-4d69-b112-4c856174f2ae tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.742924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bd77f-7386-4e35-a810-7cd3a1d4af7f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:24.827870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:24.894957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:24.896315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.896866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.897284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/03da70b75531404c887dd51bc1e4a2ac` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.899739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=03da70b75531404c887dd51bc1e4a2ac)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:24.903715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:24.936940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2676/5372] 10.222.0.78 () {56 vars in 1266 bytes} [Sun Aug 28 20:15:24 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:24.942156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:24.942156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:24.942156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:24.980077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] MFA Rules not processed for user `6e4ff6cbda604aa6afacf6dcc7f94d96`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:24.987827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.103955 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2677/5373] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:25.104828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:25.106326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.194250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role 03da70b75531404c887dd51bc1e4a2ac has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:25.195406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.195715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.201814 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2697/5374] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:24 2022] DELETE /identity/v3/roles/03da70b75531404c887dd51bc1e4a2ac => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:25.203491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:25.205369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.222655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce627f-0051-4db6-91ae-2850149170f7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:25.260651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:25.317030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf0168-1f0d-4500-b480-7cbc8feb092a tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:25.325608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a01c77785754eec8b211bb79ca012ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:25.326663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:25.327292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:25.327643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:25.331083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 28 20:15:25.348812 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 20:15:25.350492 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 20:15:25.353262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:25.353262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:25.353262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 20:15:25.353262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 20:15:25.353262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 20:15:25.353262 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:25.356305 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2698/5375] 10.222.0.78 () {56 vars in 1263 bytes} [Sun Aug 28 20:15:25 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:15:25.357209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:25.371278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.371734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:25.371734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:25.371734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:25.371734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] PATH_INFO: `/v3/projects/27b1890a4a6644569c728faf20190ab4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:25.372123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b1890a4a6644569c728faf20190ab4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:25.372123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:25.456963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7923e-fb5f-463d-a31e-d716d864377f tempest-TokensV3Test-79678583 tempest-TokensV3Test-79678583-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:25.462012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:25.462811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:25.463032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:25.463320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:25.466326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.574550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:25.577690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:25.609957 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2699/5376] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:25.609957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:25.609957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.656002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b1890a4a6644569c728faf20190ab4', 'request_id': 'req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.667888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b1890a4a6644569c728faf20190ab4', 'request_id': 'req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.676610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b1890a4a6644569c728faf20190ab4', 'request_id': 'req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.749526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814d01e-8118-416b-9ebb-424f19f02445 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:25.903227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] The token cache is being invalidate because project 27b1890a4a6644569c728faf20190ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:25.903227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.903227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:25.903227 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2678/5377] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:25 2022] DELETE /identity/v3/projects/27b1890a4a6644569c728faf20190ab4 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:25.903227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:25.905216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:25.922783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:25.923999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:25.924297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:25.924840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/6e2802fe6071412caab8277c33031b61` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:25.949841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6e2802fe6071412caab8277c33031b61)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:25.954189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:26.145576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa2fe4-88ef-47be-af5d-f394ffa3ace9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:26.165566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:26.167216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:26.167950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:26.168481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] PATH_INFO: `/v3/users/6a01c77785754eec8b211bb79ca012ed` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:26.171206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a01c77785754eec8b211bb79ca012ed)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:26.174006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:26.912473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role 6e2802fe6071412caab8277c33031b61 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:26.913375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:26.913716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:26.917676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2700/5378] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:25 2022] DELETE /identity/v3/roles/6e2802fe6071412caab8277c33031b61 => generated 0 bytes in 1320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:26.918486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:26.920469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:27.016365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762409a1-6614-44c6-a9ee-bb1fc1431dd0 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:27.023789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:27.024592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.025096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.025590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] PATH_INFO: `/v3/users/8b980965953d4640b9e85fce120425b3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.033351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b980965953d4640b9e85fce120425b3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.033351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.107716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a01c77785754eec8b211bb79ca012ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.125925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a01c77785754eec8b211bb79ca012ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.137091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a01c77785754eec8b211bb79ca012ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.138018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a01c77785754eec8b211bb79ca012ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.138667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a01c77785754eec8b211bb79ca012ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.298523 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2679/5379] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:25 2022] DELETE /identity/v3/users/6a01c77785754eec8b211bb79ca012ed => generated 0 bytes in 1416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:27.299528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:27.301243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:27.383035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b980965953d4640b9e85fce120425b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.384960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b980965953d4640b9e85fce120425b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.393490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499fa1d-193f-4b06-982f-d32fd0bb324c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:27.399881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:27.400973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.401540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.402216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.404577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.406719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.470739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b980965953d4640b9e85fce120425b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.485185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b980965953d4640b9e85fce120425b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.486345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-23778b0b-e760-4287-afe9-b04fb00b3025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b980965953d4640b9e85fce120425b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:27.518354 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2701/5380] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:26 2022] DELETE /identity/v3/users/8b980965953d4640b9e85fce120425b3 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:27.520665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.521255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.521898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.540911 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2680/5381] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:27 2022] PUT /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 520 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:27.541538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:27.544827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:27.564192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:27.566405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:27.699152 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2702/5382] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:27.711664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:27.713903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:27.727466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8a57-acec-4bef-aa76-ac9ff165a0d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:27.740433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:27.745276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.745276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.745276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.747247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.750443 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:27.750443 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:27.750443 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:27.751856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.754479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.756203 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:27.756203 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:27.756203 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:27.757099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.763855 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2681/5383] 10.222.0.78 () {58 vars in 1345 bytes} [Sun Aug 28 20:15:27 2022] HEAD /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:27.768550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:27.782076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d531d7-6114-4d52-bdd3-a919fbaf3b20 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:27.788161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:27.789120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.789457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.789740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.792339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.794632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.794912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab6555-0b44-4c72-9053-ea61290a4754 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:27.799767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:27.800507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.800860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.801204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.805137 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2682/5384] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:15:27 2022] GET /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 520 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:15:27.809163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:27.839280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe2ac7-181c-4776-9e86-1ee08321ee52 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:27.845631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.847709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.852224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:27.853222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:27.853737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:27.854286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:27.857471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:27.859292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:27.862575 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2703/5385] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:15:28.018464 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2683/5386] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:27 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:28.019451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:28.055938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818281-273c-426d-aa8f-db9c7a65563a service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:28.164099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:28.164772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:28.165051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:28.165337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:28.168318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:28.169877 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:28.169877 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:28.169877 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:28.171873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2.: keystone.exception.ImpliedRoleNotFound: 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2. Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = query.one() Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:28.183818 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 20:15:28.185069 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 20:15:28.186339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 20:15:28.186339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2. Aug 28 20:15:28.186339 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:15:28.190137 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2704/5387] 10.222.0.78 () {58 vars in 1344 bytes} [Sun Aug 28 20:15:28 2022] GET /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 137 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:28.190966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:28.204399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142baeb-c30c-404c-a024-41833c00108f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:28.211163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:28.212197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:28.212493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:28.212829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:28.215093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:28.217056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:28.230425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:28.233047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2.: keystone.exception.ImpliedRoleNotFound: 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2. Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = query.one() Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:28.237421 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 20:15:28.238791 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 20:15:28.240442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 20:15:28.240442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 20:15:28.240442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 20:15:28.240442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 8c00f05e6c3f4c5ba3198474ae2a6844 does not imply c11cd3f1329f4f28aeb7216e00775ad2. Aug 28 20:15:28.240442 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:28.240442 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2684/5388] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:28 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 137 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:28.243587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:28.256377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9a1c8-2a4f-4b9e-b79b-ce7498fdebf3 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:28.262915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:28.262915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:28.262915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:28.263452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:28.264800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:28.266449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:28.353232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeea7a-67a0-4c97-b090-fdf30fc670bd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:28.359585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:28.360247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:28.360530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:28.360810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] PATH_INFO: `/v3/users/838bfffecb0a4939a4713a2835b6af45` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:28.362309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] RBAC: Authorizing `identity:delete_user(user_id=838bfffecb0a4939a4713a2835b6af45)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:28.365068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:28.469618 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2685/5389] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:28 2022] PUT /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 520 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:15:28.471511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:28.475464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:28.589780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108c3e4-9027-449f-8f3c-be8fb17ab9af tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:28.613687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:28.617388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:28.617388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:28.617388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] PATH_INFO: `/v3/projects/9ce4158048ab4f7288f709120bb2a381` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:28.617388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce4158048ab4f7288f709120bb2a381)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:28.618729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:28.802901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838bfffecb0a4939a4713a2835b6af45'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:28.803580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838bfffecb0a4939a4713a2835b6af45'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:28.927181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce4158048ab4f7288f709120bb2a381', 'request_id': 'req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:28.933541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce4158048ab4f7288f709120bb2a381', 'request_id': 'req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:28.941394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce4158048ab4f7288f709120bb2a381', 'request_id': 'req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.022574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838bfffecb0a4939a4713a2835b6af45'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.033154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838bfffecb0a4939a4713a2835b6af45'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.034018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838bfffecb0a4939a4713a2835b6af45'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.055995 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2705/5390] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:28 2022] DELETE /identity/v3/users/838bfffecb0a4939a4713a2835b6af45 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:29.056915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:29.058507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.132342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287001-4e5d-41c7-b4be-52d4bc9f794d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:29.137453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255198ee-dfde-465b-b640-67a3875090fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:29.138311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255198ee-dfde-465b-b640-67a3875090fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.138438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255198ee-dfde-465b-b640-67a3875090fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.138712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255198ee-dfde-465b-b640-67a3875090fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.140515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255198ee-dfde-465b-b640-67a3875090fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=e3af70434aba4ab9804b9212a503da0e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:29.142195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255198ee-dfde-465b-b640-67a3875090fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:29.195596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] The token cache is being invalidate because project 9ce4158048ab4f7288f709120bb2a381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:29.195596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.195596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.197467 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2686/5391] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:28 2022] DELETE /identity/v3/projects/9ce4158048ab4f7288f709120bb2a381 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:29.198633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:29.202015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.203317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:29.292331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a5aaf-1395-457e-8fe0-64343c9b24e6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:29.337227 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2706/5392] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:29 2022] PUT /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e => generated 520 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:29.337227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfc79-099a-4860-b938-2d025e1b0683 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.337641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfc79-099a-4860-b938-2d025e1b0683 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.338946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfc79-099a-4860-b938-2d025e1b0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.381656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:29.382510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.382914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.383543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] PATH_INFO: `/v3/projects/8e8dfc2fe00a4fe880e5cc54c9ee38d2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.384702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-80fdfc79-099a-4860-b938-2d025e1b0683 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:29.384955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8dfc2fe00a4fe880e5cc54c9ee38d2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:29.386794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-80fdfc79-099a-4860-b938-2d025e1b0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.387640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:29.467454 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2707/5393] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:29.469149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.469498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.469773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.493446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:29.494728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.503298 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2708/5394] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:29.504112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:29.505425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.561591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'request_id': 'req-8e06604d-a17d-480d-a0cf-c629ef72f59e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.574158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'request_id': 'req-8e06604d-a17d-480d-a0cf-c629ef72f59e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.585084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978cd82-b852-4f94-85df-cf7da64fe836 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:29.587235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8dfc2fe00a4fe880e5cc54c9ee38d2', 'request_id': 'req-8e06604d-a17d-480d-a0cf-c629ef72f59e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.666646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d1e2-2903-432f-95ff-f80db7605f95 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:29.667378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d1e2-2903-432f-95ff-f80db7605f95 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.667668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d1e2-2903-432f-95ff-f80db7605f95 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.667952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d1e2-2903-432f-95ff-f80db7605f95 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.670119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d1e2-2903-432f-95ff-f80db7605f95 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3af70434aba4ab9804b9212a503da0e, implied_role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:29.675029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d1e2-2903-432f-95ff-f80db7605f95 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:29.716817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] The token cache is being invalidate because project 8e8dfc2fe00a4fe880e5cc54c9ee38d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:29.717122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.717860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:29.719508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2687/5395] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:29 2022] DELETE /identity/v3/projects/8e8dfc2fe00a4fe880e5cc54c9ee38d2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:29.720350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:29.721742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.810444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06604d-a17d-480d-a0cf-c629ef72f59e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:29.818475 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2709/5396] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:29 2022] PUT /identity/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 521 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:29.819801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c891-7971-4ce8-8799-a0e2a01907b4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.820086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c891-7971-4ce8-8799-a0e2a01907b4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.820369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c891-7971-4ce8-8799-a0e2a01907b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.847620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:29.857134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1db2c891-7971-4ce8-8799-a0e2a01907b4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:29.859597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1db2c891-7971-4ce8-8799-a0e2a01907b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.927093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:29.927752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.928037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.928354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.931419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.950025 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2710/5397] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:29.951262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:29.951448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:29.951873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:29.978725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:29.979867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:29.991066 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2711/5398] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:29.998445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:29.998445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:30.084100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.085799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.094247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fd3a5-3012-4908-ba6c-16d67d382942 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.098120 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2688/5399] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:30.098321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.098922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.099084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.099192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.099470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.100077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.101085 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:30.101085 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:30.101085 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:30.102009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd5391-b5ec-4b5a-99df-b20d67159559 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.111448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a71a2-3a39-40ce-9108-7e9018e31986 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.117916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.118786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.119117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.119402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.120064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:30.120371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.122115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.122495 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2712/5400] 10.222.0.78 () {58 vars in 1152 bytes} [Sun Aug 28 20:15:29 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:30.127713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.128062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.128348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.141059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2689/5401] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:30.155938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.156115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:30.156115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:30.156611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe334-e734-43c8-811f-264e9bcfbebc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.162647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.163413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.163708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.163993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.164125 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2713/5402] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:30.165773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3af70434aba4ab9804b9212a503da0e, implied_role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.167471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.168212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.178993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157c36a-2357-4311-b632-56bfe73b396a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.186100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.186100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.186100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.186100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.186552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.188679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.282864 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2690/5403] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:30 2022] DELETE /identity/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:30.282864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.362085 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2714/5404] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:30 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:30.363196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.391990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dcfbd-044b-469e-a6f5-9586cbd258fe tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.469074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.470073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.470073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.470927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.471658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:30.472145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.475509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.481574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6df8-c58f-43da-bf1d-7011f92804ca admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.492655 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2691/5405] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:30.494143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.499153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.500152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.500668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.501170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.503196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=e3af70434aba4ab9804b9212a503da0e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.508679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4520-72b8-4255-8f43-424e7a759f93 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.508998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.517409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.518249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.518625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.518992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.519731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.524491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.635246 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2715/5406] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:30 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:30.639782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.641906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:30.724733 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2692/5407] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:30 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:30.724733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:30.761760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161438e3-756a-485a-be72-390c4d688b49 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.761899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd552a-73e3-4a32-96b0-38a78ab08456 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:30.765129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.765883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.766054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.766332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.768356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:30.854313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:30.855278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:30.855522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:30.855799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:30.856459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.858466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.889000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:30.891038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:30.906592 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2716/5408] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:30.906592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.005258 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2693/5409] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:30 2022] POST /identity/v3/projects => generated 391 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:31.006295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.025091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303893-6f93-417d-80a2-1c69405110fe service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.106723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dbaf3-8f84-449b-8fcb-8d9e33130062 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.114398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.115033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.115316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.115737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.133120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.134026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.134343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.134343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.136369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.136587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.138081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.138688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.177089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2694/5410] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:31 2022] GET /identity/v3/roles => generated 2323 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:31.177725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.180109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:31.197818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fcaa7-7538-49b6-ab75-03fbbdf1fc26 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.204037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.204775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.205892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.206576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] PATH_INFO: `/v3/projects/2448bb065cbe4220b31aee7fc873b066` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.208498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2448bb065cbe4220b31aee7fc873b066)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.211541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.212603 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2717/5411] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:30 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:31.219716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.330178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c7f64-6467-4997-9c34-496e140ed987 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.336298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.336947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.337229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.337507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.338244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.340788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.397176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:31.404252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2448bb065cbe4220b31aee7fc873b066', 'request_id': 'req-78711ad7-8707-4b47-9392-1024bd8a76de'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.410831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2448bb065cbe4220b31aee7fc873b066', 'request_id': 'req-78711ad7-8707-4b47-9392-1024bd8a76de'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.422211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2448bb065cbe4220b31aee7fc873b066', 'request_id': 'req-78711ad7-8707-4b47-9392-1024bd8a76de'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.447828 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2718/5412] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:31 2022] POST /identity/v3/users => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:31.447828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.458486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90c377-97d5-4f88-87c0-7b93f97a9caa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.514516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] The token cache is being invalidate because project 2448bb065cbe4220b31aee7fc873b066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:31.514851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.516302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.521920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2695/5413] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:31 2022] DELETE /identity/v3/projects/2448bb065cbe4220b31aee7fc873b066 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:31.522892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.524439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:31.539035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.543244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.543244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.543244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.543244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.543636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.564103 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2719/5414] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:31 2022] GET /identity/v3/roles => generated 2323 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:31.566634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.569694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:31.584024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fe768-dff0-49f4-a0cb-f4bb489366e4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.590160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.590789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.591075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.591352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.592002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.593629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.606616 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2720/5415] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:31 2022] GET /identity/v3/roles => generated 2323 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:31.607659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.611078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:31.620269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711ad7-8707-4b47-9392-1024bd8a76de admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.624895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1fe2-547e-409c-aa72-a6ad067134f9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.625588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.626404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.626696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.626994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.627660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.629250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.631912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.633028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.633535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.634075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] PATH_INFO: `/v3/users/6e4ff6cbda604aa6afacf6dcc7f94d96` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.636336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4ff6cbda604aa6afacf6dcc7f94d96)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.640671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.648444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2696/5416] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:31 2022] GET /identity/v3/roles => generated 2323 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:31.648444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.649183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:31.664766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a3993-0a57-4bc7-a281-813d7280fa03 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.671772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.672453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.672764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.677465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] PATH_INFO: `/v3/projects/aa104329df3245cb8477ead234930fb1/users/a6a0649833504704915d8ee791018442/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.691340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa104329df3245cb8477ead234930fb1, user_id=a6a0649833504704915d8ee791018442, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.696125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.780493 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2697/5417] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:31 2022] PUT /identity/v3/projects/aa104329df3245cb8477ead234930fb1/users/a6a0649833504704915d8ee791018442/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:31.781197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:31.867804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195bb33-bf75-4123-ae58-0921a68a1563 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:31.877540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:31.879324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:31.880830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:31.881054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4ff6cbda604aa6afacf6dcc7f94d96'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.881748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] PATH_INFO: `/v3/projects/f3a84236e584447db77dccfe9748eba1/users/302da924dd2b4a2b8ca4c0c2b26a28ac/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:31.881972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4ff6cbda604aa6afacf6dcc7f94d96'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.909090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a84236e584447db77dccfe9748eba1, user_id=302da924dd2b4a2b8ca4c0c2b26a28ac, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:31.912120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:31.914367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:31.965771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4ff6cbda604aa6afacf6dcc7f94d96'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.976625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4ff6cbda604aa6afacf6dcc7f94d96'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:31.977383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b9d92eb5-d416-4bcb-a2f6-3425b649baa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4ff6cbda604aa6afacf6dcc7f94d96'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:32.007808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2698/5418] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:31 2022] PUT /identity/v3/projects/f3a84236e584447db77dccfe9748eba1/users/302da924dd2b4a2b8ca4c0c2b26a28ac/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:32.010855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.010971 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2721/5419] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:31 2022] DELETE /identity/v3/users/6e4ff6cbda604aa6afacf6dcc7f94d96 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:32.011662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.011951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.012225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.014009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:32.045328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] MFA Rules not processed for user `a6a0649833504704915d8ee791018442`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:32.046975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:32.103723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f567-c484-428c-93c4-4d63181f5615 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.149842 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2722/5420] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:32.151662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.153388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:32.204637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.205817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.214911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.214911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.214911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.214911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.267023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e1cf1-f840-4c44-946d-ec4173ab4b9b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.272309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.273095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.273486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.273941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.274707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.276616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.294360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2723/5421] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:32 2022] GET /identity/v3/roles => generated 2323 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:32.294360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.294360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:32.325946 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2699/5422] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:15:32 2022] POST /identity/v3/roles => generated 234 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:32.328800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.351288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbf0ba-f8b3-4ae1-ab8a-0fa539dcc0c5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.366076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.370404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.370404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.370404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] PATH_INFO: `/v3/projects/f3a84236e584447db77dccfe9748eba1/users/302da924dd2b4a2b8ca4c0c2b26a28ac/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.372920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a84236e584447db77dccfe9748eba1, user_id=302da924dd2b4a2b8ca4c0c2b26a28ac, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.378238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.398221 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2700/5423] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:32 2022] PUT /identity/v3/projects/f3a84236e584447db77dccfe9748eba1/users/302da924dd2b4a2b8ca4c0c2b26a28ac/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:32.401350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.414350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed512cb-76d3-4898-b212-8376fb099e5b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.549222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c608c4-5eb0-49bf-accd-41f5c186390c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.550572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c608c4-5eb0-49bf-accd-41f5c186390c service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.551254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c608c4-5eb0-49bf-accd-41f5c186390c service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.553610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c608c4-5eb0-49bf-accd-41f5c186390c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.556113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679925-95aa-42ae-a0b0-ee1bbdd7be16 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.569810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.576401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.577200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.577647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/617d1dfd9fc2487e940369bad1c9718e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.580417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:update_role(role_id=617d1dfd9fc2487e940369bad1c9718e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.583519 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:32.583519 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:32.583519 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:32.584696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.688735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c608c4-5eb0-49bf-accd-41f5c186390c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.690358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c608c4-5eb0-49bf-accd-41f5c186390c service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.703646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2724/5424] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:32.704865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.705564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.705564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.738613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2701/5425] 10.222.0.78 () {60 vars in 1243 bytes} [Sun Aug 28 20:15:32 2022] PATCH /identity/v3/roles/617d1dfd9fc2487e940369bad1c9718e => generated 237 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:32.740313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.766899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] MFA Rules not processed for user `302da924dd2b4a2b8ca4c0c2b26a28ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:32.768413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:32.777139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2090-e496-4fca-98b9-813768de401b tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.784774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.786489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.787011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.787520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/617d1dfd9fc2487e940369bad1c9718e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.801966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:get_role(role_id=617d1dfd9fc2487e940369bad1c9718e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.803025 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:32.803025 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:32.803025 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:32.803936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.808419 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2702/5426] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:15:32 2022] GET /identity/v3/roles/617d1dfd9fc2487e940369bad1c9718e => generated 237 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:32.809356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.823808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7171fe-6a80-4500-9890-27e5313d72ce tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.840994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.841902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.842487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.842886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.843499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.845168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.874968 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2703/5427] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:32 2022] GET /identity/v3/roles => generated 2551 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:32.885261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.904367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c79b-1e0d-4756-a5cc-0a0288450b46 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:32.908985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:32.909638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:32.910039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:32.910320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/617d1dfd9fc2487e940369bad1c9718e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:32.911832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_role(role_id=617d1dfd9fc2487e940369bad1c9718e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:32.916669 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2725/5428] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:32.916884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:32.917003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:32.917003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:33.049053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8a89-f3e9-4b61-a299-e12c69bed3f4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:33.056468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:33.057123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.062606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.062606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] PATH_INFO: `/v3/projects/1c8f728c1cda461b9db76dba7a92265e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.062606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8f728c1cda461b9db76dba7a92265e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:33.062606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:33.126151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role 617d1dfd9fc2487e940369bad1c9718e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:33.127884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.127884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.129148 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2704/5429] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:32 2022] DELETE /identity/v3/roles/617d1dfd9fc2487e940369bad1c9718e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:33.131046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:33.132963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:33.241516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa91cbf-22cf-489d-aa5a-54da1173dd62 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:33.249705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:33.255815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.255815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.255815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.255815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:33.258917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:33.317674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8f728c1cda461b9db76dba7a92265e', 'request_id': 'req-9169110c-6104-4d25-8d16-fa7fa4459b46'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.320353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8f728c1cda461b9db76dba7a92265e', 'request_id': 'req-9169110c-6104-4d25-8d16-fa7fa4459b46'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.329384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8f728c1cda461b9db76dba7a92265e', 'request_id': 'req-9169110c-6104-4d25-8d16-fa7fa4459b46'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.396117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2705/5430] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:33 2022] POST /identity/v3/projects => generated 391 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:33.398602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:33.399318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:33.475393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] The token cache is being invalidate because project 1c8f728c1cda461b9db76dba7a92265e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:33.478876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.478876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:33.478876 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2726/5431] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:32 2022] DELETE /identity/v3/projects/1c8f728c1cda461b9db76dba7a92265e => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:33.479351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:33.480376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:33.491418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c7317-471e-4641-b6dc-eb2dab9af5a2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:33.502253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29669-9d50-4597-aedf-e12331e027fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:33.503416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29669-9d50-4597-aedf-e12331e027fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.506320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29669-9d50-4597-aedf-e12331e027fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.506320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29669-9d50-4597-aedf-e12331e027fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.508531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29669-9d50-4597-aedf-e12331e027fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:33.511783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29669-9d50-4597-aedf-e12331e027fa tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:33.570757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169110c-6104-4d25-8d16-fa7fa4459b46 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:33.716452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:33.732681 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2706/5432] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:33 2022] PUT /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 520 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:33.733579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.734137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.735051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.750816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84aaa-8942-4b04-b497-34b12b085b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:33.751690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84aaa-8942-4b04-b497-34b12b085b95 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.752931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84aaa-8942-4b04-b497-34b12b085b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.753216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84aaa-8942-4b04-b497-34b12b085b95 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.753912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84aaa-8942-4b04-b497-34b12b085b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:33.756068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84aaa-8942-4b04-b497-34b12b085b95 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:33.771519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:33.772779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:33.844872 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2707/5433] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:33.851366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:33.851366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:33.946185 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2727/5434] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:33 2022] POST /identity/v3/users => generated 296 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:33.948285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.948711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.949051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.955715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e1f55-1819-49d0-933d-089d2f371d63 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:33.961703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:33.962683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:33.963054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:33.963346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:33.971709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=e3af70434aba4ab9804b9212a503da0e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:33.974186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:33.984322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:33.991295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:34.000421 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2728/5435] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:34.001285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.012574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde05df-ecbf-442f-9317-265281df7d9f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.019393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.019393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.019393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.019734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.020936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.022613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.054679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2729/5436] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:34 2022] GET /identity/v3/roles => generated 2323 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:34.054679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.068775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9c9b-e2e0-4806-af8e-bd22fd1ea827 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.073968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.074599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.074875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.075158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.075809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:34.076139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.077930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.090810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:34.094341 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2708/5437] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:33 2022] PUT /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e => generated 520 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:34.096315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.107989 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2730/5438] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:34.110550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.130716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c84de8-677d-4585-a595-7542e15ebe6e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.206421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e1632-7ff6-424e-90f6-ed03c9a562c7 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.213654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.214372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.214653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.215111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.215775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.218052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.224195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.224820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.225097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.225384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.227932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3af70434aba4ab9804b9212a503da0e, implied_role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.229569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.234404 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2709/5439] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:34 2022] GET /identity/v3/roles => generated 2323 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:34.234404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.244382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15b3a-7f5f-4f40-9e40-eef66118dada admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.250590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.251269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.251559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.251840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.252490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.255796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.391062 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2731/5440] 10.222.0.78 () {60 vars in 1363 bytes} [Sun Aug 28 20:15:34 2022] PUT /identity/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 521 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:34.391062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.438360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2710/5441] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:34 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:34.439330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.493508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39033f0-cf87-46b9-9959-4e4af84395f1 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.590323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824c89-6845-4dbc-a1a9-2e5ce328ae64 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.609688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.610583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.610877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.611157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.616408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e3af70434aba4ab9804b9212a503da0e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.617684 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:34.617684 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:34.617684 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:34.619730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.638605 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2711/5442] 10.222.0.78 () {58 vars in 1245 bytes} [Sun Aug 28 20:15:34 2022] GET /identity/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies => generated 490 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:34.640318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.650369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.651781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.652238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.652678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] PATH_INFO: `/v3/projects/cf86ef04f9594363bd34d8674a3ae5ee/users/f96e72f3c9e64e0cb167f3b4fa19520e/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.670719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e896e67-eb88-4adc-b6f1-adbd3fb2e5d9 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.687124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.687786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.688106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.688590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.690013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.694847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.700675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf86ef04f9594363bd34d8674a3ae5ee, user_id=f96e72f3c9e64e0cb167f3b4fa19520e, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.719034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.875569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2712/5443] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:34 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:34.875569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.907449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42c6c2-d706-497f-a68d-43b961559c77 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:34.920512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:34.921196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:34.921643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:34.922002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:34.926733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:34.928617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:34.952030 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2713/5445] 10.222.0.78 () {58 vars in 1245 bytes} [Sun Aug 28 20:15:34 2022] GET /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies => generated 660 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:34.952030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.958688 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2732/5445] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:34 2022] PUT /identity/v3/projects/cf86ef04f9594363bd34d8674a3ae5ee/users/f96e72f3c9e64e0cb167f3b4fa19520e/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:34.959752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:34.983686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf1b3-4f95-4dc6-8f03-ac56ad961392 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:35.079366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9dbe-7b18-46b3-bba2-9b28206a1c70 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:35.092610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:35.094071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.094365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.094643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.097313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3af70434aba4ab9804b9212a503da0e, implied_role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:35.099841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:35.108405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa73742-6004-456f-9a96-f39fed752182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:35.109194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa73742-6004-456f-9a96-f39fed752182 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.109480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa73742-6004-456f-9a96-f39fed752182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.109751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa73742-6004-456f-9a96-f39fed752182 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.110478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa73742-6004-456f-9a96-f39fed752182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:35.113068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa73742-6004-456f-9a96-f39fed752182 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:35.135316 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2714/5446] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:34 2022] GET /identity/v3/roles => generated 2323 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:35.136791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.137144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.137486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.206795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] MFA Rules not processed for user `f96e72f3c9e64e0cb167f3b4fa19520e`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:35.208314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:35.326150 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2715/5447] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:35.327711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:35.333181 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2733/5448] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:34 2022] DELETE /identity/v3/roles/e3af70434aba4ab9804b9212a503da0e/implies/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:35.361546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:35.361546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:35.362255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f5270-6301-4a76-9374-fb365900eeef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:35.415613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:35.499676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:35.500673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.501995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.502382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.503387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:35.507586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:35.528679 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2716/5449] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:35 2022] GET /identity/v3/roles => generated 2323 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:35.530009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:35.555417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc12709-f321-491f-a978-609a958d7527 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:35.578723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:35.579378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.579691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.579926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.620466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:35.642948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc5c0e-75e1-4330-aff9-901dc8dd4b1f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:35.651547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:35.652599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.652949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.654006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.656744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=e3af70434aba4ab9804b9212a503da0e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:35.660231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:35.786950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:35.789069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:35.801463 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2734/5450] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:15:35.802584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:35.814754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3db3a-a997-46b3-9402-63d6d954676d service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:35.828547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:35.844536 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2717/5451] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:35 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/e3af70434aba4ab9804b9212a503da0e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:35.845213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:35.845213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:35.845213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] PATH_INFO: `/v3/projects/a69cb9cbf8074190b0305936c9704937/users/1defe551a4f843699959a97a8d6d6c44/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:35.845479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:35.861580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69cb9cbf8074190b0305936c9704937, user_id=1defe551a4f843699959a97a8d6d6c44, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:35.864938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:36.015967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c89a-5ea7-4ec3-a2da-fe121be39fc4 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:36.023029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:36.024190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:36.024316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:36.024657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:36.038317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8c00f05e6c3f4c5ba3198474ae2a6844, implied_role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:36.039975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:36.109005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:36.141160 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2718/5452] 10.222.0.78 () {58 vars in 1347 bytes} [Sun Aug 28 20:15:35 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844/implies/c11cd3f1329f4f28aeb7216e00775ad2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:36.141725 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2735/5453] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:35 2022] PUT /identity/v3/projects/a69cb9cbf8074190b0305936c9704937/users/1defe551a4f843699959a97a8d6d6c44/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:36.146747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:36.151757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:36.158915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:36.253201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff05aa-6e72-49a3-8bc9-a754de686715 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:36.255632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62a46-b7bc-4803-a092-c53a1cb42136 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:36.261559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018ca7a-4237-4e48-9762-04b77981f79e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:36.262251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ca7a-4237-4e48-9762-04b77981f79e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:36.262563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ca7a-4237-4e48-9762-04b77981f79e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:36.262841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ca7a-4237-4e48-9762-04b77981f79e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/7f1d7fba0dd240f68d340d1cfd63c255` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:36.272174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018ca7a-4237-4e48-9762-04b77981f79e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-c018ca7a-4237-4e48-9762-04b77981f79e tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Could not find domain: 7f1d7fba0dd240f68d340d1cfd63c255.: keystone.exception.DomainNotFound: Could not find domain: 7f1d7fba0dd240f68d340d1cfd63c255. Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7f1d7fba0dd240f68d340d1cfd63c255. Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:36.277330 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:36.278570 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7f1d7fba0dd240f68d340d1cfd63c255. Aug 28 20:15:36.279713 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:36.281556 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2719/5454] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:15:36 2022] PATCH /identity/v3/domains/7f1d7fba0dd240f68d340d1cfd63c255 => generated 112 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:36.282932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:36.283221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:36.283498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:36.317047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:36.317899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:36.318411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:36.318806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] PATH_INFO: `/v3/users/58e1edee84d14e25b981214faec83a8e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:36.320060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e1edee84d14e25b981214faec83a8e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:36.322178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:36.324791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] MFA Rules not processed for user `1defe551a4f843699959a97a8d6d6c44`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:36.326611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:36.436000 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2720/5455] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:36.436996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:36.449462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55605ba1-ecf7-4ebf-8724-6d6a7d77ff93 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:36.454330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:36.455016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:36.455457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:36.455741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/users/ef8e232d2d13402f90327385bd4ae400` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:36.456953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ef8e232d2d13402f90327385bd4ae400)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:36.459571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:36.622720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8e232d2d13402f90327385bd4ae400'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.637152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e1edee84d14e25b981214faec83a8e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.638658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e1edee84d14e25b981214faec83a8e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.640787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8e232d2d13402f90327385bd4ae400'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.650308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8e232d2d13402f90327385bd4ae400'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.651239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8e232d2d13402f90327385bd4ae400'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.651908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de4145ff-a5cb-4f13-b7ad-740c8eefe0a2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8e232d2d13402f90327385bd4ae400'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.820198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e1edee84d14e25b981214faec83a8e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.835823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e1edee84d14e25b981214faec83a8e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.836892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e1edee84d14e25b981214faec83a8e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:36.862351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2736/5456] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:36 2022] DELETE /identity/v3/users/58e1edee84d14e25b981214faec83a8e => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:36.863545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:36.866616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:36.943056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea12340-eaf4-4637-828a-3f7e32a94dee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:36.947735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:36.948384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:36.948671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:36.948951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:36.949595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:36.951569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.033936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2721/5457] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:36 2022] DELETE /identity/v3/users/ef8e232d2d13402f90327385bd4ae400 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:37.035255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.035547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.036390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.058660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:37.060418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:37.068683 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2737/5458] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:36 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:37.070148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.072712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:37.156327 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2722/5459] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:37.160286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.172582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ace990-ddd1-4cdf-b2f0-b0af0be930bd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.206717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e54a7-fda3-4026-be45-3707f458b94c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.221177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.223347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.223641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.223940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/a17bc4e2c2a54271b895dcd6e6f018d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.226969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a17bc4e2c2a54271b895dcd6e6f018d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.228734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.272137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.272779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.273116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.273447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.274171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.276479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.412786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role a17bc4e2c2a54271b895dcd6e6f018d5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:37.413113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:37.415065 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2723/5460] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:37 2022] POST /identity/v3/users => generated 300 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:37.415486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:37.415581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.416865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2738/5461] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:37 2022] DELETE /identity/v3/roles/a17bc4e2c2a54271b895dcd6e6f018d5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:37.417728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.419655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:37.422952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:37.509816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d82a-f6ad-468d-930d-71b57d1c2b92 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.510615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433eff-16f5-41b8-8ed4-94e4e560f3a5 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.518824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.519510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.519854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.520122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.520827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.522462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.535358 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2739/5462] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:37 2022] GET /identity/v3/roles => generated 2097 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:37.537235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.539369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:37.583030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.585148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.585148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.585533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.588137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:37.621792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.623569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.642233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa8f2c-004b-49f4-9c7d-089c3de4e379 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.658534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.662123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.663054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.663447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/groups/47b81ef605044600aea50035915755fe` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.664365 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2724/5463] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:37.665262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.667409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_group(group_id=47b81ef605044600aea50035915755fe)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.674392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.679122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece82951-e428-43f4-b8a6-77d5613de09b service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.686550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.687394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.687679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.688115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] PATH_INFO: `/v3/projects/d2f8c985d87047c5b7146134314956ad/users/1fb9a04f804340ae91c6a8d753eb11f5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.708815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f8c985d87047c5b7146134314956ad, user_id=1fb9a04f804340ae91c6a8d753eb11f5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.712214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:37.831836 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2725/5464] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:37 2022] PUT /identity/v3/projects/d2f8c985d87047c5b7146134314956ad/users/1fb9a04f804340ae91c6a8d753eb11f5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:37.837291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.871006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2740/5465] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:15:37 2022] DELETE /identity/v3/groups/47b81ef605044600aea50035915755fe => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:37.874832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:37.960338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a723d-8a4b-40eb-b78e-2d16237ca08f tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.964717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a1e6-4ed7-4c16-9fc4-b32d289683df admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:37.967508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:37.968698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:37.969386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:37.970037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/projects/a1d123f8ac9f4efe984b528e940e00d4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:37.971540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1d123f8ac9f4efe984b528e940e00d4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:37.974632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:38.004726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:38.062410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:38.102522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:38.103136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:38.103424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:38.103692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:38.104342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:38.106044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:38.118132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2726/5466] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:37 2022] GET /identity/v3/roles => generated 2097 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:38.119447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:38.121283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:38.226494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d123f8ac9f4efe984b528e940e00d4', 'request_id': 'req-ff97d8c5-8c36-4312-bb87-84a98fb77f48'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.238873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d123f8ac9f4efe984b528e940e00d4', 'request_id': 'req-ff97d8c5-8c36-4312-bb87-84a98fb77f48'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.255058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d123f8ac9f4efe984b528e940e00d4', 'request_id': 'req-ff97d8c5-8c36-4312-bb87-84a98fb77f48'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.298260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a6d6b-9f6a-4257-a0d4-55eb528dd1aa admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:38.438775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] The token cache is being invalidate because project a1d123f8ac9f4efe984b528e940e00d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:38.439619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.441203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.449360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2741/5467] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:37 2022] DELETE /identity/v3/projects/a1d123f8ac9f4efe984b528e940e00d4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:38.451339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:38.454239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:38.511333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:38.511967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:38.512250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:38.512530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:38.514437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:38.531317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:38.533385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:38.556768 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2727/5468] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:38.557755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:38.559451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:38.574436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97d8c5-8c36-4312-bb87-84a98fb77f48 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:38.576980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81149a2c-6e94-4a8f-98fe-6bf630e24776 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:38.580246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:38.581111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:38.581465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:38.581834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] PATH_INFO: `/v3/projects/d2f8c985d87047c5b7146134314956ad/users/1fb9a04f804340ae91c6a8d753eb11f5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:38.583880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:38.584527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:38.584988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f8c985d87047c5b7146134314956ad, user_id=1fb9a04f804340ae91c6a8d753eb11f5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:38.585948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:38.586287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] PATH_INFO: `/v3/projects/1daba0f46a8349d28dda69dad1203b82` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:38.595558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1daba0f46a8349d28dda69dad1203b82)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:38.595778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:38.595986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:38.602020 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2742/5469] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:38 2022] PUT /identity/v3/projects/d2f8c985d87047c5b7146134314956ad/users/1fb9a04f804340ae91c6a8d753eb11f5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:38.602968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:38.604844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:38.704229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60309-ad14-4a9a-b699-819ef1850109 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:38.712969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:38.713996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:38.714558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:38.714968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:38.717018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:38.720068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:38.754032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.755447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.846300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1daba0f46a8349d28dda69dad1203b82', 'request_id': 'req-ac968545-d055-48ca-815c-1573a4264ac7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.853821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1daba0f46a8349d28dda69dad1203b82', 'request_id': 'req-ac968545-d055-48ca-815c-1573a4264ac7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.863167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1daba0f46a8349d28dda69dad1203b82', 'request_id': 'req-ac968545-d055-48ca-815c-1573a4264ac7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.866460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.867306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dda5974-e586-4544-bedb-3181605b8dfd tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.872822 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2743/5470] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:15:38 2022] PATCH /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a => generated 278 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:38.872822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:38.872822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:38.872822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:38.906839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] MFA Rules not processed for user `1fb9a04f804340ae91c6a8d753eb11f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:38.909242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:38.947859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] The token cache is being invalidate because project 1daba0f46a8349d28dda69dad1203b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:38.948474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.949998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:38.953572 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2728/5471] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:38 2022] DELETE /identity/v3/projects/1daba0f46a8349d28dda69dad1203b82 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:38.954803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:38.958296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:39.007927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2744/5472] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:39.007927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:39.007927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:39.069231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac968545-d055-48ca-815c-1573a4264ac7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:39.078336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:39.079575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:39.080243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:39.080847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] PATH_INFO: `/v3/users/302da924dd2b4a2b8ca4c0c2b26a28ac` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:39.083066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302da924dd2b4a2b8ca4c0c2b26a28ac)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:39.088371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:39.101177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8712903-f607-47db-bf4b-8bfa8fc9ed61 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:39.106084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:39.107011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:39.107368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:39.107714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:39.122431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=76bde4e569ea49a7b0a73a65dd7f5f0a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:39.124281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:39.158104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.164974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.347709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:39.365965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302da924dd2b4a2b8ca4c0c2b26a28ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.367789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a', 'request_id': 'req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.373766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a', 'request_id': 'req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.380154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302da924dd2b4a2b8ca4c0c2b26a28ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.381881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a', 'request_id': 'req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.391367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302da924dd2b4a2b8ca4c0c2b26a28ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.392295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302da924dd2b4a2b8ca4c0c2b26a28ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.393190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302da924dd2b4a2b8ca4c0c2b26a28ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.462416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] The token cache is being invalidate because project 76bde4e569ea49a7b0a73a65dd7f5f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:39.462941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.463832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.475525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a', 'request_id': 'req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.479618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a', 'request_id': 'req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.480739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '76bde4e569ea49a7b0a73a65dd7f5f0a', 'request_id': 'req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.487688 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2745/5473] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:15:39 2022] DELETE /identity/v3/domains/76bde4e569ea49a7b0a73a65dd7f5f0a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:39.489548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:39.491057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:39.537711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2729/5474] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:38 2022] DELETE /identity/v3/users/302da924dd2b4a2b8ca4c0c2b26a28ac => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:39.538891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:39.540504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:39.575428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7add26e-5cd1-4fe7-832b-f9a89fe167bb tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:39.637278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651298b-01f1-4db7-8181-7dcafc43aa25 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:39.643512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:39.644894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:39.644894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:39.644894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:39.646739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:39.649328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:39.650209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:39.650533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:39.650778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] PATH_INFO: `/v3/users/60f9883a6278439ebe68221960febafd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:39.652285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f9883a6278439ebe68221960febafd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:39.654063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:39.737667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:39.739785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:39.750898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2730/5475] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:39.756941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:39.761466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:39.854579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:39.876878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da51c-4c90-4b32-9000-9737892cdc15 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:39.884684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:39.885790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:39.886615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:39.887236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/e3af70434aba4ab9804b9212a503da0e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:39.889123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e3af70434aba4ab9804b9212a503da0e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:39.891424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:39.952705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f9883a6278439ebe68221960febafd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:39.953470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f9883a6278439ebe68221960febafd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.033897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f9883a6278439ebe68221960febafd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.047401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f9883a6278439ebe68221960febafd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.048426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-27361f12-2bf0-4258-af30-b6c5cf64fd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f9883a6278439ebe68221960febafd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.085507 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2746/5476] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:39 2022] DELETE /identity/v3/users/60f9883a6278439ebe68221960febafd => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:40.087700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:40.088358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:40.088683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:40.104520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role e3af70434aba4ab9804b9212a503da0e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:40.120745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.120745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-919290b7-c285-43aa-bbae-a92972046912 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.121341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:40.121341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.121556 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2731/5477] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:39 2022] DELETE /identity/v3/roles/e3af70434aba4ab9804b9212a503da0e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:40.136120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:40.136655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:40.136826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:40.178618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:40.181741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.244102 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2747/5478] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:40.244102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:40.244102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.276312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496855-4c12-4899-a9e0-7d1575cc9616 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:40.296972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:40.296972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:40.296972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:40.296972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] PATH_INFO: `/v3/users/1defe551a4f843699959a97a8d6d6c44` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:40.297291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1defe551a4f843699959a97a8d6d6c44)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:40.300334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:40.314097 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2732/5479] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:40.315243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:40.318528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.443130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c982-1756-4714-bb67-518b6bb61ef4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:40.455151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:40.456709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:40.458239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:40.459013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/c11cd3f1329f4f28aeb7216e00775ad2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:40.463705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c11cd3f1329f4f28aeb7216e00775ad2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:40.467432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:40.716885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role c11cd3f1329f4f28aeb7216e00775ad2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:40.716885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.716885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.716885 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2733/5480] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:40 2022] DELETE /identity/v3/roles/c11cd3f1329f4f28aeb7216e00775ad2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:40.718528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:40.718528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.776716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1defe551a4f843699959a97a8d6d6c44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.777450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1defe551a4f843699959a97a8d6d6c44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.781911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547ab4-01aa-4917-9b03-312f491985d2 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:40.786697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:40.787311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:40.787585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:40.787857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:40.789745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.894489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:40.896997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:40.907879 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2734/5481] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:40.911681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:40.913311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:40.927820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1defe551a4f843699959a97a8d6d6c44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.942913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1defe551a4f843699959a97a8d6d6c44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.944073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1defe551a4f843699959a97a8d6d6c44'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:40.971088 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2748/5482] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:40 2022] DELETE /identity/v3/users/1defe551a4f843699959a97a8d6d6c44 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:40.972214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:40.975319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.057465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8588-76e3-4ec6-b397-006009905f70 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:41.074857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d590f-8c4d-4621-a17e-7e6b2f1b7ba9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:41.082668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd016b21d98334d76ab19ff61abe22d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4421302e7a341838e0d34fa850cb994', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:41.083568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:41.083858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:41.084135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] PATH_INFO: `/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:41.085879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8c00f05e6c3f4c5ba3198474ae2a6844)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:41.087412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:41.125970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:41.126481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:41.126586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:41.126854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:41.128917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.203990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:41.207048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:41.219547 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2735/5483] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:15:41.220764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:41.227194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.291537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invalidating the token cache because role 8c00f05e6c3f4c5ba3198474ae2a6844 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:41.291876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.298730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4cd0a295-e281-4f4d-9afe-3110d210a601 tempest-RolesV3TestJSON-768234680 tempest-RolesV3TestJSON-768234680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.303882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2749/5484] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:40 2022] DELETE /identity/v3/roles/8c00f05e6c3f4c5ba3198474ae2a6844 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:41.305550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:41.306047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:41.306728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:41.337451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc297997-f952-4197-a0f3-8e29e9eab91f service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:41.381378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:41.387234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.438865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:41.477764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:41.478778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:41.478778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:41.479182 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2750/5485] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:41.480502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:41.481898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.482982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] PATH_INFO: `/v3/projects/9407f08c3ca14f9695c0b91871460b6b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:41.484404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9407f08c3ca14f9695c0b91871460b6b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:41.486377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:41.496823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3bdd-5209-40c0-bd30-ea01785d4ced None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:41.504145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:41.505314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:41.506205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:41.506653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] PATH_INFO: `/v3/users/ecefa5c6363641b3bb59483f12c95f17` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:41.508206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecefa5c6363641b3bb59483f12c95f17)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:41.511220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:41.652670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9407f08c3ca14f9695c0b91871460b6b', 'request_id': 'req-3512ae8c-fbb2-4b14-97fa-49694188fde9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.658657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9407f08c3ca14f9695c0b91871460b6b', 'request_id': 'req-3512ae8c-fbb2-4b14-97fa-49694188fde9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.667255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9407f08c3ca14f9695c0b91871460b6b', 'request_id': 'req-3512ae8c-fbb2-4b14-97fa-49694188fde9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.817762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] The token cache is being invalidate because project 9407f08c3ca14f9695c0b91871460b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:41.818104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.818970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.824058 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2736/5486] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:41 2022] DELETE /identity/v3/projects/9407f08c3ca14f9695c0b91871460b6b => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:41.825074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:41.826701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.916253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:41.918791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512ae8c-fbb2-4b14-97fa-49694188fde9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:41.922729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:41.923371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:41.923712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:41.923940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:41.924107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecefa5c6363641b3bb59483f12c95f17'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.924788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecefa5c6363641b3bb59483f12c95f17'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:41.925907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:41.998654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:42.000915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:42.016406 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2737/5487] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:42.017276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:42.018611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.032247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8eaf7-c54a-4699-9e4f-c71ac4272b3d service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:42.037673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:42.041263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.041263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.041263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] PATH_INFO: `/v3/projects/f3a84236e584447db77dccfe9748eba1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.041263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a84236e584447db77dccfe9748eba1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:42.042301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:42.056467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecefa5c6363641b3bb59483f12c95f17'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.072991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecefa5c6363641b3bb59483f12c95f17'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.073756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f807dc11-87a9-49b4-9743-8ed3827cc357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecefa5c6363641b3bb59483f12c95f17'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.106206 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2751/5488] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:41 2022] DELETE /identity/v3/users/ecefa5c6363641b3bb59483f12c95f17 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:42.108256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443bf5a-7ee2-4ca9-877b-ab1ea630cae9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.108646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443bf5a-7ee2-4ca9-877b-ab1ea630cae9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.109155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443bf5a-7ee2-4ca9-877b-ab1ea630cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.133547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c443bf5a-7ee2-4ca9-877b-ab1ea630cae9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:42.135762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c443bf5a-7ee2-4ca9-877b-ab1ea630cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.227706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a84236e584447db77dccfe9748eba1', 'request_id': 'req-397d094a-ebbc-425c-a197-d15d5015a179'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.228197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2752/5489] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:42.229556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382758-a1fe-4a30-af1d-c418cdf01b5c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.230025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382758-a1fe-4a30-af1d-c418cdf01b5c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.230163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382758-a1fe-4a30-af1d-c418cdf01b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.236926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a84236e584447db77dccfe9748eba1', 'request_id': 'req-397d094a-ebbc-425c-a197-d15d5015a179'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.247283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a84236e584447db77dccfe9748eba1', 'request_id': 'req-397d094a-ebbc-425c-a197-d15d5015a179'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.255508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f4382758-a1fe-4a30-af1d-c418cdf01b5c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:42.256825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f4382758-a1fe-4a30-af1d-c418cdf01b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.360033 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2753/5490] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:42.361229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.361523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.361805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.378040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] The token cache is being invalidate because project f3a84236e584447db77dccfe9748eba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:42.378663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.380336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.383916 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2738/5491] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:42 2022] DELETE /identity/v3/projects/f3a84236e584447db77dccfe9748eba1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:42.385028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:42.388163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.390804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:42.392666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.404998 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2754/5492] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:42.406291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:42.409834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.433521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620d7d-9e8d-44a9-b8c8-08f4527bf49a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:42.444153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:42.444868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.446253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.446558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] PATH_INFO: `/v3/users/f96e72f3c9e64e0cb167f3b4fa19520e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.449120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96e72f3c9e64e0cb167f3b4fa19520e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:42.455431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:42.545393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d094a-ebbc-425c-a197-d15d5015a179 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:42.553471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:42.561050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.561050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.561050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.561050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:42.591523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:42.599432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:42.614895 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2739/5493] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:42.617152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:42.632285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c54ab7-78bb-4e06-85b4-2392a740103f service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:42.639368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:42.640055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.640272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.640547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.641326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:42.641648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:42.643430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:42.665310 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2740/5494] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:42.673010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:42.689982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840987bb-27d3-4c33-908e-b387b66e5644 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:42.696215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:42.696904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:42.697254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:42.697587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:42.698254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:42.700309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:42.806465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96e72f3c9e64e0cb167f3b4fa19520e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.807668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96e72f3c9e64e0cb167f3b4fa19520e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:42.937903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2741/5495] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:42 2022] POST /identity/v3/projects => generated 361 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:15:42.938687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:42.941934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:43.032653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838029d-264f-406a-8938-6bdc2f8deac5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:43.038473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:43.039282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:43.039570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:43.039848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] PATH_INFO: `/v3/projects/a69cb9cbf8074190b0305936c9704937` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:43.041036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69cb9cbf8074190b0305936c9704937)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:43.042497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96e72f3c9e64e0cb167f3b4fa19520e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.043153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:43.053777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96e72f3c9e64e0cb167f3b4fa19520e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.055102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96e72f3c9e64e0cb167f3b4fa19520e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.095678 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2755/5496] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:42 2022] DELETE /identity/v3/users/f96e72f3c9e64e0cb167f3b4fa19520e => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:43.097958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:43.127876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:43.225754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93f93-048d-4c19-ade2-0fad3eab6f12 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:43.238524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:43.239174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:43.239456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:43.239736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:43.240399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:43.242411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:43.319679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69cb9cbf8074190b0305936c9704937', 'request_id': 'req-7b0811b5-beb2-4bc3-8154-bf20c12244eb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.325911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69cb9cbf8074190b0305936c9704937', 'request_id': 'req-7b0811b5-beb2-4bc3-8154-bf20c12244eb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.333821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69cb9cbf8074190b0305936c9704937', 'request_id': 'req-7b0811b5-beb2-4bc3-8154-bf20c12244eb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.410346 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2756/5497] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:43 2022] POST /identity/v3/users => generated 281 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:43.416950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:43.453195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] The token cache is being invalidate because project a69cb9cbf8074190b0305936c9704937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:43.454398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.457624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:43.458406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.478780 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2742/5498] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:42 2022] DELETE /identity/v3/projects/a69cb9cbf8074190b0305936c9704937 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:43.486106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:43.494799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:43.503435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0cb95-20bf-49cc-867b-048930c7caba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:43.650605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:43.651652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:43.652253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:43.652842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:43.653653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0811b5-beb2-4bc3-8154-bf20c12244eb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:43.654397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:43.658182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:43.664265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:43.665314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:43.666269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:43.666922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] PATH_INFO: `/v3/projects/a6ed209ca2354f9cb7ebf9ab4ed532f4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:43.669383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ed209ca2354f9cb7ebf9ab4ed532f4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:43.676830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:43.682305 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2757/5499] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:43.684140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:43.686862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:43.731477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:43.741017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e395-89e4-4f0f-b5b9-59beca0092af admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:43.762592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:43.766750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:43.767496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:43.769383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] PATH_INFO: `/v3/users/1fb9a04f804340ae91c6a8d753eb11f5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:43.775243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb9a04f804340ae91c6a8d753eb11f5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:43.777751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:43.946642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ed209ca2354f9cb7ebf9ab4ed532f4', 'request_id': 'req-42ead3a6-7914-42b6-816e-1ed4b30bf84b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.954352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ed209ca2354f9cb7ebf9ab4ed532f4', 'request_id': 'req-42ead3a6-7914-42b6-816e-1ed4b30bf84b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:43.961567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ed209ca2354f9cb7ebf9ab4ed532f4', 'request_id': 'req-42ead3a6-7914-42b6-816e-1ed4b30bf84b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.085699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] The token cache is being invalidate because project a6ed209ca2354f9cb7ebf9ab4ed532f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:44.086036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.086749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.088610 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2743/5500] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:43 2022] DELETE /identity/v3/projects/a6ed209ca2354f9cb7ebf9ab4ed532f4 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:44.089215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:44.090723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:44.173646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb9a04f804340ae91c6a8d753eb11f5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.175401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb9a04f804340ae91c6a8d753eb11f5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.187177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead3a6-7914-42b6-816e-1ed4b30bf84b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:44.197743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:44.197743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:44.197743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:44.197743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:44.198267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:44.198267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:44.210171 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2744/5501] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:44.211140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:44.213878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:44.239334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dc2a5-3c23-4bcf-98d6-d73302157ace admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:44.239334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:44.239334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:44.239334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:44.240029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] PATH_INFO: `/v3/projects/cf86ef04f9594363bd34d8674a3ae5ee` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:44.242350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf86ef04f9594363bd34d8674a3ae5ee)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:44.246656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:44.354065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb9a04f804340ae91c6a8d753eb11f5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.366713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb9a04f804340ae91c6a8d753eb11f5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.366713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb9a04f804340ae91c6a8d753eb11f5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.403296 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2758/5502] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:43 2022] DELETE /identity/v3/users/1fb9a04f804340ae91c6a8d753eb11f5 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:44.404181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:44.405869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:44.451908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf86ef04f9594363bd34d8674a3ae5ee', 'request_id': 'req-d034d64e-0809-4068-ba8f-68e6cce9e960'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.459569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf86ef04f9594363bd34d8674a3ae5ee', 'request_id': 'req-d034d64e-0809-4068-ba8f-68e6cce9e960'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.469092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf86ef04f9594363bd34d8674a3ae5ee', 'request_id': 'req-d034d64e-0809-4068-ba8f-68e6cce9e960'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.558647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd28a-65aa-46a1-8a04-27f1ec4817db admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:44.633415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:44.634178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:44.634461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:44.634737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] PATH_INFO: `/v3/users/d016b21d98334d76ab19ff61abe22d10` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:44.635940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d016b21d98334d76ab19ff61abe22d10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:44.638115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:44.742338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] The token cache is being invalidate because project cf86ef04f9594363bd34d8674a3ae5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:44.742912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.743442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:44.745084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2745/5503] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:44 2022] DELETE /identity/v3/projects/cf86ef04f9594363bd34d8674a3ae5ee => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:44.746126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:44.749992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:44.764550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d64e-0809-4068-ba8f-68e6cce9e960 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:44.769918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb888b50-6cca-46e4-8895-73fa77c3009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:44.774786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888b50-6cca-46e4-8895-73fa77c3009d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:44.774786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888b50-6cca-46e4-8895-73fa77c3009d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:44.774786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888b50-6cca-46e4-8895-73fa77c3009d admin admin] PATH_INFO: `/v3/projects/ec8b95ac71f340c08279c0e29d9df422/users/fca6e298d6de42229826f9d5fd787ff7/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:44.788346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb888b50-6cca-46e4-8895-73fa77c3009d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8b95ac71f340c08279c0e29d9df422, user_id=fca6e298d6de42229826f9d5fd787ff7, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:44.791143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb888b50-6cca-46e4-8895-73fa77c3009d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:44.936542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:45.006343 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2746/5504] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:44 2022] PUT /identity/v3/projects/ec8b95ac71f340c08279c0e29d9df422/users/fca6e298d6de42229826f9d5fd787ff7/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:45.009009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109270c7-6a68-47dd-a3c8-bb327bcb32da None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.009724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109270c7-6a68-47dd-a3c8-bb327bcb32da None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.010197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109270c7-6a68-47dd-a3c8-bb327bcb32da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.023911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd016b21d98334d76ab19ff61abe22d10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.025040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd016b21d98334d76ab19ff61abe22d10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.040487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-109270c7-6a68-47dd-a3c8-bb327bcb32da None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:45.041737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-109270c7-6a68-47dd-a3c8-bb327bcb32da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:45.122331 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2747/5505] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:45.123758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12a13-2c75-4514-8a86-4d9c0633497d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.124314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12a13-2c75-4514-8a86-4d9c0633497d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.124546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12a13-2c75-4514-8a86-4d9c0633497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.164033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-81a12a13-2c75-4514-8a86-4d9c0633497d None None] MFA Rules not processed for user `fca6e298d6de42229826f9d5fd787ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:45.165334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81a12a13-2c75-4514-8a86-4d9c0633497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:45.208774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd016b21d98334d76ab19ff61abe22d10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.224749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd016b21d98334d76ab19ff61abe22d10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.226331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd016b21d98334d76ab19ff61abe22d10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.265456 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2759/5506] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:44 2022] DELETE /identity/v3/users/d016b21d98334d76ab19ff61abe22d10 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:45.266052 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2748/5507] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:45.267816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.268153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.268482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.271998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:45.274352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:45.302388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:45.304521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:45.454218 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2749/5508] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:45.455401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:45.462739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:45.470391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c587af-1743-4b8c-a416-2dec6f519208 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:45.478694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:45.479767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.480551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.481315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] PATH_INFO: `/v3/projects/d2f8c985d87047c5b7146134314956ad` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.482998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f8c985d87047c5b7146134314956ad)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:45.486000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:45.490577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d5394-35de-4618-a9be-bde503d55ea9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:45.506766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:45.506766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.506766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.506766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.510813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:45.513448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:45.627236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:45.676981 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2750/5509] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:45 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:45.678135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:45.694922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f8c985d87047c5b7146134314956ad', 'request_id': 'req-5cee1952-ce4e-43fc-8708-a504199c33b1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.703513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f8c985d87047c5b7146134314956ad', 'request_id': 'req-5cee1952-ce4e-43fc-8708-a504199c33b1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.712105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f8c985d87047c5b7146134314956ad', 'request_id': 'req-5cee1952-ce4e-43fc-8708-a504199c33b1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.752355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a1875-ddb7-4c04-b832-b0600e5e15fb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:45.758739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:45.760118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.760118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.760478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.761295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:45.761617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:45.764439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:45.782497 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2751/5510] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:45.782497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:45.793971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d19e-3b1c-4d53-919a-885ea38084f5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:45.798812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:45.799419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:45.799695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:45.799964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:45.801227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:45.803265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:45.935355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] The token cache is being invalidate because project d2f8c985d87047c5b7146134314956ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:45.935855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.936763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:45.938794 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2760/5511] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:45 2022] DELETE /identity/v3/projects/d2f8c985d87047c5b7146134314956ad => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:45.940242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:45.942532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:45.990923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2752/5512] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:45 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:45.992170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:45.997325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.012323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c38a98-8076-4d8c-b9c0-1ddbe5b8528e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.018326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.020366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.020366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.020366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] PATH_INFO: `/v3/projects/c4421302e7a341838e0d34fa850cb994` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.021633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4421302e7a341838e0d34fa850cb994)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.023761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.038554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1952-ce4e-43fc-8708-a504199c33b1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.044029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2263-d76e-4d42-942b-eefbe4f7cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.044795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2263-d76e-4d42-942b-eefbe4f7cd34 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.049461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2263-d76e-4d42-942b-eefbe4f7cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.049461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2263-d76e-4d42-942b-eefbe4f7cd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.049461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2263-d76e-4d42-942b-eefbe4f7cd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.049461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2263-d76e-4d42-942b-eefbe4f7cd34 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.162933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4421302e7a341838e0d34fa850cb994', 'request_id': 'req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:46.171029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4421302e7a341838e0d34fa850cb994', 'request_id': 'req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:46.178399 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2761/5513] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:45 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:46.178399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.178399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.178399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.179618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4421302e7a341838e0d34fa850cb994', 'request_id': 'req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:46.198681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:46.199924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.273366 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2762/5514] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:46.274323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.276211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.292764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641653-751c-417f-9cc9-d76c9781fd26 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.298147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.298794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.299073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.299346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.300061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.301931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.313557 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2763/5515] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:46.314584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.323084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] The token cache is being invalidate because project c4421302e7a341838e0d34fa850cb994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:46.323465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:46.324240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-47402c16-6eb9-4b9f-b1c7-86e3c5def37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:46.326060 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2753/5516] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:45 2022] DELETE /identity/v3/projects/c4421302e7a341838e0d34fa850cb994 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:46.326929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d02a-df61-4c85-aaed-7bfe6ec45163 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.327275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.327562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.327841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.335541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7572-daf4-4f94-95f2-bc0d9c5da20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.338480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7572-daf4-4f94-95f2-bc0d9c5da20e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.338480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7572-daf4-4f94-95f2-bc0d9c5da20e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.338480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7572-daf4-4f94-95f2-bc0d9c5da20e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.338480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e7572-daf4-4f94-95f2-bc0d9c5da20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.340096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e7572-daf4-4f94-95f2-bc0d9c5da20e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.361736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:46.364022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.375395 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2754/5517] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:46.376250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.377586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.390739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010671c7-78a8-4c95-9958-77454aed0246 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.396855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.397543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.397833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.398130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] PATH_INFO: `/v3/projects/286e09ede7584deba34f6f1ed3dafbe6/users/e8bd8bba8f874e66a5a551c68ec1fdda/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.414944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286e09ede7584deba34f6f1ed3dafbe6, user_id=e8bd8bba8f874e66a5a551c68ec1fdda, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.417631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.442890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2764/5518] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:46.442890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.442890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.442890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.462012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:46.463245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.471625 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2765/5519] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:46.478973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.484107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57637770-65c3-4129-a3fb-4823e127be39 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.489581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.490230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.490515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.493402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.493402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:46.493402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.493402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.505646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2766/5520] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:46.509161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.509161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.522493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7339ed-aebf-4990-90c2-8f375f79c9fa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.527354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7c596-48dc-4867-9762-146d7e9ffac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.527963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c596-48dc-4867-9762-146d7e9ffac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.528340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c596-48dc-4867-9762-146d7e9ffac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.529161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c596-48dc-4867-9762-146d7e9ffac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.529406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c596-48dc-4867-9762-146d7e9ffac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.531075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c596-48dc-4867-9762-146d7e9ffac0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.543482 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2767/5521] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:46.547185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.547185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.547185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.557566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2755/5522] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:46 2022] PUT /identity/v3/projects/286e09ede7584deba34f6f1ed3dafbe6/users/e8bd8bba8f874e66a5a551c68ec1fdda/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:46.557566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.569676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:46.571111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:46.627936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84790d-eb55-41c7-8493-f939d1686125 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.633459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.634250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.634618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.634954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.635667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.637806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.649201 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2768/5523] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:46.649201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.661121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd9772-6c36-48cd-bee1-c605a6696bcb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.667797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.668957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.678269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.678269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] PATH_INFO: `/v3/projects/dc6b4ca891b7479dbf8135c7e2ab6102/users/76c77f67eabf41be83c00b44c4f086cb/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.688380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6b4ca891b7479dbf8135c7e2ab6102, user_id=76c77f67eabf41be83c00b44c4f086cb, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.691131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.794131 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2756/5524] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:46.794131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.820066 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2769/5525] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:46 2022] PUT /identity/v3/projects/dc6b4ca891b7479dbf8135c7e2ab6102/users/76c77f67eabf41be83c00b44c4f086cb/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:46.820066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.899564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4b87-0384-4374-a065-a40583d57afb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.903650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:46.926108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dda49-a414-4d90-930c-720034132625 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.932666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.933290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.933564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.933842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.934608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:46.934913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.936782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.951106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:46.962875 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2770/5526] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:46.962875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.963610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011399da-356e-4c34-b0b9-7e8716b80a5a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:46.968644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.969188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.969494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.969767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.970239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:46.970428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.971041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:46.971424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:46.971795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:46.972373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.972735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:46.974889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:46.985980 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2757/5527] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:46.985980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:46.997711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f549c8-6ac5-4cb6-aadf-2ef1b18078b6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.002829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.003419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.004344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.004758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.005451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.007078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.017884 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2758/5528] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:47.018845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.029172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46d85-ed73-42e0-8243-774de5b6e389 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.034308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.034947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.035235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.035511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.036153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.038159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.068661 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2771/5529] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:46 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:47.068661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.078161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978139-f9e6-426a-a810-cde41945d35c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.083591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.084424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.084573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.084849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] PATH_INFO: `/v3/projects/286e09ede7584deba34f6f1ed3dafbe6/users/e8bd8bba8f874e66a5a551c68ec1fdda/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.087327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=286e09ede7584deba34f6f1ed3dafbe6, user_id=e8bd8bba8f874e66a5a551c68ec1fdda, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.090274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.103420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2772/5530] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:47 2022] PUT /identity/v3/projects/286e09ede7584deba34f6f1ed3dafbe6/users/e8bd8bba8f874e66a5a551c68ec1fdda/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:47.104286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.180972 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2759/5531] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:47 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:47.182661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.206335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ab573-125c-496a-be68-c4525f79d2ee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.279328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a4d8-cfed-4247-9157-9ecf945019b9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.287066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd798f-cb27-4c42-88c2-27e518bc7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.288063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd798f-cb27-4c42-88c2-27e518bc7852 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.288063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd798f-cb27-4c42-88c2-27e518bc7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.288362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd798f-cb27-4c42-88c2-27e518bc7852 admin admin] PATH_INFO: `/v3/projects/dc6b4ca891b7479dbf8135c7e2ab6102/users/76c77f67eabf41be83c00b44c4f086cb/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.290530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd798f-cb27-4c42-88c2-27e518bc7852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6b4ca891b7479dbf8135c7e2ab6102, user_id=76c77f67eabf41be83c00b44c4f086cb, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.293872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd798f-cb27-4c42-88c2-27e518bc7852 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.295144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.296370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.296370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.296574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.297184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.299060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.307972 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2773/5532] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:47 2022] PUT /identity/v3/projects/dc6b4ca891b7479dbf8135c7e2ab6102/users/76c77f67eabf41be83c00b44c4f086cb/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:47.314270 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2760/5533] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:47.315273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.319658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.319951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.320228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.331620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85cbfb-67c1-4c9e-9866-1a0f7c59c6c2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.353942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] MFA Rules not processed for user `e8bd8bba8f874e66a5a551c68ec1fdda`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:47.355809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:47.440838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.441587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.441900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.442185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.442831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.444811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.479469 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2774/5534] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:47.480953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.493173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7dc3b-868d-4170-9266-522c2dd20a80 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.497973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0d354-6b80-4ab3-b07a-2223346e047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.498598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0d354-6b80-4ab3-b07a-2223346e047e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.498883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0d354-6b80-4ab3-b07a-2223346e047e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.499163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0d354-6b80-4ab3-b07a-2223346e047e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.500165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0d354-6b80-4ab3-b07a-2223346e047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.505029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0d354-6b80-4ab3-b07a-2223346e047e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.518534 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2775/5535] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:47.518534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.518534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.518534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.558510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] MFA Rules not processed for user `76c77f67eabf41be83c00b44c4f086cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:47.563314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:47.563503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2761/5536] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:47 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:47.563503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.563922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:47.648213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483f839-2b41-4fe9-af30-d5b64d51502a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.653043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.653724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.654040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.654279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.666341 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2776/5537] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:47.667551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.677287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.678772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.680735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9d11-c495-4b56-b5dd-3e769e749ba1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.686861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.687875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.688893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.689357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] PATH_INFO: `/v3/projects/c6a3127313524b7d95dfc42d87627d72/users/1c7630ec96eb4f579e05cb79c2520769/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.708901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a3127313524b7d95dfc42d87627d72, user_id=1c7630ec96eb4f579e05cb79c2520769, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.712302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.718173 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2762/5538] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:47.718921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.741992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57b73e-60af-4b02-b7d5-b97eb43654fd service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.752250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.752250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.752250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.752250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.752738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.752838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.773368 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2763/5539] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:47.774545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.785878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86394-11ef-40ce-bc1c-e3b59fa9519b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:47.791203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7334c82-4b17-4c08-b580-f5294ba748b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:47.792087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334c82-4b17-4c08-b580-f5294ba748b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.792466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334c82-4b17-4c08-b580-f5294ba748b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.792835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334c82-4b17-4c08-b580-f5294ba748b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:47.793819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7334c82-4b17-4c08-b580-f5294ba748b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:47.795844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7334c82-4b17-4c08-b580-f5294ba748b4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:47.945026 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2777/5540] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:47 2022] PUT /identity/v3/projects/c6a3127313524b7d95dfc42d87627d72/users/1c7630ec96eb4f579e05cb79c2520769/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:47.945026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:47.991739 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2764/5541] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:47 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:47.994292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:47.995026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:47.995571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.058189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] MFA Rules not processed for user `1c7630ec96eb4f579e05cb79c2520769`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:48.060677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:48.068017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4f49-b3f8-45e0-bf02-97a379e8bae2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.154008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2765/5542] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:48.160060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.178067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.178067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.178067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.178067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.178505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.178505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.190791 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2778/5543] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:48.192208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.214833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5468d5d-6856-40ad-b41b-749ea6608de3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.224210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.225252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.225783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.226419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.227643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.232662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.244990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c31a0-5e46-48b7-b8f1-50e85510529b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.251536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.252697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.252907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.253187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.254729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.256677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.367676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2779/5544] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:48 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:48.374645 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2766/5545] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:48 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:48.374645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.378883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.390034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9b54-e807-41d4-aff9-3eb32cac613a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.503185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda692ef-0e3c-4f23-a713-7698e1250184 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.512914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.513552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.513834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.514146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.515014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.516668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.517180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.517483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.517915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.518422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] PATH_INFO: `/v3/projects/a97e525223614a29a3173eb80fe99d72/users/fdfc52b16d5948cd949653bfadefe92d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.546218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97e525223614a29a3173eb80fe99d72, user_id=fdfc52b16d5948cd949653bfadefe92d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.549418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.732245 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2767/5546] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:48 2022] POST /identity/v3/users => generated 299 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:48.732245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.745949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49e6b5-738f-4ac1-84a3-9c54168c0031 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.751781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.752420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.752700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.752974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.753629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.755274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.767794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2768/5547] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:48.767794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.780443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c16a4-e44b-4d3c-b86e-371e9a410966 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.807291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2780/5548] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:48 2022] PUT /identity/v3/projects/a97e525223614a29a3173eb80fe99d72/users/fdfc52b16d5948cd949653bfadefe92d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:48.807291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.894269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2b6db-5b0d-445a-852f-0eaa30dbc8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.895188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2b6db-5b0d-445a-852f-0eaa30dbc8ee admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.895464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2b6db-5b0d-445a-852f-0eaa30dbc8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.895845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2b6db-5b0d-445a-852f-0eaa30dbc8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.896678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2b6db-5b0d-445a-852f-0eaa30dbc8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.896798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f06-8dba-4926-ba5e-95dd4468533e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.898533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2b6db-5b0d-445a-852f-0eaa30dbc8ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.903649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.905498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.905498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.905498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.905988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.907762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:48.915421 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2769/5549] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:48.915421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.915421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.915421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.928773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2781/5550] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:48.928773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:48.940040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd64172-7385-48b1-8d37-759db33155f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:48.944720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:48.945455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:48.945741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:48.946043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] PATH_INFO: `/v3/projects/1b8daaa861e34f1c8d8e971b9c991576/users/bf1231fc995d4534b8e209b790a1fa99/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:48.949898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] MFA Rules not processed for user `fdfc52b16d5948cd949653bfadefe92d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:48.950737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:48.964276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8daaa861e34f1c8d8e971b9c991576, user_id=bf1231fc995d4534b8e209b790a1fa99, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:48.967413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.039458 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2770/5551] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:49.039458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.051396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd12f9-007f-40eb-81af-d3f3a9322a7b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.056710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.057401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.057687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.058009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] PATH_INFO: `/v3/projects/aa2f44a441364d738e651497d8f57848/users/9150f4ec75b6459d9fc4db553c002d23/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.078385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2f44a441364d738e651497d8f57848, user_id=9150f4ec75b6459d9fc4db553c002d23, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.084163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.088665 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2782/5552] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:48 2022] PUT /identity/v3/projects/1b8daaa861e34f1c8d8e971b9c991576/users/bf1231fc995d4534b8e209b790a1fa99/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:49.088665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.125333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:49.162593 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2771/5553] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:49 2022] PUT /identity/v3/projects/aa2f44a441364d738e651497d8f57848/users/9150f4ec75b6459d9fc4db553c002d23/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:49.163725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.169388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dedfb7-1047-47b3-b60d-29c5e948d204 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.206224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:49.240573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92ff9d-bad8-41fa-8e41-4e1294bb6431 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.249684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1826f2-0225-4deb-ad36-f6dcb1f5737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.250500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1826f2-0225-4deb-ad36-f6dcb1f5737e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.250767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1826f2-0225-4deb-ad36-f6dcb1f5737e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.252065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1826f2-0225-4deb-ad36-f6dcb1f5737e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.252065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1826f2-0225-4deb-ad36-f6dcb1f5737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.253592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1826f2-0225-4deb-ad36-f6dcb1f5737e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.257014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.258152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.258732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.259352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.260468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.268127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.268629 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2772/5554] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:49.272290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.272581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.272859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.313242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] MFA Rules not processed for user `9150f4ec75b6459d9fc4db553c002d23`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:49.317232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:49.406004 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2773/5555] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:49.407016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.425637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1137a-87bb-49a9-8693-ec01a79a7701 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.431232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.432110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.432454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.432820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] PATH_INFO: `/v3/projects/1b8daaa861e34f1c8d8e971b9c991576/users/bf1231fc995d4534b8e209b790a1fa99/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.435519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8daaa861e34f1c8d8e971b9c991576, user_id=bf1231fc995d4534b8e209b790a1fa99, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.438464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.454229 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2774/5556] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:49 2022] PUT /identity/v3/projects/1b8daaa861e34f1c8d8e971b9c991576/users/bf1231fc995d4534b8e209b790a1fa99/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:49.455223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.457740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:49.467519 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2783/5557] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:49 2022] POST /identity/v3/projects => generated 369 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:49.468875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.483211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:49.579324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b9ad-6054-446a-ba92-03bd25d0958b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.584497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88905e88-9475-4297-9cd8-e00a7e10295d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.585138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88905e88-9475-4297-9cd8-e00a7e10295d service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.586252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88905e88-9475-4297-9cd8-e00a7e10295d service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.586614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88905e88-9475-4297-9cd8-e00a7e10295d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.604315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdab94-be6e-4006-8e1b-3573ee7efb20 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.713991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.714775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.715252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.715618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.718254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:49.724325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88905e88-9475-4297-9cd8-e00a7e10295d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.725622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88905e88-9475-4297-9cd8-e00a7e10295d service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.739473 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2784/5558] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:49.741024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.741312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.741592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.788487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] MFA Rules not processed for user `bf1231fc995d4534b8e209b790a1fa99`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:49.789905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:49.845643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.847747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:49.861127 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2775/5559] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:15:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:15:49.863837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.928958 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2785/5560] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:49.939752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:49.942400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:49.948803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98890-9acd-41ff-9d01-85b858c11c9f service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:49.954941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:49.955837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:49.956133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:49.956510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:49.957234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:49.959212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.013937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083324a0-526e-42f7-9597-3b806b102b3c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:50.018793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:50.018793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.019178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.019406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.030317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:50.031948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.043518 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2786/5561] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:50.090515 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2776/5562] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:49 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:50.095228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:50.107327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766942e-c904-49c8-b339-de1190e0b4ee service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:50.115405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:50.116324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.116639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.117268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.118384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:50.121360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.141386 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2787/5563] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:50.148366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:50.174439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e96fb-b9ca-4f7c-a18d-6f35b577e23b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:50.191908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:50.193910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.195102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.195783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] PATH_INFO: `/v3/projects/b9d2b83c7f4242e39424f52d3d66b3a3/users/e1cdabf0fbbe42b1b56defccef565cf9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.242668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d2b83c7f4242e39424f52d3d66b3a3, user_id=e1cdabf0fbbe42b1b56defccef565cf9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:50.247041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.390909 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2777/5564] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:50 2022] PUT /identity/v3/projects/b9d2b83c7f4242e39424f52d3d66b3a3/users/e1cdabf0fbbe42b1b56defccef565cf9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:50.395551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:50.409302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903e1b-98bf-42fd-b787-d774011d6a12 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:50.511758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151011f6-4150-42ee-b388-a36c760b47b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:50.512959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151011f6-4150-42ee-b388-a36c760b47b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.513599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151011f6-4150-42ee-b388-a36c760b47b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.514257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151011f6-4150-42ee-b388-a36c760b47b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.515536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151011f6-4150-42ee-b388-a36c760b47b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:50.518735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151011f6-4150-42ee-b388-a36c760b47b4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.544523 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2788/5565] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:15:50.546380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:50.562219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefd22f-d9a7-4638-b0a8-e45addb0db0b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:50.569832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:50.571485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.572062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.578392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] PATH_INFO: `/v3/projects/b9d2b83c7f4242e39424f52d3d66b3a3/users/e1cdabf0fbbe42b1b56defccef565cf9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.578392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d2b83c7f4242e39424f52d3d66b3a3, user_id=e1cdabf0fbbe42b1b56defccef565cf9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:50.579626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.601903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2778/5566] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:50 2022] PUT /identity/v3/projects/b9d2b83c7f4242e39424f52d3d66b3a3/users/e1cdabf0fbbe42b1b56defccef565cf9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:50.612561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.615911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.615911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.662107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] MFA Rules not processed for user `e1cdabf0fbbe42b1b56defccef565cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:50.663925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:50.799718 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2789/5567] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:50.805133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:50.820819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea875-c252-4445-a020-e3192649647a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:50.829177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:50.830653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:50.831530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:50.841177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:50.841177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:50.841177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:50.985557 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2779/5568] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:15:50 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:50.989698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:51.004731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925fd6c-09c4-4f42-8a2f-4c0830da4930 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:51.020266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:51.023876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:51.024341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:51.024729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/c3ce3b6e1f3e4c4fbe4d3d4cbbaca64e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:51.025478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c3ce3b6e1f3e4c4fbe4d3d4cbbaca64e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:51.027634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:51.256071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:51.261015 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2790/5569] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:50 2022] DELETE /identity/v3/services/c3ce3b6e1f3e4c4fbe4d3d4cbbaca64e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:51.268352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:51.348855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0df7f-0666-4ce9-bcbe-f22245d445ff tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:51.366930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:51.373632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:51.374220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:51.374723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:51.376133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:51.380346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:51.403011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302f3b7-4b7e-4f00-bb7f-6b2dac48b5c6 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:51.422857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:51.423843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:51.424206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:51.424556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] PATH_INFO: `/v3/users/76c77f67eabf41be83c00b44c4f086cb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:51.425867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c77f67eabf41be83c00b44c4f086cb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:51.436227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:51.532380 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2791/5570] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:51 2022] POST /identity/v3/services => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:15:51.537144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:51.569949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e5857-dd67-4d2d-b05a-42e880c7839c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:51.575516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:51.576291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:51.576637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:51.576984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/6ba2ce3dc1124af0a14a20951785344e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:51.577912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:update_service(service_id=6ba2ce3dc1124af0a14a20951785344e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:51.579014 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:51.579014 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:51.579014 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:51.580390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:51.696933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:51.796028 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2792/5571] 10.222.0.78 () {60 vars in 1252 bytes} [Sun Aug 28 20:15:51 2022] PATCH /identity/v3/services/6ba2ce3dc1124af0a14a20951785344e => generated 281 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:15:51.797566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:51.799540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:51.816558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:51.834713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c77f67eabf41be83c00b44c4f086cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:51.853773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c77f67eabf41be83c00b44c4f086cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:51.883619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c77f67eabf41be83c00b44c4f086cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:51.884789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c77f67eabf41be83c00b44c4f086cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:51.885648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c77f67eabf41be83c00b44c4f086cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:51.950466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e748-a948-4674-aad1-16f6f79e0c49 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:51.953179 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2780/5572] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:51 2022] DELETE /identity/v3/users/76c77f67eabf41be83c00b44c4f086cb => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:51.954386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:51.956709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:51.959018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:51.959773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:51.960223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:51.960564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:51.963457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:52.042626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.044776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.072357 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2793/5573] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:51 2022] GET /identity/v3/auth/tokens => generated 3369 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:52.073013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335838ee-e168-41e7-9740-e753bec42aa8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.073474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.087189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:52.100290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.107650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.107650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.107650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.107650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:52.123684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d5c3-760b-45e9-809b-3cd1ae7c45bc service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.127349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.129905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d05566-b8c9-49d4-85bf-cc2a45d395d5 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.156511 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2781/5574] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:51 2022] GET /identity/v3/auth/tokens => generated 3439 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:52.158350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.158547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.158827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.189233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:52.190644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:52.282178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.282885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.283168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.283453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/6ba2ce3dc1124af0a14a20951785344e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.284214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:get_service(service_id=6ba2ce3dc1124af0a14a20951785344e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.285892 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:52.285892 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:52.285892 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:52.286892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.307698 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2794/5575] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:15:52 2022] GET /identity/v3/services/6ba2ce3dc1124af0a14a20951785344e => generated 281 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:52.307698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.321110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:52.339959 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2782/5576] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:52 2022] POST /identity/v3/auth/tokens => generated 3370 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:52.340666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde8d20-d299-4d51-b577-73da42e0c738 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.340903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.346207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.354131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.354131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.354131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] PATH_INFO: `/v3/users/1c7630ec96eb4f579e05cb79c2520769` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.354131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7630ec96eb4f579e05cb79c2520769)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.354131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.358943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acd14-8fda-4b70-bc66-5fc0e531d424 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.397671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.398902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.399473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.400092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/6ba2ce3dc1124af0a14a20951785344e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.401370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6ba2ce3dc1124af0a14a20951785344e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.404658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.574259 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2783/5577] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:52 2022] DELETE /identity/v3/services/6ba2ce3dc1124af0a14a20951785344e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:52.575462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.578743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:52.652364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7630ec96eb4f579e05cb79c2520769'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:52.654784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7630ec96eb4f579e05cb79c2520769'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:52.710216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87d8c-5b8d-4485-92e7-a05a4ea9cd33 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.714237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.714858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.715137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.715405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.726573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.728408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.758153 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2784/5578] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:52.759687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.790234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2272-89d4-4417-afdf-ec070accd557 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.796327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.797068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.797421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.797770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/6ba2ce3dc1124af0a14a20951785344e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.798902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:get_service(service_id=6ba2ce3dc1124af0a14a20951785344e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.799578 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:52.799578 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:52.799578 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:52.801227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Could not find service: 6ba2ce3dc1124af0a14a20951785344e.: keystone.exception.ServiceNotFound: Could not find service: 6ba2ce3dc1124af0a14a20951785344e. Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6ba2ce3dc1124af0a14a20951785344e. Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:15:52.812572 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 20:15:52.815065 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application with Lock( Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._enter() Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.creator() Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application created_value = creator( Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6ba2ce3dc1124af0a14a20951785344e. Aug 28 20:15:52.817843 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:15:52.819373 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2785/5579] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:15:52 2022] GET /identity/v3/services/6ba2ce3dc1124af0a14a20951785344e => generated 113 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:15:52.820826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.832501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b3ae-9d0a-43bd-a332-70e79baff07a tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:52.861385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:52.861385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.861385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.863783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.863783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:52.863783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:52.891355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7630ec96eb4f579e05cb79c2520769'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:52.910440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7630ec96eb4f579e05cb79c2520769'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:52.912713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-58025b85-29ef-4385-8457-074dfa842e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7630ec96eb4f579e05cb79c2520769'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:52.956030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2795/5580] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:52 2022] DELETE /identity/v3/users/1c7630ec96eb4f579e05cb79c2520769 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:52.968280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e057a-f67b-49c9-aa4a-e0c4413864f3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:52.969165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e057a-f67b-49c9-aa4a-e0c4413864f3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:52.969543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e057a-f67b-49c9-aa4a-e0c4413864f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:52.980860 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2786/5581] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:52 2022] POST /identity/v3/services => generated 274 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:15:52.984976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:52.993780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:53.000277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-754e057a-f67b-49c9-aa4a-e0c4413864f3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:53.001603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-754e057a-f67b-49c9-aa4a-e0c4413864f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:53.042872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cd5e7-66d9-4102-a96a-f8368ae75e7b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.109099 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2796/5582] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:52 2022] POST /identity/v3/auth/tokens => generated 3406 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:15:53.111138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.111623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.112081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.129320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.130059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.130351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.130629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.131293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.133643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.138374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] MFA Rules not processed for user `38a9059e210e486aa34b724d5c497e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:53.141411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:53.240576 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2797/5583] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:53 2022] POST /identity/v3/auth/tokens => generated 3429 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:53.243520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.247582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:53.265683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2787/5584] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:52 2022] POST /identity/v3/services => generated 271 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:15:53.269197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.310085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97ab7-89cb-49a3-92dc-7dbaa4a0746c tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.317961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.319124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.319124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.319124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.321062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.322034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.363547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6358232-79d1-4009-a5fd-21fe4b933c88 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.381729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.382394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.382750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.383035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.393451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.396156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.427023 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2798/5585] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:53 2022] GET /identity/v3/auth/tokens => generated 3570 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:53.492827 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2788/5586] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:53 2022] POST /identity/v3/services => generated 274 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:15:53.497173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.513631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797edc2-d855-46b1-9187-68dd35e18287 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.531916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.533192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.533697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.535234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.535918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.537714 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:53.537714 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:15:53.537714 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:15:53.538546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.549940 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2799/5587] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:15:53 2022] GET /identity/v3/services => generated 2974 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:53.554763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.574383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e54a7-8e94-422d-8e31-a15db98919bb tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.580941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.582407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.583039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.583325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.583602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.584250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-244491515) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:53.584566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.586245 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:15:53.586245 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:15:53.586245 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:15:53.590568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:53.590669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.597149 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2789/5588] 10.222.0.78 () {58 vars in 1220 bytes} [Sun Aug 28 20:15:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-244491515 => generated 416 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:53.598722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.611641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567750a4-6420-43f0-a93c-d6f543990d81 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.621014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.622404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.622769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.623329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.624189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-4400786) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:53.624514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.629477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.648857 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2790/5589] 10.222.0.78 () {58 vars in 1216 bytes} [Sun Aug 28 20:15:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-4400786 => generated 411 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:53.651014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.680322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162934f-e8d9-4d11-a235-cf6a279c06bf tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.685194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e652-dfc8-4193-b0d6-e7549fcfaff3 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.699170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.700346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.701198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.702145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.702599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.703454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] PATH_INFO: `/v3/projects/dc6b4ca891b7479dbf8135c7e2ab6102` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.703726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.704163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.705807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-342944294) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:53.710454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6b4ca891b7479dbf8135c7e2ab6102)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.710617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.712102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.713335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:53.724395 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2791/5590] 10.222.0.78 () {58 vars in 1220 bytes} [Sun Aug 28 20:15:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-342944294 => generated 416 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:53.733767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:53.765765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164a67-7723-41c0-9ebb-95e2dd8ca4f5 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:53.778288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:53.780435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:53.780827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:53.782255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/d32ade61a93b4cf0b03eef279793ba7d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:53.790858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d32ade61a93b4cf0b03eef279793ba7d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:53.790858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:54.049955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6b4ca891b7479dbf8135c7e2ab6102', 'request_id': 'req-2923c714-c281-4a2c-8102-893d7f8e7038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.066680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6b4ca891b7479dbf8135c7e2ab6102', 'request_id': 'req-2923c714-c281-4a2c-8102-893d7f8e7038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.074189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6b4ca891b7479dbf8135c7e2ab6102', 'request_id': 'req-2923c714-c281-4a2c-8102-893d7f8e7038'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.097917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2792/5591] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:53 2022] DELETE /identity/v3/services/d32ade61a93b4cf0b03eef279793ba7d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:15:54.105212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:54.139877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2a82b-4625-435d-a98b-4f9136c2815b tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:54.216305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] The token cache is being invalidate because project dc6b4ca891b7479dbf8135c7e2ab6102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:54.216611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.217414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.219783 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2800/5592] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:53 2022] DELETE /identity/v3/projects/dc6b4ca891b7479dbf8135c7e2ab6102 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:54.220776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:54.225639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:54.271256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:54.271953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:54.272239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:54.272523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/7e35ec155fc3427080b10286d5e8888d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:54.273119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7e35ec155fc3427080b10286d5e8888d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:54.274759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:54.318809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923c714-c281-4a2c-8102-893d7f8e7038 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:54.337591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:54.341189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:54.341189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:54.341189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] PATH_INFO: `/v3/users/fca6e298d6de42229826f9d5fd787ff7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:54.341189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca6e298d6de42229826f9d5fd787ff7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:54.343144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:54.395344 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2793/5593] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:54 2022] DELETE /identity/v3/services/7e35ec155fc3427080b10286d5e8888d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:54.395344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:54.397766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:54.492252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310ca7-1332-4428-83ec-48a4c9d9a3ce tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:54.511849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:54.513076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:54.513502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:54.514015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] PATH_INFO: `/v3/projects/c6a3127313524b7d95dfc42d87627d72` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:54.516338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a3127313524b7d95dfc42d87627d72)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:54.520911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:54.664764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca6e298d6de42229826f9d5fd787ff7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.666325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca6e298d6de42229826f9d5fd787ff7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.714508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a3127313524b7d95dfc42d87627d72', 'request_id': 'req-6ea9588c-924d-463c-bd29-72ce252ad850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.723973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a3127313524b7d95dfc42d87627d72', 'request_id': 'req-6ea9588c-924d-463c-bd29-72ce252ad850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.732751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a3127313524b7d95dfc42d87627d72', 'request_id': 'req-6ea9588c-924d-463c-bd29-72ce252ad850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.884622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca6e298d6de42229826f9d5fd787ff7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.898927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca6e298d6de42229826f9d5fd787ff7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.900243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca6e298d6de42229826f9d5fd787ff7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.948154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2801/5594] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:54 2022] DELETE /identity/v3/users/fca6e298d6de42229826f9d5fd787ff7 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:54.949715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:54.953017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:54.983680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] The token cache is being invalidate because project c6a3127313524b7d95dfc42d87627d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:54.984647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.985949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:54.989937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2794/5595] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:54 2022] DELETE /identity/v3/projects/c6a3127313524b7d95dfc42d87627d72 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:54.995970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:54.999290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:55.118842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26b1b6-e0d9-4acc-b9cc-9be1cccfab22 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:55.125017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:55.125203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:55.125540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:55.126520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] PATH_INFO: `/v3/users/9150f4ec75b6459d9fc4db553c002d23` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:55.128115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9150f4ec75b6459d9fc4db553c002d23)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:55.132164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:55.173780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9588c-924d-463c-bd29-72ce252ad850 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:55.308927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:55.311728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99241-bc36-4bd4-9a8c-74f4d14ac611 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1cdabf0fbbe42b1b56defccef565cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:55.312404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99241-bc36-4bd4-9a8c-74f4d14ac611 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:55.312689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99241-bc36-4bd4-9a8c-74f4d14ac611 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:55.312985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99241-bc36-4bd4-9a8c-74f4d14ac611 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] PATH_INFO: `/v3/services/7200c933d75d44e39de2bfdc4d0cfc33` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:55.313573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99241-bc36-4bd4-9a8c-74f4d14ac611 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7200c933d75d44e39de2bfdc4d0cfc33)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:55.316170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99241-bc36-4bd4-9a8c-74f4d14ac611 tempest-ServicesTestJSON-1488615763 tempest-ServicesTestJSON-1488615763-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:55.467950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:55.509083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9150f4ec75b6459d9fc4db553c002d23'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:55.510079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9150f4ec75b6459d9fc4db553c002d23'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:55.544973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2795/5596] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:54 2022] DELETE /identity/v3/services/7200c933d75d44e39de2bfdc4d0cfc33 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:55.544973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:55.544973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:55.544973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:55.580302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:55.582566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:55.611451 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2796/5597] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:55.612554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:55.615150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:55.615765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9150f4ec75b6459d9fc4db553c002d23'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:55.635111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9150f4ec75b6459d9fc4db553c002d23'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:55.636055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9150f4ec75b6459d9fc4db553c002d23'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:55.648660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7eb53-d4f7-4359-a84a-d719a81ef526 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:55.654649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:55.655601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:55.656426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:55.656913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] PATH_INFO: `/v3/users/bf1231fc995d4534b8e209b790a1fa99` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:55.660037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1231fc995d4534b8e209b790a1fa99)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:55.663208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:55.672558 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2802/5598] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:54 2022] DELETE /identity/v3/users/9150f4ec75b6459d9fc4db553c002d23 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:55.672558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:55.673798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:55.770472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48913eae-d32a-4d7e-b9f1-fdd6407d6949 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:55.775986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:55.776632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:55.776912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:55.777189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] PATH_INFO: `/v3/users/fdfc52b16d5948cd949653bfadefe92d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:55.778389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfc52b16d5948cd949653bfadefe92d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:55.780317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:56.093767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfc52b16d5948cd949653bfadefe92d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.095287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfc52b16d5948cd949653bfadefe92d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.104927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1231fc995d4534b8e209b790a1fa99'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.125001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1231fc995d4534b8e209b790a1fa99'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.154583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1231fc995d4534b8e209b790a1fa99'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.156004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1231fc995d4534b8e209b790a1fa99'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.157074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b36c081e-e032-4e49-b406-619464787f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1231fc995d4534b8e209b790a1fa99'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.284018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfc52b16d5948cd949653bfadefe92d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.292129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfc52b16d5948cd949653bfadefe92d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.293388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfc52b16d5948cd949653bfadefe92d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.313436 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2803/5599] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:55 2022] DELETE /identity/v3/users/fdfc52b16d5948cd949653bfadefe92d => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:56.314326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:56.316680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:56.414728 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2797/5600] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:55 2022] DELETE /identity/v3/users/bf1231fc995d4534b8e209b790a1fa99 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:56.422055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:56.422055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:56.422055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:56.441402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9e4b-6037-4c31-95d7-389910ae9c76 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:56.461504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:56.461504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:56.553072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:56.555151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:56.555984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:56.556569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:56.560261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:56.591488 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2798/5601] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:56.593075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:56.596792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:56.619372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c6887-c4cf-490d-aad0-5ba9d6fc3757 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:56.629140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:56.630218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:56.630596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:56.631058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] PATH_INFO: `/v3/projects/aa2f44a441364d738e651497d8f57848` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:56.633127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2f44a441364d738e651497d8f57848)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:56.636998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:56.707501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:56.709023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:56.721549 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2804/5602] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:56.723174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:56.730230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:56.745349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee578ac7-4f79-4fac-84ae-23478365f67b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:56.751176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e66288-3071-4e13-8e27-2ee6bce14a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:56.752564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66288-3071-4e13-8e27-2ee6bce14a4d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:56.752997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66288-3071-4e13-8e27-2ee6bce14a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:56.753935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66288-3071-4e13-8e27-2ee6bce14a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:56.771610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66288-3071-4e13-8e27-2ee6bce14a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:56.774403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66288-3071-4e13-8e27-2ee6bce14a4d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:56.805132 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2805/5603] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:56.933035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2f44a441364d738e651497d8f57848', 'request_id': 'req-13003b38-fefd-4c4d-8454-fed39d6be8ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:56.976191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2f44a441364d738e651497d8f57848', 'request_id': 'req-13003b38-fefd-4c4d-8454-fed39d6be8ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:57.006294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2f44a441364d738e651497d8f57848', 'request_id': 'req-13003b38-fefd-4c4d-8454-fed39d6be8ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:57.355098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] The token cache is being invalidate because project aa2f44a441364d738e651497d8f57848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:57.357277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:57.360890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:57.375353 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2799/5604] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:56 2022] DELETE /identity/v3/projects/aa2f44a441364d738e651497d8f57848 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:57.385545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0dea-5518-49fd-b96d-f73def6e8d7a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:57.386466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0dea-5518-49fd-b96d-f73def6e8d7a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:57.386466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0dea-5518-49fd-b96d-f73def6e8d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:57.419436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:57.422750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:57.458114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1b9e0dea-5518-49fd-b96d-f73def6e8d7a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:57.458114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1b9e0dea-5518-49fd-b96d-f73def6e8d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:57.686127 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2806/5605] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:57.697768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:57.700299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:57.701242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:57.727963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003b38-fefd-4c4d-8454-fed39d6be8ed admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:57.747928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:57.752939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:57.755135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:57.756448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:57.757341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] PATH_INFO: `/v3/projects/1b8daaa861e34f1c8d8e971b9c991576` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:57.760775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:57.763106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:57.763566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8daaa861e34f1c8d8e971b9c991576)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:57.771220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:57.780845 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2807/5606] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:57.787206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:57.802674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90404f6-6f7a-4bd6-969c-09ab4cd5c0c6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:57.811680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:57.812937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:57.813686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:57.814464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:57.824487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:57.827733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:57.830744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:57.852353 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2808/5607] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:15:57.874659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:57.877419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:57.910741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bab827-278b-4f6c-b22a-4815a98d5fe5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:57.925383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:57.926607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:57.927081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:57.927368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] PATH_INFO: `/v3/projects/a97e525223614a29a3173eb80fe99d72` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:57.932667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97e525223614a29a3173eb80fe99d72)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:57.936395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:58.070160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8daaa861e34f1c8d8e971b9c991576', 'request_id': 'req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.080378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8daaa861e34f1c8d8e971b9c991576', 'request_id': 'req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.088677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8daaa861e34f1c8d8e971b9c991576', 'request_id': 'req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.169020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97e525223614a29a3173eb80fe99d72', 'request_id': 'req-2fc8a410-001b-4610-bef5-148186f90d35'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.179359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] The token cache is being invalidate because project 1b8daaa861e34f1c8d8e971b9c991576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:58.180546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.183459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97e525223614a29a3173eb80fe99d72', 'request_id': 'req-2fc8a410-001b-4610-bef5-148186f90d35'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.184035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.186882 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2800/5608] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:57 2022] DELETE /identity/v3/projects/1b8daaa861e34f1c8d8e971b9c991576 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:58.193469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:58.195394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:58.204726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97e525223614a29a3173eb80fe99d72', 'request_id': 'req-2fc8a410-001b-4610-bef5-148186f90d35'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.308708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] The token cache is being invalidate because project a97e525223614a29a3173eb80fe99d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:58.309325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb734de-bea6-49ba-bec1-e6e3686ce0cc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:58.310023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.312004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.314505 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2809/5609] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:57 2022] DELETE /identity/v3/projects/a97e525223614a29a3173eb80fe99d72 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:58.316973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:58.325635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:58.354425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:58.396978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea6489-6f34-4e1f-9013-072e3b62a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:58.398553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea6489-6f34-4e1f-9013-072e3b62a061 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:58.398958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea6489-6f34-4e1f-9013-072e3b62a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:58.399349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea6489-6f34-4e1f-9013-072e3b62a061 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:58.400361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea6489-6f34-4e1f-9013-072e3b62a061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:58.403412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea6489-6f34-4e1f-9013-072e3b62a061 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:58.447400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a410-001b-4610-bef5-148186f90d35 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:58.459987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:58.459987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:58.459987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:58.459987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] PATH_INFO: `/v3/projects/ec8b95ac71f340c08279c0e29d9df422` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:58.461266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8b95ac71f340c08279c0e29d9df422)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:58.462699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:58.648089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2801/5610] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:58 2022] POST /identity/v3/projects => generated 387 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:58.650306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:58.650832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:58.651275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:58.691340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:58.693492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:58.703232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8b95ac71f340c08279c0e29d9df422', 'request_id': 'req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.713198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8b95ac71f340c08279c0e29d9df422', 'request_id': 'req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.725505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8b95ac71f340c08279c0e29d9df422', 'request_id': 'req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.795468 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2802/5611] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:58.796926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:58.799205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:58.823194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdddb5-f99f-4da2-9f43-c124c6f46b34 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:58.832479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:58.833686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:58.834243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:58.834786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] PATH_INFO: `/v3/users/e1cdabf0fbbe42b1b56defccef565cf9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:58.837184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cdabf0fbbe42b1b56defccef565cf9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:58.841234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:58.870396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] The token cache is being invalidate because project ec8b95ac71f340c08279c0e29d9df422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:15:58.870396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.870396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:58.870396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2810/5612] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:15:58 2022] DELETE /identity/v3/projects/ec8b95ac71f340c08279c0e29d9df422 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:58.870396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:58.870987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:58.888982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e3a7-59eb-4f00-93fe-6f22b1c26409 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:58.895832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513e09-d69d-4feb-afec-6bfade8c33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:58.896782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513e09-d69d-4feb-afec-6bfade8c33cd admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:58.897056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513e09-d69d-4feb-afec-6bfade8c33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:58.897545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513e09-d69d-4feb-afec-6bfade8c33cd admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:58.898324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513e09-d69d-4feb-afec-6bfade8c33cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:58.900218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513e09-d69d-4feb-afec-6bfade8c33cd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:59.163475 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2811/5613] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:58 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:59.165721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:59.166451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:59.166956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:59.196722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:59.198028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:59.206506 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2812/5614] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:59.207393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.208870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:59.224794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5cb6f-20ea-4f01-8c52-54100579e335 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:59.229800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:59.230487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:59.230947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:59.231226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] PATH_INFO: `/v3/users/e8bd8bba8f874e66a5a551c68ec1fdda` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:59.233398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bd8bba8f874e66a5a551c68ec1fdda)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:59.245008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:59.259908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cdabf0fbbe42b1b56defccef565cf9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.284217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cdabf0fbbe42b1b56defccef565cf9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.308567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cdabf0fbbe42b1b56defccef565cf9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.318617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cdabf0fbbe42b1b56defccef565cf9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.318617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cdabf0fbbe42b1b56defccef565cf9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.446562 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2803/5615] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:58 2022] DELETE /identity/v3/users/e1cdabf0fbbe42b1b56defccef565cf9 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:59.447516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.448916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:59.553905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1631c-d0b7-4fac-a90b-bef425673798 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:59.561741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:59.562596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:59.563037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:59.563315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:59.564340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:59.567410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:59.606801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2804/5616] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:59.606801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.610758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:59.614275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bd8bba8f874e66a5a551c68ec1fdda'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.615913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bd8bba8f874e66a5a551c68ec1fdda'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.629151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bad56-90f9-4f7a-a48a-9467ac24fb11 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:59.635212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:59.636286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:59.636827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:59.637431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:59.638232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:15:59.638571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:59.640347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:59.663196 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2805/5617] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:15:59.663196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.686976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78affaa9-fe00-4bfd-b2a2-ab9738269d2c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:59.686976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:59.686976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:59.686976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:59.687802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:59.687802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:59.687802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:59.698781 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2806/5618] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:15:59.699804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.711253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2160942-846a-479c-bbcc-3c665cdf0363 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:59.721122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:59.722084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:59.722372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:59.722746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:59.723425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:59.726708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:59.882491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bd8bba8f874e66a5a551c68ec1fdda'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.893259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bd8bba8f874e66a5a551c68ec1fdda'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.895010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bd8bba8f874e66a5a551c68ec1fdda'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:15:59.927593 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2813/5619] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:15:59 2022] DELETE /identity/v3/users/e8bd8bba8f874e66a5a551c68ec1fdda => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:15:59.930427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.932063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:59.989084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2807/5620] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:15:59 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:15:59.990858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:59.992684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:00.098178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e324-657b-43fd-8c96-ea77fc24608d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:00.129181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:00.148919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0c8b-99a9-4e82-99c0-22452ad0c407 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:00.167205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:00.168475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:00.169251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:00.169719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:00.172655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:00.186939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:00.231688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:00.232494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:00.232675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:00.232963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] PATH_INFO: `/v3/projects/0a5e890e1c454e02a7c67bddd76f6c38/users/6e28a0d06eaf4b9d8f95dfa33fa90c96/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:00.258902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5e890e1c454e02a7c67bddd76f6c38, user_id=6e28a0d06eaf4b9d8f95dfa33fa90c96, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:00.262051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:00.396214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2808/5621] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:15:59 2022] POST /identity/v3/users => generated 291 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:00.410156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:00.426110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e11f-dc6b-479a-96e8-741e03db511c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:00.441053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2814/5622] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:15:59 2022] PUT /identity/v3/projects/0a5e890e1c454e02a7c67bddd76f6c38/users/6e28a0d06eaf4b9d8f95dfa33fa90c96/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:00.443200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:00.449542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:00.635287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164f2f-73b9-4015-a75e-a289dffe0bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:00.636367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164f2f-73b9-4015-a75e-a289dffe0bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:00.636840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164f2f-73b9-4015-a75e-a289dffe0bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:00.637317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164f2f-73b9-4015-a75e-a289dffe0bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:00.638218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164f2f-73b9-4015-a75e-a289dffe0bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:00.640378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164f2f-73b9-4015-a75e-a289dffe0bb9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:00.643722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04944ba-018f-495e-a8e6-91264612cea6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:00.651559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:00.653089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:00.653454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:00.653742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] PATH_INFO: `/v3/projects/b9d2b83c7f4242e39424f52d3d66b3a3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:00.655648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d2b83c7f4242e39424f52d3d66b3a3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:00.656689 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2809/5623] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:00.658009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:00.658504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:00.658921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:00.660321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:00.699492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] MFA Rules not processed for user `6e28a0d06eaf4b9d8f95dfa33fa90c96`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:00.701997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:00.818828 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2810/5624] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:00.821402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:00.839244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb887ff-f07e-4429-ba3f-53f285eee4a9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:00.856970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:00.856970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:00.856970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:00.859975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:00.862529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:00.867397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:00.888671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2811/5625] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:00.888671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:00.890723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:00.894567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:00.920836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'request_id': 'req-0234e567-5196-4a83-b86d-a4afe14bb90d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:00.952329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'request_id': 'req-0234e567-5196-4a83-b86d-a4afe14bb90d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:00.961130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d2b83c7f4242e39424f52d3d66b3a3', 'request_id': 'req-0234e567-5196-4a83-b86d-a4afe14bb90d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.036853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b9147-c561-4b38-a29e-13936313a14d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:01.063742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] The token cache is being invalidate because project b9d2b83c7f4242e39424f52d3d66b3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:01.064143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.065243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.066491 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2815/5626] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:00 2022] DELETE /identity/v3/projects/b9d2b83c7f4242e39424f52d3d66b3a3 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:01.070968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:01.072525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.127134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:01.127134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.127134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.127134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.128838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.190865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e567-5196-4a83-b86d-a4afe14bb90d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:01.197319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:01.198502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.199015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.199563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] PATH_INFO: `/v3/projects/286e09ede7584deba34f6f1ed3dafbe6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.201107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286e09ede7584deba34f6f1ed3dafbe6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:01.204223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:01.223887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:01.226110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:01.242054 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2812/5627] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:01.243512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:01.245039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.263240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f72bef-631f-4384-98b1-f78e1f39eeea service glance] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:01.270832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8576599-28ac-4e92-9cf2-14c8001662c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:01.271610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8576599-28ac-4e92-9cf2-14c8001662c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.272228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8576599-28ac-4e92-9cf2-14c8001662c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.272584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8576599-28ac-4e92-9cf2-14c8001662c8 admin admin] PATH_INFO: `/v3/projects/1b40d330b05447a68220a015b9ed2d79/users/db9e25f20e754e39b4ac5b3b56a2e0be/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.300307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8576599-28ac-4e92-9cf2-14c8001662c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b40d330b05447a68220a015b9ed2d79, user_id=db9e25f20e754e39b4ac5b3b56a2e0be, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:01.303571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8576599-28ac-4e92-9cf2-14c8001662c8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:01.492513 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2813/5628] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:01 2022] PUT /identity/v3/projects/1b40d330b05447a68220a015b9ed2d79/users/db9e25f20e754e39b4ac5b3b56a2e0be/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:01.495130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.495898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.496702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.521885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286e09ede7584deba34f6f1ed3dafbe6', 'request_id': 'req-126ef151-ae00-429c-b3b0-10a7e4e2df47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.531714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286e09ede7584deba34f6f1ed3dafbe6', 'request_id': 'req-126ef151-ae00-429c-b3b0-10a7e4e2df47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.545632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286e09ede7584deba34f6f1ed3dafbe6', 'request_id': 'req-126ef151-ae00-429c-b3b0-10a7e4e2df47'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.546083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:01.546779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.656946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] The token cache is being invalidate because project 286e09ede7584deba34f6f1ed3dafbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:01.657467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.657986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-126ef151-ae00-429c-b3b0-10a7e4e2df47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:01.663431 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2816/5629] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:01 2022] DELETE /identity/v3/projects/286e09ede7584deba34f6f1ed3dafbe6 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:01.664041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b224-1cbe-45a4-a401-977831605fda None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.664415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b224-1cbe-45a4-a401-977831605fda None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.664704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b224-1cbe-45a4-a401-977831605fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.694122 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2814/5630] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:01.695374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:01.697381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.714912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2cb5b224-1cbe-45a4-a401-977831605fda None None] MFA Rules not processed for user `db9e25f20e754e39b4ac5b3b56a2e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:01.716476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2cb5b224-1cbe-45a4-a401-977831605fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.831257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3373a-3d6d-4dde-9a4e-64ea161079c5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:01.842304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:01.842945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.843227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.843501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.846906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.864239 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2817/5631] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:01.873900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96fe20-6b62-4130-89d0-05ea00cd0648 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.874990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96fe20-6b62-4130-89d0-05ea00cd0648 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.875740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96fe20-6b62-4130-89d0-05ea00cd0648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:01.884159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:01.886483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5deb98a-29e4-4ab4-952b-bc87a7c180ac service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:01.915607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4b96fe20-6b62-4130-89d0-05ea00cd0648 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:01.918190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4b96fe20-6b62-4130-89d0-05ea00cd0648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:01.946362 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2815/5632] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:01.950903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40c6d9-3773-4a18-9f80-5c0ca18a0c33 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:01.951604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40c6d9-3773-4a18-9f80-5c0ca18a0c33 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:01.952160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40c6d9-3773-4a18-9f80-5c0ca18a0c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.018933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4e40c6d9-3773-4a18-9f80-5c0ca18a0c33 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:02.020276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e40c6d9-3773-4a18-9f80-5c0ca18a0c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:02.039899 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2816/5633] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:02.049118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.049575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.054384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.100765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:02.102273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:02.113287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2817/5634] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:02.114087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.115967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:02.138183 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2818/5635] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:02.143348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.144175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.145179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.156012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d435ec-bdc3-4af4-a934-efddfc30a509 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.172190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.173172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.173812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.174302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.176346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.178941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.180892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:02.182450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:02.198909 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2819/5636] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:02.199987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.216605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d62034-47cf-48fb-87ea-b25f54ead1c8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.222893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.224792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.225777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.226301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.226987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:02.227290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.228961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.250831 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2820/5637] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:02.250831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.257254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:02.343452 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2818/5638] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:02.345035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.393726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8562d-6384-48b2-8906-5b5c6b07a35d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.461117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:02.468762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d106d-f168-4b30-bca9-81a62eec9177 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.478707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.479288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.479571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.479843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.481727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:02.482162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.484240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.504179 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2819/5639] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:02.506264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.516413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.517356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.517356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.517643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.526342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb895c2-3de9-4b9c-950c-a6d15d61435a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.536083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.537275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.537900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.538496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.539839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.544180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.589828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.591452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.603534 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2821/5640] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:02.605462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.619859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe135-ee06-4367-a418-842d0ce6e06a service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.626037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.626870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.627162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.627443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.628126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.630451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.703429 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2820/5641] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:02.708108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.782506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b862-6c76-4f0d-bea3-8a97fe1a76c6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.788565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.789210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.789496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.789891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.790571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.792819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.809425 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2822/5642] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:02.810678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:02.827836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931dcb9-1e4f-40ba-8cc5-ee90d5574170 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:02.834439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:02.835188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:02.835559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:02.835923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:02.836751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:02.839454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:02.962894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2821/5643] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/projects => generated 371 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:02.962894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.005168 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2823/5644] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:02 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:03.005168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.013096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee966f9-8b6a-4bd8-b493-b1b67bdb33a4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.050019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a911-4502-44a8-a02d-965396812ce0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.056022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.056653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.056946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.057214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.057900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.059612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.080071 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2822/5645] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:03.080696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.093840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36b12-13c7-4c80-b8fd-dde445a7ccc2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.100722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.101100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.101573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.101879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.102549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.104177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.118408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.119151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.119546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.119916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.120582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.121800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2823/5646] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:03.122675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.123572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.139636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0645c5-905f-4831-8433-79534dff5849 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.146060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.147114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.147382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.147484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] PATH_INFO: `/v3/projects/910a48465aab440f974b9c98f29ca17c/users/d084162977ba403eb9a8168df8076d22/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.170213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910a48465aab440f974b9c98f29ca17c, user_id=d084162977ba403eb9a8168df8076d22, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.173830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.333416 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2824/5647] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:03 2022] POST /identity/v3/users => generated 286 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:03.334697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.360933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcc83b-2c2d-4235-ae70-9b43988d3758 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.375329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.380502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.380502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.380502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.380502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.380946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:03.381055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.391328 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2824/5648] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:03 2022] PUT /identity/v3/projects/910a48465aab440f974b9c98f29ca17c/users/d084162977ba403eb9a8168df8076d22/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:03.393118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.399708 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2825/5649] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:03.402843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.418066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24a0e-372c-4841-80e7-0fb9633067ae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.526068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.526700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.526982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.527257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.527962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.529580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.531062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372dc70-ff2e-4fa6-9bc2-ba12ea9ebec5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.544041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.544160 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2826/5650] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:03.544253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.544253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.544253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.544505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.544588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.547718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.561277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57449b77-888b-4129-87f2-9aac10916720 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.569673 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2825/5651] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:03.571564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.578182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aea79-a70f-47c1-be08-27d8b627ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.579851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aea79-a70f-47c1-be08-27d8b627ff15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.580527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aea79-a70f-47c1-be08-27d8b627ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.581300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aea79-a70f-47c1-be08-27d8b627ff15 admin admin] PATH_INFO: `/v3/projects/3d9be8fc40f441608bc9e796560c3818/users/5e988fe1a8a64a979f2d44672c80a790/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.583923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5170-9567-44dc-b6dd-83529a6044de admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.590620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.591299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.591601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.591878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] PATH_INFO: `/v3/projects/910a48465aab440f974b9c98f29ca17c/users/d084162977ba403eb9a8168df8076d22/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.594171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=910a48465aab440f974b9c98f29ca17c, user_id=d084162977ba403eb9a8168df8076d22, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.597984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.605002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aea79-a70f-47c1-be08-27d8b627ff15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9be8fc40f441608bc9e796560c3818, user_id=5e988fe1a8a64a979f2d44672c80a790, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.608333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aea79-a70f-47c1-be08-27d8b627ff15 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.609955 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2826/5652] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:03 2022] PUT /identity/v3/projects/910a48465aab440f974b9c98f29ca17c/users/d084162977ba403eb9a8168df8076d22/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:03.612942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.692041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b3fa-aa47-42a9-9617-255df62b03cd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:03.717968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4de46b-31e5-4db8-8079-e9855766e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:03.719426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de46b-31e5-4db8-8079-e9855766e770 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.722449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de46b-31e5-4db8-8079-e9855766e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.723298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de46b-31e5-4db8-8079-e9855766e770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.726070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de46b-31e5-4db8-8079-e9855766e770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:03.730861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de46b-31e5-4db8-8079-e9855766e770 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:03.731032 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2827/5653] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:03 2022] PUT /identity/v3/projects/3d9be8fc40f441608bc9e796560c3818/users/5e988fe1a8a64a979f2d44672c80a790/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:03.732169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.732462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.732739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.760267 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2827/5654] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:03.765637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:03.767671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:03.767671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:03.802160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] MFA Rules not processed for user `d084162977ba403eb9a8168df8076d22`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:03.803598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:03.811895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] MFA Rules not processed for user `5e988fe1a8a64a979f2d44672c80a790`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:03.813798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:03.942417 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2828/5655] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:03.942417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:03.967883 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2828/5656] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:03.969316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:04.070364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba40548-41e5-4334-8ac5-7a651b704039 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.076981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.082824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.082824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.082824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] PATH_INFO: `/v3/projects/2d74cb7a06e542488ed82bce56a844d5/users/d23a58ff5fab414baaa806e75bde45e1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.106615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d74cb7a06e542488ed82bce56a844d5, user_id=d23a58ff5fab414baaa806e75bde45e1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:04.109286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c096f0-5956-44aa-9c63-89f5f08e636a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.111605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:04.114982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137aea-c3c2-4eb0-8cdf-cc75c6200cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.115677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137aea-c3c2-4eb0-8cdf-cc75c6200cca admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.116159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137aea-c3c2-4eb0-8cdf-cc75c6200cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.116443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137aea-c3c2-4eb0-8cdf-cc75c6200cca admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.117107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137aea-c3c2-4eb0-8cdf-cc75c6200cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:04.119164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137aea-c3c2-4eb0-8cdf-cc75c6200cca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:04.209919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2829/5657] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:03 2022] PUT /identity/v3/projects/2d74cb7a06e542488ed82bce56a844d5/users/d23a58ff5fab414baaa806e75bde45e1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:04.211708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:04.215104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:04.258800 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2829/5658] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:03 2022] POST /identity/v3/projects => generated 365 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:04.260353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d137-21bb-4669-9338-ab864a429a34 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.261061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d137-21bb-4669-9338-ab864a429a34 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.261658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d137-21bb-4669-9338-ab864a429a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.312686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0530d137-21bb-4669-9338-ab864a429a34 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:04.317062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0530d137-21bb-4669-9338-ab864a429a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:04.358981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdf66-eb3e-4fa5-806a-dcf545a29e0c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.424964 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2830/5659] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:04.428299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.428538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.428964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.445763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:04.458735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.459886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.460485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.461089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.466604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] MFA Rules not processed for user `d23a58ff5fab414baaa806e75bde45e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:04.470208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:04.490658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:04.577749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:04.577749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:04.588777 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2830/5660] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:04.589743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:04.648515 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2831/5661] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:04.660225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:04.685222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee31e3-d499-4865-aa35-cca7abd5811c service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.694143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.694870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.695256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.695746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.696581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:04.699944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:04.851817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2831/5662] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:04 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:04.856679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:04.878023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9aeaf-7627-4172-838c-b66995666f92 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.878464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:04.898866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.899972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.900183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.900836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.926399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:04.928206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:04.941439 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2832/5663] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:04.942392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:04.958227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a73a2-d367-4c3f-baec-52073a86958f service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.967753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.968723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.969311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.969563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.970636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:04.973097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:04.986396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0375-a25d-41af-93c8-3ef203395c1b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:04.990656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:04.991564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:04.991702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:04.992251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2833/5664] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:04.992425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:04.993314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:05.002417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:05.004015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:05.006326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699047f-e0bc-4455-b098-2bb9b987a61b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:05.012560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:05.013648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:05.013961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:05.014254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] PATH_INFO: `/v3/projects/2c5224a11b404bcd9b76c557f2a8fb16/users/c927bd9cfa2b4eafa8cf0b0ae0c71a37/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:05.014569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2832/5665] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:05.035946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5224a11b404bcd9b76c557f2a8fb16, user_id=c927bd9cfa2b4eafa8cf0b0ae0c71a37, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:05.038972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:05.134629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2834/5666] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:04 2022] PUT /identity/v3/projects/2c5224a11b404bcd9b76c557f2a8fb16/users/c927bd9cfa2b4eafa8cf0b0ae0c71a37/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:05.137298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:05.150035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef46da-d9e2-44a2-8512-ff33beb8640f service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:05.199396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:05.261420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a55abe-adbb-411b-ab9e-58eb929c7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:05.262956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a55abe-adbb-411b-ab9e-58eb929c7e10 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:05.263444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a55abe-adbb-411b-ab9e-58eb929c7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:05.263920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a55abe-adbb-411b-ab9e-58eb929c7e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:05.267925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a55abe-adbb-411b-ab9e-58eb929c7e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:05.272043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a55abe-adbb-411b-ab9e-58eb929c7e10 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:05.297113 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2833/5667] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:05.298553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:05.319376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b544c-4592-4a09-9278-8ce20b5c3803 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:05.319376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:05.319376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:05.319376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:05.319751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] PATH_INFO: `/v3/projects/2c5224a11b404bcd9b76c557f2a8fb16/users/c927bd9cfa2b4eafa8cf0b0ae0c71a37/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:05.320272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5224a11b404bcd9b76c557f2a8fb16, user_id=c927bd9cfa2b4eafa8cf0b0ae0c71a37, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:05.323109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:05.334106 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2835/5668] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:05 2022] PUT /identity/v3/projects/2c5224a11b404bcd9b76c557f2a8fb16/users/c927bd9cfa2b4eafa8cf0b0ae0c71a37/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:05.344949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:05.345240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:05.345523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:05.390199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] MFA Rules not processed for user `c927bd9cfa2b4eafa8cf0b0ae0c71a37`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:05.392885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:05.495376 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2834/5669] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:05.500547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:05.512762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2435f-6817-4cf2-98db-cc998cc1a098 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:05.518045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:05.519332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:05.519705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:05.519992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:05.520690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:05.522554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:05.718227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:05.730068 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2836/5670] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:05 2022] POST /identity/v3/projects => generated 358 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:16:05.730807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7cdb6-4289-41e7-a0b7-04c5f683ae44 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:05.859451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:05.860429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:05.860936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:05.861405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:05.862344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:05.864714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:06.008315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2835/5671] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:05 2022] POST /identity/v3/users => generated 373 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:06.012217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:06.032255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1a80-76d4-4dbc-85a3-d4e3389bf31c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:06.049764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8fb6e-2bcc-4f0e-a4bb-1d21c30c9b9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:06.049764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fb6e-2bcc-4f0e-a4bb-1d21c30c9b9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:06.049764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fb6e-2bcc-4f0e-a4bb-1d21c30c9b9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:06.050109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fb6e-2bcc-4f0e-a4bb-1d21c30c9b9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/f6abfca1926045de976cb707edb5ef93` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:06.069272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fb6e-2bcc-4f0e-a4bb-1d21c30c9b9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:get_user(user_id=f6abfca1926045de976cb707edb5ef93)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:06.072136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fb6e-2bcc-4f0e-a4bb-1d21c30c9b9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:06.073944 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2837/5672] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:16:06 2022] GET /identity/v3/users/f6abfca1926045de976cb707edb5ef93 => generated 373 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:06.079243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:06.094251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2fa12-2d44-4898-9c88-570539a8f075 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:06.101780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:06.102855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:06.103572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:06.104018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/f6abfca1926045de976cb707edb5ef93` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:06.106102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f6abfca1926045de976cb707edb5ef93)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:06.108538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:06.269782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:06.270265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:06.270912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:06.304269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6abfca1926045de976cb707edb5ef93'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.319213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6abfca1926045de976cb707edb5ef93'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.328993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6abfca1926045de976cb707edb5ef93'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.330065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6abfca1926045de976cb707edb5ef93'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.331057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6abfca1926045de976cb707edb5ef93'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.341882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:06.343587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:06.430237 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2836/5673] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:06 2022] DELETE /identity/v3/users/f6abfca1926045de976cb707edb5ef93 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:06.434005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:06.437792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:06.441077 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2838/5674] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 20:16:06.444469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:06.454339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:06.457464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:06.599961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc846a2-f884-46fc-b973-f6a39baf520f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:06.622460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eaea9-950b-4848-aa88-4dc053efeca3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:06.624538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:06.624538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:06.624903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:06.625102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/02e353b4695e4b94be0c725c6be2e218` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:06.626735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02e353b4695e4b94be0c725c6be2e218)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:06.633908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:06.738704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:06.739687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:06.740292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:06.740781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:06.890100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:06.892837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:06.910780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e353b4695e4b94be0c725c6be2e218', 'request_id': 'req-6d16f16c-ecb8-487b-b809-5cb52575c01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.918107 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2839/5675] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:16:06.930202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e353b4695e4b94be0c725c6be2e218', 'request_id': 'req-6d16f16c-ecb8-487b-b809-5cb52575c01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:06.939640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e353b4695e4b94be0c725c6be2e218', 'request_id': 'req-6d16f16c-ecb8-487b-b809-5cb52575c01a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:07.068084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] The token cache is being invalidate because project 02e353b4695e4b94be0c725c6be2e218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:07.068406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:07.069125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:07.075054 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2837/5676] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:06 2022] DELETE /identity/v3/projects/02e353b4695e4b94be0c725c6be2e218 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:16:07.076956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.096852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46399f3c-ad8c-4f51-b374-6549ff3c250b service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.159182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.160684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:07.197697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.200341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.201075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.202638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.203833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.207845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.271427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f16c-ecb8-487b-b809-5cb52575c01a tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.276517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.277110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.277387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.277652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.279469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:07.293097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.294762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.307551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2838/5677] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:16:07.350915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2840/5678] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:07 2022] POST /identity/v3/projects => generated 359 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:07.352712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.354289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:07.371121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada1f53-77d2-4142-a4f7-f3d734be946f service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.469642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c7db0-c514-4acf-a9d3-0cb357d7d1aa tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.470578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7db0-c514-4acf-a9d3-0cb357d7d1aa tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.470903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7db0-c514-4acf-a9d3-0cb357d7d1aa tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.471147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7db0-c514-4acf-a9d3-0cb357d7d1aa tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.472374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c7db0-c514-4acf-a9d3-0cb357d7d1aa tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.474316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c7db0-c514-4acf-a9d3-0cb357d7d1aa tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.622078 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2839/5679] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:07 2022] POST /identity/v3/users => generated 417 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:07.626499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.647721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9217b-23e4-4187-bc5f-e8b314940f9d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.652612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.653375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.653728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.654162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.655181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.657187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.722465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.722465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.722465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.742643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:07.744308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:07.789557 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2841/5680] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:16:07 2022] POST /identity/v3/roles => generated 239 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:16:07.795423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.810092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c52d26-761f-4ce9-97ca-6e1b23d35f45 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.816147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.821125 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2840/5681] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:07.826264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.826589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.826881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/56c29a9ec4a945db864b8f03fba623b2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.841631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.844740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:07.863521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:get_user(user_id=56c29a9ec4a945db864b8f03fba623b2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.865764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.869901 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2842/5682] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:16:07 2022] GET /identity/v3/users/56c29a9ec4a945db864b8f03fba623b2 => generated 417 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:07.872067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.884427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43cf17-d419-4b96-8aca-27ab7c27295f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.890894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.891536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.891817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.892111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/roles/1fe2bd975f6842d49344b82d7d84035f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.894064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:get_role(role_id=1fe2bd975f6842d49344b82d7d84035f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.895332 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:16:07.895332 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:16:07.895332 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:16:07.897585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.898031 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2843/5683] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:16:07 2022] GET /identity/v3/roles/1fe2bd975f6842d49344b82d7d84035f => generated 239 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:16:07.901740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:07.913838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19c90-4437-4e6e-9882-ff14c22ba1ae tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.919800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.923715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.923715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.923715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.923715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.923715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:07.950068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f195212-ad44-4714-bb55-d38f5097c366 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:07.954841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:07.955527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:07.956687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:07.956687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:07.968843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:07.977530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:08.007026 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2841/5684] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:08.045709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:08.108383 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2844/5685] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:07 2022] POST /identity/v3/projects => generated 359 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:08.109748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:08.121774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e0f5-587e-430b-bcbf-9f3f08019637 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:08.243927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:08.243927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:08.243927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:08.244289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/c2e6dd37a4fb4270951bc8abc9202344` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:08.244289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2e6dd37a4fb4270951bc8abc9202344)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:08.244289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:08.247879 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2842/5686] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:16:08 2022] GET /identity/v3/projects/c2e6dd37a4fb4270951bc8abc9202344 => generated 359 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:08.250498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:08.269522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a22ec-0bfd-4b69-b68d-9be08e4511cc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:08.274828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:08.275598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:08.275955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:08.276431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/c2e6dd37a4fb4270951bc8abc9202344/users/56c29a9ec4a945db864b8f03fba623b2/roles/1fe2bd975f6842d49344b82d7d84035f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:08.278976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c2e6dd37a4fb4270951bc8abc9202344, user_id=56c29a9ec4a945db864b8f03fba623b2, role_id=1fe2bd975f6842d49344b82d7d84035f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:08.282597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:08.459101 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2845/5687] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:08 2022] PUT /identity/v3/projects/c2e6dd37a4fb4270951bc8abc9202344/users/56c29a9ec4a945db864b8f03fba623b2/roles/1fe2bd975f6842d49344b82d7d84035f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:08.463236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:08.488244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede5a5b-ab2a-4d58-bf75-0ab104531078 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:08.603539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:08.604272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:08.604565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:08.605242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:08.605694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:08.607830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:08.900308 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2843/5688] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:08 2022] POST /identity/v3/projects => generated 359 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:08.902321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:08.912928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fc06-4b49-48eb-9828-38d288419d07 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:09.028056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0429fc-1a80-4015-86b0-90210aab3ab5 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:09.029385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0429fc-1a80-4015-86b0-90210aab3ab5 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:09.029966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0429fc-1a80-4015-86b0-90210aab3ab5 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:09.030476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0429fc-1a80-4015-86b0-90210aab3ab5 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/a279a78eb49b4e928585521a66f2c7bc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:09.032546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0429fc-1a80-4015-86b0-90210aab3ab5 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:get_project(project_id=a279a78eb49b4e928585521a66f2c7bc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:09.037804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0429fc-1a80-4015-86b0-90210aab3ab5 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:09.051410 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2846/5689] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:16:08 2022] GET /identity/v3/projects/a279a78eb49b4e928585521a66f2c7bc => generated 359 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:09.052586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:09.063864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921532f-7e65-401a-a403-9e1d3970b637 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:09.070163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:09.070931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:09.071277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:09.071802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/a279a78eb49b4e928585521a66f2c7bc/users/56c29a9ec4a945db864b8f03fba623b2/roles/1fe2bd975f6842d49344b82d7d84035f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:09.074837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a279a78eb49b4e928585521a66f2c7bc, user_id=56c29a9ec4a945db864b8f03fba623b2, role_id=1fe2bd975f6842d49344b82d7d84035f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:09.078397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:09.191162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:09.192107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:09.192481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:09.211850 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2844/5690] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:09 2022] PUT /identity/v3/projects/a279a78eb49b4e928585521a66f2c7bc/users/56c29a9ec4a945db864b8f03fba623b2/roles/1fe2bd975f6842d49344b82d7d84035f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:09.215820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:09.246505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:09.256903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:09.365636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2847/5691] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:09.375994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41946-8227-43eb-8497-89168e19f180 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:09.383819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:09.384488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:09.384653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:09.384941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:09.385276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/56c29a9ec4a945db864b8f03fba623b2/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:09.386845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=56c29a9ec4a945db864b8f03fba623b2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:09.388982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:09.462723 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2845/5692] 10.222.0.78 () {58 vars in 1248 bytes} [Sun Aug 28 20:16:09 2022] GET /identity/v3/users/56c29a9ec4a945db864b8f03fba623b2/projects => generated 842 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:16:09.466324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:09.481573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae189b-9489-4115-a693-b164716e86ab tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:09.482748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dfee1-be81-4356-96a4-c62b9c5c5aef None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:09.489006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:09.490126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:09.490576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:09.491163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:09.491447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/a279a78eb49b4e928585521a66f2c7bc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:09.491881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:09.492349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:09.493132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:09.500275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a279a78eb49b4e928585521a66f2c7bc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:09.504544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:09.506645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:09.509656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:09.523503 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2848/5693] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:09.987530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a279a78eb49b4e928585521a66f2c7bc', 'request_id': 'req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:09.996755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a279a78eb49b4e928585521a66f2c7bc', 'request_id': 'req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.008551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a279a78eb49b4e928585521a66f2c7bc', 'request_id': 'req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.221888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] The token cache is being invalidate because project a279a78eb49b4e928585521a66f2c7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:10.221888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.225124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-76aa7839-2a09-4ba9-a0ff-7450f482dd3c tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.227056 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2846/5694] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:09 2022] DELETE /identity/v3/projects/a279a78eb49b4e928585521a66f2c7bc => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:10.231756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:10.243232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1736e-b6a8-43ff-b548-4d88d8a5f569 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:10.341588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:10.343891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:10.343891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:10.343891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/c2e6dd37a4fb4270951bc8abc9202344` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:10.345124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2e6dd37a4fb4270951bc8abc9202344)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:10.348511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:10.612421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:10.613156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:10.613156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:10.652009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:10.653914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:10.756519 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2847/5695] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:10.763742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:10.768717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:10.781797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e6dd37a4fb4270951bc8abc9202344', 'request_id': 'req-32c968d8-e770-461c-b7fe-5399c8868d72'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.797474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e6dd37a4fb4270951bc8abc9202344', 'request_id': 'req-32c968d8-e770-461c-b7fe-5399c8868d72'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.822982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e6dd37a4fb4270951bc8abc9202344', 'request_id': 'req-32c968d8-e770-461c-b7fe-5399c8868d72'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.880496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:10.931152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f91a-f611-40c6-b3cd-3b0deb526d90 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:10.936363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] The token cache is being invalidate because project c2e6dd37a4fb4270951bc8abc9202344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:10.937023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.938103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:10.940386 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2849/5696] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:10 2022] DELETE /identity/v3/projects/c2e6dd37a4fb4270951bc8abc9202344 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:10.947395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:10.949509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:11.043358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:11.044262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:11.045197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:11.045679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:11.053458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:11.063367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c968d8-e770-461c-b7fe-5399c8868d72 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:11.075408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:11.076431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:11.076806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:11.077201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/roles/1fe2bd975f6842d49344b82d7d84035f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:11.080169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1fe2bd975f6842d49344b82d7d84035f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:11.084793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:11.138272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:11.140373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:11.166055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2848/5697] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:11.262775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invalidating the token cache because role 1fe2bd975f6842d49344b82d7d84035f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:11.263715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.264406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.266692 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2850/5698] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:10 2022] DELETE /identity/v3/roles/1fe2bd975f6842d49344b82d7d84035f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:11.270880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:11.282781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14780096-eb2d-4fc3-80f6-22c41e18dece service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:11.358760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:11.359777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:11.360468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:11.360468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/56c29a9ec4a945db864b8f03fba623b2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:11.362891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_user(user_id=56c29a9ec4a945db864b8f03fba623b2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:11.364493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:11.578833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c29a9ec4a945db864b8f03fba623b2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.605327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c29a9ec4a945db864b8f03fba623b2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.619534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c29a9ec4a945db864b8f03fba623b2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.620330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c29a9ec4a945db864b8f03fba623b2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.620967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c29a9ec4a945db864b8f03fba623b2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:11.870705 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2849/5699] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:11 2022] DELETE /identity/v3/users/56c29a9ec4a945db864b8f03fba623b2 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:11.875575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:11.877446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:11.897764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904355-633e-4038-ae6d-81058dcc2a3b tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:11.988943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:11.989903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:11.990614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:11.990933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/0797e92c5bec4508835bea3940abb247` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:11.992220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0797e92c5bec4508835bea3940abb247)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:11.995068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:12.173149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0797e92c5bec4508835bea3940abb247', 'request_id': 'req-2f7c7e0c-698f-4d7f-9d35-bea383296058'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.183883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0797e92c5bec4508835bea3940abb247', 'request_id': 'req-2f7c7e0c-698f-4d7f-9d35-bea383296058'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.211126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0797e92c5bec4508835bea3940abb247', 'request_id': 'req-2f7c7e0c-698f-4d7f-9d35-bea383296058'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.230955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:12.233997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:12.309659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab1c3a-8d13-47ab-8fc4-1751ba76306f tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:12.379800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] The token cache is being invalidate because project 0797e92c5bec4508835bea3940abb247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:12.381045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.382995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.389496 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2851/5700] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:11 2022] DELETE /identity/v3/projects/0797e92c5bec4508835bea3940abb247 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:16:12.397453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:12.397453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:12.397453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:12.397453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] PATH_INFO: `/v3/users/6e28a0d06eaf4b9d8f95dfa33fa90c96` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:12.398587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e28a0d06eaf4b9d8f95dfa33fa90c96)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:12.398587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:12.408713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:12.418747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:12.522710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:12.552821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7e0c-698f-4d7f-9d35-bea383296058 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:12.562552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:12.562552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:12.562552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:12.562831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/5e988fe1a8a64a979f2d44672c80a790` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:12.564813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:update_user(user_id=5e988fe1a8a64a979f2d44672c80a790)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:12.568675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:12.670823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e28a0d06eaf4b9d8f95dfa33fa90c96'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.693956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e28a0d06eaf4b9d8f95dfa33fa90c96'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.712431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e28a0d06eaf4b9d8f95dfa33fa90c96'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.712777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e28a0d06eaf4b9d8f95dfa33fa90c96'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.716341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-48de089e-f3a6-4708-b6c0-a4b66229e3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e28a0d06eaf4b9d8f95dfa33fa90c96'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.734066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:12.931846 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2850/5701] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:12 2022] DELETE /identity/v3/users/6e28a0d06eaf4b9d8f95dfa33fa90c96 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:12.945941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:12.945941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:12.945941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:12.984191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:12.986768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:13.049472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invalidating the token cache because user 5e988fe1a8a64a979f2d44672c80a790 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:13.049947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:13.050690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-46b68fd7-7585-4ab7-ad1e-2f71b0531c2d tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:13.052833 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2852/5702] 10.222.0.78 () {60 vars in 1243 bytes} [Sun Aug 28 20:16:12 2022] PATCH /identity/v3/users/5e988fe1a8a64a979f2d44672c80a790 => generated 296 bytes in 644 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:13.057718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:13.058132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:13.058505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:13.069239 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2851/5703] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:13.081100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:13.084240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:13.106235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] MFA Rules not processed for user `5e988fe1a8a64a979f2d44672c80a790`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:13.108955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:13.114044 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2853/5704] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:13 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 20:16:13.118756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:13.120994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:13.196065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5329c-e81a-4768-bc2a-038281edb706 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:13.204289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:13.205308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:13.210052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:13.211402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:13.228071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:13.231202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:13.238484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a163a-d399-4ab9-b1cb-f7e679892d1c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:13.246561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:13.247240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:13.247610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:13.247872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/5e988fe1a8a64a979f2d44672c80a790` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:13.249533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:update_user(user_id=5e988fe1a8a64a979f2d44672c80a790)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:13.255677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:13.262158 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2852/5705] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:13.488574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:13.586123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invalidating the token cache because user 5e988fe1a8a64a979f2d44672c80a790 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:13.587813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:13.589017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8f9df3f1-e7bb-451d-876c-cfcd51d61155 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:13.597538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:13.597999 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2854/5706] 10.222.0.78 () {60 vars in 1243 bytes} [Sun Aug 28 20:16:13 2022] PATCH /identity/v3/users/5e988fe1a8a64a979f2d44672c80a790 => generated 296 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:16:13.617028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb5bc-3987-42d0-9635-2eed19bedc77 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:13.625031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:13.627579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:13.628020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:13.628442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/5e988fe1a8a64a979f2d44672c80a790` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:13.655797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:update_user(user_id=5e988fe1a8a64a979f2d44672c80a790)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:13.656858 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:16:13.656858 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:16:13.656858 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:16:13.659280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:13.787098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.043596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invalidating the token cache because user 5e988fe1a8a64a979f2d44672c80a790 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:14.044130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.045342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.047450 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2853/5707] 10.222.0.78 () {60 vars in 1243 bytes} [Sun Aug 28 20:16:13 2022] PATCH /identity/v3/users/5e988fe1a8a64a979f2d44672c80a790 => generated 296 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:16:14.052998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.053309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.054013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.078657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:14.081208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.091993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] MFA Rules not processed for user `5e988fe1a8a64a979f2d44672c80a790`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:14.093641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.100593 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2855/5708] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:14 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:14.111702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:14.114520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.155318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808eae-dbe3-4c14-af94-adac79c608bd tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:14.163126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:14.163987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.163987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.164258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] PATH_INFO: `/v3/projects/0a5e890e1c454e02a7c67bddd76f6c38` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.165715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5e890e1c454e02a7c67bddd76f6c38)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:14.166684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe4acd-6a5a-41c6-a405-01f44c45134a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:14.168142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:14.188338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:14.189422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.190208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.190656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/5e988fe1a8a64a979f2d44672c80a790` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.196399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:update_user(user_id=5e988fe1a8a64a979f2d44672c80a790)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:14.201029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:14.367991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.379153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5e890e1c454e02a7c67bddd76f6c38', 'request_id': 'req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.388237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5e890e1c454e02a7c67bddd76f6c38', 'request_id': 'req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.402026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5e890e1c454e02a7c67bddd76f6c38', 'request_id': 'req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.553453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invalidating the token cache because user 5e988fe1a8a64a979f2d44672c80a790 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:14.554169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.554980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.556873 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2856/5709] 10.222.0.78 () {60 vars in 1243 bytes} [Sun Aug 28 20:16:14 2022] PATCH /identity/v3/users/5e988fe1a8a64a979f2d44672c80a790 => generated 296 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:14.562095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:14.563953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.578380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8383b-fabe-4601-9961-13960f08b3f2 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:14.605076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:14.644978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:14.645639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.645940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.646223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.646873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:14.648746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:14.765727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] The token cache is being invalidate because project 0a5e890e1c454e02a7c67bddd76f6c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:14.766242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.767452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5c24aa8a-873d-4f4d-8b3c-17f406ca8ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:14.772618 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2854/5710] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:14 2022] DELETE /identity/v3/projects/0a5e890e1c454e02a7c67bddd76f6c38 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:14.774838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca9516-a807-423e-b85a-b3b10c62f295 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.775179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca9516-a807-423e-b85a-b3b10c62f295 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.775691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca9516-a807-423e-b85a-b3b10c62f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.831440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3aca9516-a807-423e-b85a-b3b10c62f295 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:14.832769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3aca9516-a807-423e-b85a-b3b10c62f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.891824 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2857/5711] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:16:14 2022] POST /identity/v3/users => generated 264 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:16:14.893211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:14.895357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.911865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cea081-7349-4e60-b87c-2b897b116401 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:14.917908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:14.919023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.919478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.919917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/144d15bc4fa14480ae33e6bc25023a88/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.929053 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2855/5712] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:14.938924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:14.939911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:14.940724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:14.967398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:14.969276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:14.984284 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2856/5713] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:14.993669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:15.017456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ec7e-6631-4e70-9918-80198f11d66c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:15.026293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:15.026293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.026293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.026293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.026910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:15.026910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:15.029898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:15.048302 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2857/5714] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:15.054499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:15.068675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a263d9-2472-485a-8a95-c414cf2f8894 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:15.077674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:15.078832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.079658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.079969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.080685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:15.084113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:15.129966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '144d15bc4fa14480ae33e6bc25023a88'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:15.281438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2858/5715] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:15 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:15.288380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:15.326020 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2858/5716] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:14 2022] POST /identity/v3/users/144d15bc4fa14480ae33e6bc25023a88/password => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:15.392393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db15b-c4ea-4a3a-9a30-fa616fd62137 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:15.422025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:15.422025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.422025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.422025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.422350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:15.422350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:15.538099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:15.538231 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2859/5717] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:15 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:15.553877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af98e-4242-4aa8-8557-b85d12854d00 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:15.563713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:15.565470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.570375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.570672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.571721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:15.574542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:15.594128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2859/5718] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:15.595929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:15.607716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0e68-6031-4d27-8287-bd5b54aec107 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:15.612983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407903-67da-42f2-bb9f-9d24c89b06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:15.613620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407903-67da-42f2-bb9f-9d24c89b06e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.613955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407903-67da-42f2-bb9f-9d24c89b06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.614236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407903-67da-42f2-bb9f-9d24c89b06e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.615052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407903-67da-42f2-bb9f-9d24c89b06e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:15.616679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407903-67da-42f2-bb9f-9d24c89b06e6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:15.629337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2860/5719] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:15.633897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:15.653324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae894f7-48a9-420e-b80a-878b48f61eb6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:15.676612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:15.676612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.676612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.676612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] PATH_INFO: `/v3/projects/2c4b8bcf71954baead4b01629954b63a/users/8885c36da72f422eb7811c26e09a8910/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.677178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:15.682612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4b8bcf71954baead4b01629954b63a, user_id=8885c36da72f422eb7811c26e09a8910, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:15.685742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:15.843447 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2860/5720] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:15 2022] PUT /identity/v3/projects/2c4b8bcf71954baead4b01629954b63a/users/8885c36da72f422eb7811c26e09a8910/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:15.866377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05aee-0db4-4ee5-93f7-536e49f385af None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:15.866945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05aee-0db4-4ee5-93f7-536e49f385af None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:15.866945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05aee-0db4-4ee5-93f7-536e49f385af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:15.910933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c5d05aee-0db4-4ee5-93f7-536e49f385af None None] MFA Rules not processed for user `8885c36da72f422eb7811c26e09a8910`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:15.913338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c5d05aee-0db4-4ee5-93f7-536e49f385af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:16.034508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2861/5721] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:16.066415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:16.068979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:16.278567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13972f6f-890b-4286-9281-ca2c3ed4c3ac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:16.283711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:16.284470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:16.284840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:16.285177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:16.297076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:16.299935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:16.316967 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2861/5722] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:16.333022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:16.333539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:16.340269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:16.400179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] MFA Rules not processed for user `144d15bc4fa14480ae33e6bc25023a88`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:16.401312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:16.406574 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2862/5723] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:16 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:16.412848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:16.534941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:16.556297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0f60-217c-4dcb-baef-e852433e45ba service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:16.561473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9187c-b35a-4cb8-8686-b2dcf58db7fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:16.562158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9187c-b35a-4cb8-8686-b2dcf58db7fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:16.562496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9187c-b35a-4cb8-8686-b2dcf58db7fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:16.562716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9187c-b35a-4cb8-8686-b2dcf58db7fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:16.572765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9187c-b35a-4cb8-8686-b2dcf58db7fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:16.575301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9187c-b35a-4cb8-8686-b2dcf58db7fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:16.592776 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2862/5724] 10.222.0.78 () {56 vars in 1263 bytes} [Sun Aug 28 20:16:16 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 20:16:16.594125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:16.614472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7fac8-634d-412f-9bb8-b0a623d3a910 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:16.629171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:16.629730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:16.630094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:16.630340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/144d15bc4fa14480ae33e6bc25023a88` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:16.632240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_user(user_id=144d15bc4fa14480ae33e6bc25023a88)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:16.634294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:16.775784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:16.831360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144d15bc4fa14480ae33e6bc25023a88'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:16.853305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144d15bc4fa14480ae33e6bc25023a88'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:16.866151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144d15bc4fa14480ae33e6bc25023a88'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:16.867098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144d15bc4fa14480ae33e6bc25023a88'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:16.868296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144d15bc4fa14480ae33e6bc25023a88'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:17.024482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:17.024985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:17.029014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:17.055563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:17.056809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:17.122554 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2863/5725] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:17.136772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:17.138409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:17.149927 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2863/5726] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:16 2022] DELETE /identity/v3/users/144d15bc4fa14480ae33e6bc25023a88 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:17.156644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:17.158931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:17.289271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258360-b28e-41bc-a202-68d784f8255e tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:17.302517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:17.303562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:17.304017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:17.304930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:17.305898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:17.309112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:17.316603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f1ed9-4a0d-4ed0-8c34-a89a462adf9e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:17.439603 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2864/5727] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:17 2022] POST /identity/v3/users => generated 364 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:17.444066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:17.477081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08d22-e310-4c86-a9a2-d25538f7b8fc tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:17.502740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:17.504967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:17.506077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:17.507086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:17.511282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:17.517834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:17.580491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:17.585438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:17.585438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:17.585438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:17.688596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:17.690856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:17.701592 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2864/5728] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:16:17.745198 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2865/5729] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:17 2022] POST /identity/v3/projects => generated 360 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:17.749832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:17.763424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0fe9e-6e0b-499a-b987-3cf914e90012 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:17.851198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:17.852268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:17.852569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:17.852910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/b4aefd0703034f3d8ff81e4c3f70dd87` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:17.875766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:update_user(user_id=b4aefd0703034f3d8ff81e4c3f70dd87)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:17.878085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:18.088798 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2865/5730] 10.222.0.78 () {60 vars in 1244 bytes} [Sun Aug 28 20:16:17 2022] PATCH /identity/v3/users/b4aefd0703034f3d8ff81e4c3f70dd87 => generated 522 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:18.093500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:18.102041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:18.121882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80de07-fbcd-4d61-9673-151a3cd2c795 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:18.138341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:18.139310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:18.139763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:18.140189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/b4aefd0703034f3d8ff81e4c3f70dd87` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:18.232038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:get_user(user_id=b4aefd0703034f3d8ff81e4c3f70dd87)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:18.248136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:18.250133 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2866/5731] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:16:18 2022] GET /identity/v3/users/b4aefd0703034f3d8ff81e4c3f70dd87 => generated 389 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:16:18.255951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:18.276780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ef580-5b1d-4e0d-a839-f79dedd28cc8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:18.293798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:18.295007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:18.295575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:18.296014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/projects/6711ea301186420b9ae8746a143365cd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:18.298131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6711ea301186420b9ae8746a143365cd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:18.302780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:18.381399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:18.533541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6711ea301186420b9ae8746a143365cd', 'request_id': 'req-2dcd2809-9a26-4321-9e66-e1f386a26927'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:18.550563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6711ea301186420b9ae8746a143365cd', 'request_id': 'req-2dcd2809-9a26-4321-9e66-e1f386a26927'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:18.582154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6711ea301186420b9ae8746a143365cd', 'request_id': 'req-2dcd2809-9a26-4321-9e66-e1f386a26927'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:18.744204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] The token cache is being invalidate because project 6711ea301186420b9ae8746a143365cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:18.744648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:18.752920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:18.752920 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2866/5732] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:18 2022] DELETE /identity/v3/projects/6711ea301186420b9ae8746a143365cd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:18.753136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:18.754890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:18.771593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975eb6f9-aea3-469a-990e-87664badcb19 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:18.879477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c5224a11b404bcd9b76c557f2a8fb16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:18.880220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:18.880576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:18.880925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] PATH_INFO: `/v3/users/b4aefd0703034f3d8ff81e4c3f70dd87` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:18.882734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b4aefd0703034f3d8ff81e4c3f70dd87)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:18.885070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:19.070346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:19.072110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:19.100379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4aefd0703034f3d8ff81e4c3f70dd87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:19.115260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4aefd0703034f3d8ff81e4c3f70dd87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:19.123524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4aefd0703034f3d8ff81e4c3f70dd87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:19.124515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4aefd0703034f3d8ff81e4c3f70dd87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:19.125492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4aefd0703034f3d8ff81e4c3f70dd87'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:19.183843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd2809-9a26-4321-9e66-e1f386a26927 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:19.189735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:19.190552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:19.190839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:19.203374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:19.211844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:19.305013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:19.306535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fe3d-e218-4eda-a5a7-d94b602b7821 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:19.321580 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2867/5733] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:19.323171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:19.323649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:19.324740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:19.333512 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2867/5734] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:18 2022] DELETE /identity/v3/users/b4aefd0703034f3d8ff81e4c3f70dd87 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:19.346801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:19.348726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:19.363635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:19.364838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:19.450947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2868/5735] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:19.464867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:19.466668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:19.531281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd184e-6930-4fbb-b6e6-cc3a278206d8 tempest-UsersV3TestJSON-320505433 tempest-UsersV3TestJSON-320505433-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:19.551809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:19.565950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:19.569008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:19.572510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] PATH_INFO: `/v3/users/5e988fe1a8a64a979f2d44672c80a790` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:19.633796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e988fe1a8a64a979f2d44672c80a790)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:19.636744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:19.637408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c0fdd-da77-4e5b-941d-d98c3d1e1a47 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:19.656536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45009-aca5-4fce-b6a1-c5273e367380 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:19.656536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45009-aca5-4fce-b6a1-c5273e367380 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:19.656536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45009-aca5-4fce-b6a1-c5273e367380 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:19.656536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45009-aca5-4fce-b6a1-c5273e367380 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:19.675528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45009-aca5-4fce-b6a1-c5273e367380 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:19.691646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45009-aca5-4fce-b6a1-c5273e367380 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:19.721915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2869/5736] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:19.877000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:20.086423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:20.132400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:20.156447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:20.158816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:20.161458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e988fe1a8a64a979f2d44672c80a790'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:20.324839 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2868/5737] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:19 2022] DELETE /identity/v3/users/5e988fe1a8a64a979f2d44672c80a790 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:16:20.329325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad39e20-5c68-4cef-bc82-c0c0049246ca None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:20.330915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad39e20-5c68-4cef-bc82-c0c0049246ca None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:20.331316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad39e20-5c68-4cef-bc82-c0c0049246ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:20.436910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cad39e20-5c68-4cef-bc82-c0c0049246ca None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:20.441865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cad39e20-5c68-4cef-bc82-c0c0049246ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:20.610299 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2870/5738] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:20.621393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:20.623170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:20.771794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dd96d-600e-43c8-9c64-cbfef50055f2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:20.779690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:20.779690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:20.779690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:20.779690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:20.792884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:20.796512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:20.813273 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2869/5739] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:21.185296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:21.186337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:21.186777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:21.222658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:21.224218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:21.382458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2871/5740] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:21.397774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:21.399915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:21.572148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:21.621088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab70a85-45f5-4cdd-b52c-d60b1354cf63 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:21.634049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:21.634783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:21.635145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:21.635564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:21.657754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:21.657754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:21.667153 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2870/5741] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:21.790237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:21.792614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:21.824162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b9044-0bab-4f1e-ac3d-0c17e222603d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:21.857081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:21.858082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:21.859085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:21.860290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] PATH_INFO: `/v3/projects/3d9be8fc40f441608bc9e796560c3818` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:21.862793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9be8fc40f441608bc9e796560c3818)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:21.865091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:22.112742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9be8fc40f441608bc9e796560c3818', 'request_id': 'req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.121495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9be8fc40f441608bc9e796560c3818', 'request_id': 'req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.131343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9be8fc40f441608bc9e796560c3818', 'request_id': 'req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.276141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] The token cache is being invalidate because project 3d9be8fc40f441608bc9e796560c3818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:22.277428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.279343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a2ea55c-7c15-4018-b852-a7c1b8f55c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.281024 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2872/5742] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:21 2022] DELETE /identity/v3/projects/3d9be8fc40f441608bc9e796560c3818 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:16:22.285931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:22.307542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9b53d-abaa-48d3-919e-9ac2cf26da6a service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:22.498042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:22.500202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:22.503405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:22.504576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] PATH_INFO: `/v3/users/c927bd9cfa2b4eafa8cf0b0ae0c71a37` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:22.507681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c927bd9cfa2b4eafa8cf0b0ae0c71a37)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:22.514894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:22.887833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.912537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.923213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.925605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.926505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c927bd9cfa2b4eafa8cf0b0ae0c71a37'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:22.988581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:23.072330 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2871/5743] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:22 2022] DELETE /identity/v3/users/c927bd9cfa2b4eafa8cf0b0ae0c71a37 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:23.213458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:23.213744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:23.214058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:23.244229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:23.246601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:23.382853 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2873/5744] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:23.383499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:23.385053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:23.460344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:23.623292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb50fd-7e18-46af-b288-22ffbb70aeac admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:23.628936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac856-f516-44b7-bec1-9f5f1a0ec7d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:23.629672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac856-f516-44b7-bec1-9f5f1a0ec7d9 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:23.630050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac856-f516-44b7-bec1-9f5f1a0ec7d9 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:23.630553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac856-f516-44b7-bec1-9f5f1a0ec7d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:23.640622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac856-f516-44b7-bec1-9f5f1a0ec7d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:23.646777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac856-f516-44b7-bec1-9f5f1a0ec7d9 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:23.655623 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2872/5745] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:16:23.726897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:23.727372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:23.839136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f198985-f9fb-4153-bb6d-1494ec328e49 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:23.841231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:23.841966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:23.842255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:23.842534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] PATH_INFO: `/v3/projects/2c5224a11b404bcd9b76c557f2a8fb16` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:23.844328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5224a11b404bcd9b76c557f2a8fb16)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:23.847644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:24.006086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5224a11b404bcd9b76c557f2a8fb16', 'request_id': 'req-ab815198-0bae-46be-aed3-a77bf9fc68ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.020094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5224a11b404bcd9b76c557f2a8fb16', 'request_id': 'req-ab815198-0bae-46be-aed3-a77bf9fc68ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.028507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5224a11b404bcd9b76c557f2a8fb16', 'request_id': 'req-ab815198-0bae-46be-aed3-a77bf9fc68ee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.086014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:24.134684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] The token cache is being invalidate because project 2c5224a11b404bcd9b76c557f2a8fb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:24.142818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.142818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab815198-0bae-46be-aed3-a77bf9fc68ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.143559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2874/5746] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:23 2022] DELETE /identity/v3/projects/2c5224a11b404bcd9b76c557f2a8fb16 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:24.144725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:24.145022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:24.145300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:24.209310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:24.210636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:24.371738 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2873/5747] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:24.383476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:24.386744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:24.386744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:24.419200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:24.424493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:24.463764 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2875/5748] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:24.470201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:24.485989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22b0fd-8995-4690-9e1c-2b277aacead2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:24.493058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:24.493820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:24.494713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:24.494989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:24.496388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:24.496702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:24.498386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:24.527516 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2874/5749] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:24.536606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:24.547494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8d6b6-5e6b-4c9b-a4d0-1b90fb3476ca None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:24.556707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:24.557028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:24.557361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:24.557731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:24.558533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:24.560545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:24.619313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:24.621107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:24.638233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f8ee4-45a1-4fd1-99aa-05c6cf0159fc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:24.644935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:24.645654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:24.647320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:24.647320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] PATH_INFO: `/v3/users/d23a58ff5fab414baaa806e75bde45e1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:24.647511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23a58ff5fab414baaa806e75bde45e1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:24.649999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:24.746074 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2876/5750] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:24 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:24.752498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:24.894512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23a58ff5fab414baaa806e75bde45e1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.906533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615cfa6-a573-48ca-a3aa-a7e5d1f2041d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:24.919481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23a58ff5fab414baaa806e75bde45e1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:24.920335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.135742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.135742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.135742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.135742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:25.135742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:25.136882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23a58ff5fab414baaa806e75bde45e1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:25.136882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23a58ff5fab414baaa806e75bde45e1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:25.136882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0fbf8503-c62d-40e2-a7d9-b1eb98e6e3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23a58ff5fab414baaa806e75bde45e1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:25.158014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:25.174182 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2875/5751] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:24 2022] DELETE /identity/v3/users/d23a58ff5fab414baaa806e75bde45e1 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:25.178941 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2877/5752] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:24 2022] POST /identity/v3/users => generated 284 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:25.179564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0027d-4b3c-4aef-99f3-5bd722ba36a4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.181209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.181758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0027d-4b3c-4aef-99f3-5bd722ba36a4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.182384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0027d-4b3c-4aef-99f3-5bd722ba36a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.186259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:25.208443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e2c0027d-4b3c-4aef-99f3-5bd722ba36a4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:25.210097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e2c0027d-4b3c-4aef-99f3-5bd722ba36a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:25.227183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7b49-c68f-4dea-9e4f-c9941c9b7c73 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:25.320119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.320749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.321027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.321300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.321985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:25.324867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:25.329266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:25.338393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2876/5753] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:25.339725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.340081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.340423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.344203 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2878/5754] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:25.359838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.374116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45b181-ca5c-42f7-b9d7-c1cce0eca16c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:25.381382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.382114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.382349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:25.382533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.382881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.383607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:25.384238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:25.385577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:25.403740 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2879/5755] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:25.404964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.407897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:25.482039 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2877/5756] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:25.482039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.482039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3088cc-a186-4024-9c12-5bf071c77201 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:25.482039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e92bb-c09e-4f8c-b2f0-ea3bc04236f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.484294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e92bb-c09e-4f8c-b2f0-ea3bc04236f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.484744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e92bb-c09e-4f8c-b2f0-ea3bc04236f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.485269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e92bb-c09e-4f8c-b2f0-ea3bc04236f3 admin admin] PATH_INFO: `/v3/projects/6c552ef337c943bcaa9fb6d3dd544b06/users/b961f0bbd8cc4330a57c9fdea195e850/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.504319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e92bb-c09e-4f8c-b2f0-ea3bc04236f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c552ef337c943bcaa9fb6d3dd544b06, user_id=b961f0bbd8cc4330a57c9fdea195e850, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:25.516446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e3ed3-7a5b-438a-bd17-3cd3f5b028b7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:25.516446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.516446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.517004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e92bb-c09e-4f8c-b2f0-ea3bc04236f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:25.517109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.517109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.520756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:25.522250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:25.533956 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2880/5757] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:25.534360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.536261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:25.635892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de881b-e3f1-457a-9eb2-bdd86602a411 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:25.653940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2878/5758] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:25 2022] PUT /identity/v3/projects/6c552ef337c943bcaa9fb6d3dd544b06/users/b961f0bbd8cc4330a57c9fdea195e850/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:25.664526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.667340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.667340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.702795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accde99-757a-485c-8102-32d94d235fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.704019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accde99-757a-485c-8102-32d94d235fec service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.704322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accde99-757a-485c-8102-32d94d235fec service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.707366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accde99-757a-485c-8102-32d94d235fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.742004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accde99-757a-485c-8102-32d94d235fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:25.743782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accde99-757a-485c-8102-32d94d235fec service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:25.758478 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2881/5759] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:25.779161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] MFA Rules not processed for user `b961f0bbd8cc4330a57c9fdea195e850`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:25.780775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:25.865683 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2879/5760] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:25.879632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accde99-757a-485c-8102-32d94d235fec service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.972490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accde99-757a-485c-8102-32d94d235fec service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:25.977287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30f31-ef62-423f-88ef-cb491874c829 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b961f0bbd8cc4330a57c9fdea195e850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c552ef337c943bcaa9fb6d3dd544b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:25.977926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30f31-ef62-423f-88ef-cb491874c829 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:25.978219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30f31-ef62-423f-88ef-cb491874c829 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:25.978605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30f31-ef62-423f-88ef-cb491874c829 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] PATH_INFO: `/v3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:25.979924 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2882/5761] 10.222.0.78 () {58 vars in 1104 bytes} [Sun Aug 28 20:16:25 2022] GET /identity/v3 => generated 255 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:25.985038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:25.997739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc6cde-e23f-4da8-ab40-2d125e0979d0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:26.003079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592358d-549b-4a7a-911a-2d70aea2c429 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b961f0bbd8cc4330a57c9fdea195e850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c552ef337c943bcaa9fb6d3dd544b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:26.003684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592358d-549b-4a7a-911a-2d70aea2c429 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.003967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592358d-549b-4a7a-911a-2d70aea2c429 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.004244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592358d-549b-4a7a-911a-2d70aea2c429 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] PATH_INFO: `/v3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.005697 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2880/5762] 10.222.0.78 () {58 vars in 1104 bytes} [Sun Aug 28 20:16:25 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:26.010621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30f31-ef62-423f-88ef-cb491874c829 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:26.020323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30f31-ef62-423f-88ef-cb491874c829 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:26.034633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2aef-1b26-4437-a695-28ad028206f7 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b961f0bbd8cc4330a57c9fdea195e850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c552ef337c943bcaa9fb6d3dd544b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:26.034633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2aef-1b26-4437-a695-28ad028206f7 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.034633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2aef-1b26-4437-a695-28ad028206f7 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.035713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2aef-1b26-4437-a695-28ad028206f7 tempest-TestApiDiscovery-846113118 tempest-TestApiDiscovery-846113118-project] PATH_INFO: `/v3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.035713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2883/5763] 10.222.0.78 () {58 vars in 1104 bytes} [Sun Aug 28 20:16:26 2022] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:26.040047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd48a-8dfd-4d3b-b818-f29ccaf6bd24 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.040332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd48a-8dfd-4d3b-b818-f29ccaf6bd24 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.040611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd48a-8dfd-4d3b-b818-f29ccaf6bd24 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.042319 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2881/5764] 10.222.0.78 () {56 vars in 895 bytes} [Sun Aug 28 20:16:26 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:16:26.047460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fffb71-f65c-4d66-891a-faf90a38701a None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.047745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fffb71-f65c-4d66-891a-faf90a38701a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.048024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fffb71-f65c-4d66-891a-faf90a38701a None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.050462 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2884/5765] 10.222.0.78 () {56 vars in 895 bytes} [Sun Aug 28 20:16:26 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:16:26.063963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd48a-8dfd-4d3b-b818-f29ccaf6bd24 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:26.065945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fffb71-f65c-4d66-891a-faf90a38701a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:26.068436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-63fffb71-f65c-4d66-891a-faf90a38701a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:26.142363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd48a-8dfd-4d3b-b818-f29ccaf6bd24 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:26.147185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:26.147747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.148025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.148296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] PATH_INFO: `/v3/users/b961f0bbd8cc4330a57c9fdea195e850` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.149501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b961f0bbd8cc4330a57c9fdea195e850)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:26.151441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:26.163735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fffb71-f65c-4d66-891a-faf90a38701a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:26.169163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:26.169808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.170162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.171127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] PATH_INFO: `/v3/projects/2d74cb7a06e542488ed82bce56a844d5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.171583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d74cb7a06e542488ed82bce56a844d5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:26.173606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:26.490017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b961f0bbd8cc4330a57c9fdea195e850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.503783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b961f0bbd8cc4330a57c9fdea195e850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.505589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d74cb7a06e542488ed82bce56a844d5', 'request_id': 'req-8671d577-7261-466b-bce4-659ec8f10ba3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.513152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b961f0bbd8cc4330a57c9fdea195e850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.515318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b961f0bbd8cc4330a57c9fdea195e850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.515945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d74cb7a06e542488ed82bce56a844d5', 'request_id': 'req-8671d577-7261-466b-bce4-659ec8f10ba3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.516415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d00b94c-5d21-477b-80eb-924f3f32c791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b961f0bbd8cc4330a57c9fdea195e850'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.525128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d74cb7a06e542488ed82bce56a844d5', 'request_id': 'req-8671d577-7261-466b-bce4-659ec8f10ba3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.660837 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2882/5766] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:26 2022] DELETE /identity/v3/users/b961f0bbd8cc4330a57c9fdea195e850 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:26.665470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.665765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.666161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.688351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:26.689471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:26.767270 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2883/5767] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:26.774270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:26.777888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:26.779663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:26.781979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] The token cache is being invalidate because project 2d74cb7a06e542488ed82bce56a844d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:26.782466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.783806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8671d577-7261-466b-bce4-659ec8f10ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:26.788880 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2885/5768] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:26 2022] DELETE /identity/v3/projects/2d74cb7a06e542488ed82bce56a844d5 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:26.794069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6356-1aa0-489d-acbe-27de30f9f672 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.794359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6356-1aa0-489d-acbe-27de30f9f672 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.794639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6356-1aa0-489d-acbe-27de30f9f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.816941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-374b6356-1aa0-489d-acbe-27de30f9f672 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:26.819230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-374b6356-1aa0-489d-acbe-27de30f9f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:26.836778 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2886/5769] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:26.841817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.842272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.842678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.853198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca165d-fb71-4d64-b1db-4cdc2a0053e3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:26.857056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:26.857672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.857999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.858273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.860432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:26.883757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:26.885127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:26.886315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:26.887160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:26.906632 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2884/5770] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:16:26.910993 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2887/5771] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:26.914154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:26.944209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66732e4-f69e-4514-9e04-769cca1756ac service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:26.951549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:26.952842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:26.953191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:26.953528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:26.954305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:26.954723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:26.958539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.006931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.019194 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2885/5772] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:27.021398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72442a-bf44-4a85-994f-9830f8904947 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.027370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235f3fc-d885-4717-a73d-8aef66e6f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.028125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f3fc-d885-4717-a73d-8aef66e6f5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.028699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f3fc-d885-4717-a73d-8aef66e6f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.029495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f3fc-d885-4717-a73d-8aef66e6f5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.031700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235f3fc-d885-4717-a73d-8aef66e6f5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.034585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235f3fc-d885-4717-a73d-8aef66e6f5f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.222057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:27.231636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2888/5773] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:27 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:27.236245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.251792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcef025-d0c5-4ad5-9509-fb10f4e37403 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.303088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.303386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.303698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.343063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:27.344380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:27.353071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.353758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.354059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.354330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.354984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.357658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.451515 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2889/5774] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:27.463720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.465935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:27.519944 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2886/5775] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:27 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:16:27.531849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.547025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a89a-b8f5-4417-9c78-69b3701f196f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.569213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.570270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.570782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.571259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.572137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.574489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.602845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2887/5776] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:16:27.607533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.620455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647bd09-2d2f-4954-bbb1-1b7874c63185 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.625294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c37f02-05fd-447a-933e-ef80acf8fa63 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.626668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.627617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.627972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.628322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.629057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.631048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.636057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.636057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.636057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.636057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.642853 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2888/5777] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:16:27.645146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.646802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.647787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.656673 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2890/5778] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:27.660869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2203-a7ab-4761-b25b-f66c9b5f6bab admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.666045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181aefb-5a85-4a3f-8eb1-e7cce0ca9d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.667030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181aefb-5a85-4a3f-8eb1-e7cce0ca9d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.667341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181aefb-5a85-4a3f-8eb1-e7cce0ca9d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.667631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181aefb-5a85-4a3f-8eb1-e7cce0ca9d8d admin admin] PATH_INFO: `/v3/projects/7330eace4daf4db0a7cb0c149eb48669/users/d5dd54ded7ec498faceb5c0a0eaa2c94/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.684972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181aefb-5a85-4a3f-8eb1-e7cce0ca9d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7330eace4daf4db0a7cb0c149eb48669, user_id=d5dd54ded7ec498faceb5c0a0eaa2c94, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.688005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181aefb-5a85-4a3f-8eb1-e7cce0ca9d8d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.932337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:27.934068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:27.950596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672365b1-4d8b-440d-9745-ce6191954a5d service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:27.957091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:27.957687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:27.958285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:27.959268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] PATH_INFO: `/v3/projects/6c552ef337c943bcaa9fb6d3dd544b06` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:27.960879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c552ef337c943bcaa9fb6d3dd544b06)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:27.962861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:27.993737 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2889/5779] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:27 2022] PUT /identity/v3/projects/7330eace4daf4db0a7cb0c149eb48669/users/d5dd54ded7ec498faceb5c0a0eaa2c94/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:28.005172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:28.005457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:28.005728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:28.044733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] MFA Rules not processed for user `d5dd54ded7ec498faceb5c0a0eaa2c94`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:28.044733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:28.137596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2890/5780] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:28.144256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:28.145728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:28.215290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933c76f-b4d5-4727-ae16-b138fa1065fa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:28.219379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0679d-e28d-4bff-810e-3c21bb234962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:28.220014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0679d-e28d-4bff-810e-3c21bb234962 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:28.220299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0679d-e28d-4bff-810e-3c21bb234962 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:28.220569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0679d-e28d-4bff-810e-3c21bb234962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:28.231923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0679d-e28d-4bff-810e-3c21bb234962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:28.233411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0679d-e28d-4bff-810e-3c21bb234962 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:28.246041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2891/5781] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:16:28.392404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c552ef337c943bcaa9fb6d3dd544b06', 'request_id': 'req-a797be09-b509-4361-bbba-f7f98291d615'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:28.401920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c552ef337c943bcaa9fb6d3dd544b06', 'request_id': 'req-a797be09-b509-4361-bbba-f7f98291d615'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:28.415870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c552ef337c943bcaa9fb6d3dd544b06', 'request_id': 'req-a797be09-b509-4361-bbba-f7f98291d615'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:28.546520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] The token cache is being invalidate because project 6c552ef337c943bcaa9fb6d3dd544b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:28.546990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:28.547792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a797be09-b509-4361-bbba-f7f98291d615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:28.552616 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2891/5782] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:27 2022] DELETE /identity/v3/projects/6c552ef337c943bcaa9fb6d3dd544b06 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:28.560268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:28.561176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:28.561693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:28.592433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:28.597586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:28.598909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:28.698085 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2892/5783] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:28.718219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:28.719194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:28.719557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:28.746276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:28.747522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:28.756743 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2892/5784] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:28.760935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:28.772109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783e68-a902-4d4b-a906-ec630711f777 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:28.779322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:28.799932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:28.799932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:28.799932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:28.799932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:28.799932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:28.799932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:28.800973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2893/5785] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:28.803515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:28.813822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6976b-64c4-4f5c-887f-609a21a504dc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:28.819400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:28.820027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:28.820312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:28.820590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:28.821238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:28.823520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:28.980529 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2893/5786] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:28 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:28.984585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:28.997681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cffdcc-ced9-47c1-8248-63b451d1785f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:29.133523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:29.139184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:29.139184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:29.139184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:29.139184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:29.139184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:29.192020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:29.255415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2894/5787] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:28 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:29.257641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:29.276288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153661-a7ae-4232-8375-76e455db04e2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:29.297491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:29.298922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:29.299367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:29.300007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:29.300837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:29.302919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:29.326486 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2894/5788] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:16:29.327714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:29.343809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698720e-45e2-47a3-8df8-f64f4c01c2d2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:29.358319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8cd5-58b9-4e7f-9a92-f4b9fcbf5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:29.358957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8cd5-58b9-4e7f-9a92-f4b9fcbf5f83 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:29.359299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8cd5-58b9-4e7f-9a92-f4b9fcbf5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:29.359577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8cd5-58b9-4e7f-9a92-f4b9fcbf5f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:29.360285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a8cd5-58b9-4e7f-9a92-f4b9fcbf5f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:29.364158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a8cd5-58b9-4e7f-9a92-f4b9fcbf5f83 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:29.395232 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2895/5789] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:29.399911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:29.411079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905274-3081-4e2d-8862-02c4bcb0c6ab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:29.416091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:29.417311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:29.417752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:29.418249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] PATH_INFO: `/v3/projects/6a9d385853a84022984423b141adcb68/users/e88aa16b34a74af0b243eca60f80cc83/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:29.436409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9d385853a84022984423b141adcb68, user_id=e88aa16b34a74af0b243eca60f80cc83, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:29.439155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:29.596517 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2895/5790] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:29 2022] PUT /identity/v3/projects/6a9d385853a84022984423b141adcb68/users/e88aa16b34a74af0b243eca60f80cc83/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:29.621200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19dc92-9c90-4604-9547-a13377ab054c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:29.621488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19dc92-9c90-4604-9547-a13377ab054c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:29.621765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19dc92-9c90-4604-9547-a13377ab054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:29.723635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bd19dc92-9c90-4604-9547-a13377ab054c None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:29.729924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bd19dc92-9c90-4604-9547-a13377ab054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:29.958143 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2896/5791] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:29.963015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:29.979298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b10e9e-b7ad-4a69-868f-0ae1f39a8f2c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:29.992620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:29.994606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:29.995583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:29.996012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:30.185674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:30.210140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:30.272117 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2896/5792] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:29 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:30.400108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e248b8-705d-4b24-8605-7d5bbec7cb28 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:30.401532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e248b8-705d-4b24-8605-7d5bbec7cb28 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:30.402058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e248b8-705d-4b24-8605-7d5bbec7cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:30.450408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-60e248b8-705d-4b24-8605-7d5bbec7cb28 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:30.450408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-60e248b8-705d-4b24-8605-7d5bbec7cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:30.536080 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2897/5793] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:30.552341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:30.554434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:30.663092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fae674-f76c-4d9c-a673-64089b2973f6 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:30.667511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:30.672468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2734d7-9986-44d4-b4cd-157cb5c33317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:30.673109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2734d7-9986-44d4-b4cd-157cb5c33317 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:30.673393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2734d7-9986-44d4-b4cd-157cb5c33317 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:30.673698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2734d7-9986-44d4-b4cd-157cb5c33317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:30.684800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2734d7-9986-44d4-b4cd-157cb5c33317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:30.687103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2734d7-9986-44d4-b4cd-157cb5c33317 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:30.698469 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2897/5794] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:31.194545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:31.278343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.279770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.280364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.332216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:31.332216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:31.337177 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2898/5795] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:31 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:31.339058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.339633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.340019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.368687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:31.370467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:31.388029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2898/5796] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:31.393618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:31.412095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea2db-6102-4dc0-8d89-857f6f8add72 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:31.418178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df2dd-eff6-4cbd-ab10-9ff8b88174e2 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:31.420114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df2dd-eff6-4cbd-ab10-9ff8b88174e2 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.420855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df2dd-eff6-4cbd-ab10-9ff8b88174e2 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.421298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df2dd-eff6-4cbd-ab10-9ff8b88174e2 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-555df2dd-eff6-4cbd-ab10-9ff8b88174e2 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:16:31.494348 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 20:16:31.495555 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:16:31.502670 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2899/5797] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:31 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 188 bytes in 106 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:16:31.504455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:31.530897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fad92-849e-49bd-bb4b-fbdd0167550d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:31.552853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:31.554695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.555298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.556223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.598085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.598085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.598085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:16:31.662182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 20:16:31.663182 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:16:31.666248 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2899/5798] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:31 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 188 bytes in 162 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 20:16:31.672179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:31.683365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c6d97-61cf-4527-b4e6-0a3976666817 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:31.688346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:31.689952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.690482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.690975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.699332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:31.704851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:31.738796 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2900/5799] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:31.757711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:31.780462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8ac6-7009-4a93-a8ce-d726fb5d22da None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:31.788775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94052c-bb3e-4923-82b1-4362bc0564de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:31.789753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94052c-bb3e-4923-82b1-4362bc0564de service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:31.790566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94052c-bb3e-4923-82b1-4362bc0564de service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:31.791079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94052c-bb3e-4923-82b1-4362bc0564de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:31.819740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:31.838536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94052c-bb3e-4923-82b1-4362bc0564de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:31.840652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94052c-bb3e-4923-82b1-4362bc0564de service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:31.891951 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2901/5800] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:31.942724 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2900/5801] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:31 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:32.346501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:32.471198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:32.493180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ee48-84e9-4d47-8730-ea5205895c03 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:32.496774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ee48-84e9-4d47-8730-ea5205895c03 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:32.496774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ee48-84e9-4d47-8730-ea5205895c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:32.536528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4c76ee48-84e9-4d47-8730-ea5205895c03 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:32.542484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4c76ee48-84e9-4d47-8730-ea5205895c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:32.565142 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2902/5802] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:32.581527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:32.601467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e99a8-f273-4aea-9320-2337688501ff tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:32.632911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b31d0-8e95-4327-9473-ec280fcad351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:32.635262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b31d0-8e95-4327-9473-ec280fcad351 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:32.636202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b31d0-8e95-4327-9473-ec280fcad351 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:32.640532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b31d0-8e95-4327-9473-ec280fcad351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:32.661946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b31d0-8e95-4327-9473-ec280fcad351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:32.704464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b31d0-8e95-4327-9473-ec280fcad351 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:32.740540 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2901/5803] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:32.950211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:32.950211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:32.950211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:32.972442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:32.973577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:32.976969 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2903/5804] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:32.982545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48efdee-b35b-45ab-8a4b-e7b84b55d7f2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:32.982840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48efdee-b35b-45ab-8a4b-e7b84b55d7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:32.983828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48efdee-b35b-45ab-8a4b-e7b84b55d7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:33.011310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a48efdee-b35b-45ab-8a4b-e7b84b55d7f2 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:33.014809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a48efdee-b35b-45ab-8a4b-e7b84b55d7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:33.027701 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2902/5805] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:33.032549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:33.051962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09583-d2b2-4f39-9dd6-05cdecaa2f2e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:33.090100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:33.091408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:33.092287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:33.092788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:33.316924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:33.512880 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2904/5806] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:33 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:33.570814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3b3d-c9c6-43bb-9bf1-e9b8347a2899 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:33.571366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3b3d-c9c6-43bb-9bf1-e9b8347a2899 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:33.571366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3b3d-c9c6-43bb-9bf1-e9b8347a2899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:33.592240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-85cb3b3d-c9c6-43bb-9bf1-e9b8347a2899 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:33.593479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85cb3b3d-c9c6-43bb-9bf1-e9b8347a2899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:33.601147 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2903/5807] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:33.621581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:33.642777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e0b5-2a67-4e32-ad8b-c76e6ea78453 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:33.649542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f772e0-17d5-4e45-8dcd-d543d493a546 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:33.650439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f772e0-17d5-4e45-8dcd-d543d493a546 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:33.650716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f772e0-17d5-4e45-8dcd-d543d493a546 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:33.651156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f772e0-17d5-4e45-8dcd-d543d493a546 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:33.661275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f772e0-17d5-4e45-8dcd-d543d493a546 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:33.662989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f772e0-17d5-4e45-8dcd-d543d493a546 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:33.672962 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2905/5808] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:34.475192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:34.475734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:34.476158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:34.509051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:34.514370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:34.518536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614315-3555-433a-98b7-a849500953e8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:34.519144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614315-3555-433a-98b7-a849500953e8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:34.519264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614315-3555-433a-98b7-a849500953e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:34.553967 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2904/5809] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:34.558011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-00614315-3555-433a-98b7-a849500953e8 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:34.567674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:34.569893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-00614315-3555-433a-98b7-a849500953e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:34.579788 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2906/5810] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 20:16:34.590669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:34.590669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:34.590669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:34.597606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae0642-35c9-41f8-9886-e25016ccb909 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:34.607912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c00e0-46e4-4a97-94d1-60e6eeedb51e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:34.610077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c00e0-46e4-4a97-94d1-60e6eeedb51e service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:34.610404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c00e0-46e4-4a97-94d1-60e6eeedb51e service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:34.610680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c00e0-46e4-4a97-94d1-60e6eeedb51e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:34.630631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:34.633165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:34.633300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c00e0-46e4-4a97-94d1-60e6eeedb51e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:34.640088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c00e0-46e4-4a97-94d1-60e6eeedb51e service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:34.644290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2907/5811] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:34.647909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:34.659918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3660a-4737-432d-8628-f311f79df18d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:34.668092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:34.669188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:34.669763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:34.670267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:34.677709 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2905/5812] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:16:34.831566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:34.963476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:34.966620 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2908/5813] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:34 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:35.040048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:35.380097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395301-b4f4-4ceb-a8ce-c4efe267eea4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:35.380654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395301-b4f4-4ceb-a8ce-c4efe267eea4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:35.381088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395301-b4f4-4ceb-a8ce-c4efe267eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:35.421047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-25395301-b4f4-4ceb-a8ce-c4efe267eea4 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:35.422380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-25395301-b4f4-4ceb-a8ce-c4efe267eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:35.433068 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2906/5814] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:16:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:35.456693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:35.477722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18206-38ff-4500-8aa2-24df5ed339e8 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:35.489398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57779-947f-47ba-8fba-dca50bd2f764 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:35.489398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57779-947f-47ba-8fba-dca50bd2f764 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:35.489398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57779-947f-47ba-8fba-dca50bd2f764 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:35.489766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57779-947f-47ba-8fba-dca50bd2f764 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:35.507969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57779-947f-47ba-8fba-dca50bd2f764 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:35.524100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57779-947f-47ba-8fba-dca50bd2f764 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:35.557932 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2909/5815] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:16:35.974023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:35.974543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:35.974543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:35.995358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:36.011084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:36.011084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2907/5816] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:36.011331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:36.011331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:36.011331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:36.027430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:36.028686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:36.037302 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2910/5817] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:36.042497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:36.055902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6376e-1e35-460c-a0f7-defa1779cb85 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:36.060414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0b50b-bc3e-4298-9806-9c14ab77cc0e tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:36.061064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b50b-bc3e-4298-9806-9c14ab77cc0e tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:36.061351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b50b-bc3e-4298-9806-9c14ab77cc0e tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:36.061627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b50b-bc3e-4298-9806-9c14ab77cc0e tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:36.334041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b5f0b50b-bc3e-4298-9806-9c14ab77cc0e tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:36.404368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:36.406096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:36.455777 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2908/5818] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:36 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:36.540109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f684c-1e26-495a-b761-23b880d84206 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:36.553835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:36.555084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:36.556013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:36.556779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] PATH_INFO: `/v3/users/8885c36da72f422eb7811c26e09a8910` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:36.559121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8885c36da72f422eb7811c26e09a8910)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:36.562984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:37.061058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8885c36da72f422eb7811c26e09a8910'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:37.087700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8885c36da72f422eb7811c26e09a8910'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:37.097042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8885c36da72f422eb7811c26e09a8910'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:37.098074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8885c36da72f422eb7811c26e09a8910'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:37.098872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0d07c2f-0d17-47d6-90f2-acf2ed5e6403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8885c36da72f422eb7811c26e09a8910'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:37.267326 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2911/5819] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:36 2022] DELETE /identity/v3/users/8885c36da72f422eb7811c26e09a8910 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:16:37.267461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:37.267461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:37.267461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:37.321443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:37.324435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:37.461931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:37.462596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:37.463147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:37.472837 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2909/5820] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:37.486086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:37.492318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:37.538611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:37.544401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:37.571516 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2912/5821] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 20:16:37.666789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57a463-4dc1-4323-9bf4-27c64dfcc747 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:37.672115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e08c9-be81-472a-b4ad-9d752daab8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:37.674958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e08c9-be81-472a-b4ad-9d752daab8ea service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:37.674958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e08c9-be81-472a-b4ad-9d752daab8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:37.675307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e08c9-be81-472a-b4ad-9d752daab8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:37.686430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e08c9-be81-472a-b4ad-9d752daab8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:37.688166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e08c9-be81-472a-b4ad-9d752daab8ea service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:37.718135 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2910/5822] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:16:38.296168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:38.434392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:38.436139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:38.488897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef393-fc65-4e6d-be90-d7f6182ab151 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:38.493467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:38.494344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:38.494636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:38.495607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] PATH_INFO: `/v3/projects/2c4b8bcf71954baead4b01629954b63a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:38.497167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4b8bcf71954baead4b01629954b63a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:38.499525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:38.573283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49f141-f890-4f55-8a02-dc6ea568b573 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:38.573638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49f141-f890-4f55-8a02-dc6ea568b573 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:38.574030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49f141-f890-4f55-8a02-dc6ea568b573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:38.645331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bd49f141-f890-4f55-8a02-dc6ea568b573 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:38.647602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bd49f141-f890-4f55-8a02-dc6ea568b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:38.732089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4b8bcf71954baead4b01629954b63a', 'request_id': 'req-4d62009d-56fc-482d-8c95-841f715c8356'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:38.739663 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2911/5823] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:38.748523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a2f4-9bb7-4036-bd3a-46e445aaa4b5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:38.749216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a2f4-9bb7-4036-bd3a-46e445aaa4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:38.749839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a2f4-9bb7-4036-bd3a-46e445aaa4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:38.763839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4b8bcf71954baead4b01629954b63a', 'request_id': 'req-4d62009d-56fc-482d-8c95-841f715c8356'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:38.785442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cb10a2f4-9bb7-4036-bd3a-46e445aaa4b5 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:38.786826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cb10a2f4-9bb7-4036-bd3a-46e445aaa4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:38.788260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4b8bcf71954baead4b01629954b63a', 'request_id': 'req-4d62009d-56fc-482d-8c95-841f715c8356'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:38.797949 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2912/5824] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:38.802924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0abc-ed42-4134-9d51-d92e0cfb36b0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:38.804171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0abc-ed42-4134-9d51-d92e0cfb36b0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:38.804669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0abc-ed42-4134-9d51-d92e0cfb36b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:38.966589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] The token cache is being invalidate because project 2c4b8bcf71954baead4b01629954b63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:38.967422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:38.968732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d62009d-56fc-482d-8c95-841f715c8356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:38.973030 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2913/5825] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:38 2022] DELETE /identity/v3/projects/2c4b8bcf71954baead4b01629954b63a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:38.979052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cb76-6025-4a34-9cb8-10fae6fa4be3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:38.985738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cb76-6025-4a34-9cb8-10fae6fa4be3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:38.986807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cb76-6025-4a34-9cb8-10fae6fa4be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.020224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e700cb76-6025-4a34-9cb8-10fae6fa4be3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:39.021469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e700cb76-6025-4a34-9cb8-10fae6fa4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:39.114351 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.server.flask.application [None req-946a0abc-ed42-4134-9d51-d92e0cfb36b0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 20:16:39.115356 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2913/5826] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 313 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 28 20:16:39.120393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f2e1d-57d9-43a4-9454-65f3fe69105f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.120991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f2e1d-57d9-43a4-9454-65f3fe69105f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.121430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f2e1d-57d9-43a4-9454-65f3fe69105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.181402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:39.201833 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2914/5827] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:39.201833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.201833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.201833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.235098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:39.237035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:39.247101 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2915/5828] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:39.250918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:39.264829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb114-25bd-4640-ace2-65407c763fd7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:39.274811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:39.275996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.276510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.277532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.278965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:39.279726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:39.281954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:39.306673 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2916/5829] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:16:39.307730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:39.333030 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.server.flask.application [None req-942f2e1d-57d9-43a4-9454-65f3fe69105f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 20:16:39.341322 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2914/5830] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 223 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 28 20:16:39.347858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a8907-42b7-4db6-b7a5-44f372e015ae admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:39.352516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72295-1947-47aa-b530-76cf6fe207e5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.353280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72295-1947-47aa-b530-76cf6fe207e5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.353775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72295-1947-47aa-b530-76cf6fe207e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.374613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:39.375253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.375535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.375960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.376669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:39.380704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:39.466906 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.server.flask.application [None req-42e72295-1947-47aa-b530-76cf6fe207e5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 20:16:39.470142 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2915/5831] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 120 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 20:16:39.564609 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2917/5832] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:39 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:39.566157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e72295-1947-47aa-b530-76cf6fe207e5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:39.691257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e72295-1947-47aa-b530-76cf6fe207e5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:39.702878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:39.705414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:39.708649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:39.711771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.714479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.715344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.716260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:39.722644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:39.837180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888a71b-d1fc-4d06-a8b9-2397e3456431 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:39.844007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:39.845265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.845731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.846147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.848926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:39.940454 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2916/5833] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:39 2022] POST /identity/v3/users => generated 292 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:39.941680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:39.966277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a540-dd7f-4dfb-8f09-632b79171b3a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:39.971285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:39.971911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:39.972198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:39.972492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:39.974291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:39.979605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:39.982472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:39.992911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:40.017445 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2918/5834] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:40.028537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:40.034554 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2917/5835] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:40.049778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6fc7-02af-4c4b-b703-c81dcd137272 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:40.057191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07309-31c1-4521-8bd0-8db244b0415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:40.061624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07309-31c1-4521-8bd0-8db244b0415c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:40.062708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07309-31c1-4521-8bd0-8db244b0415c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:40.064550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07309-31c1-4521-8bd0-8db244b0415c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:40.065491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c07309-31c1-4521-8bd0-8db244b0415c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:40.069506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c07309-31c1-4521-8bd0-8db244b0415c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:40.102089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2919/5836] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:40.106622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:40.159193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b31c8-24d4-4850-b672-f7a33f228158 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:40.164732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:40.167573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:40.167573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:40.167573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] PATH_INFO: `/v3/projects/c304ce9703914e75bb19283f045073ad/users/832b308a886243d693a31105c9a1ece1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:40.192525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c304ce9703914e75bb19283f045073ad, user_id=832b308a886243d693a31105c9a1ece1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:40.196444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:40.296763 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2918/5837] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:40 2022] PUT /identity/v3/projects/c304ce9703914e75bb19283f045073ad/users/832b308a886243d693a31105c9a1ece1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:40.309562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:40.309998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:40.310170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:40.399416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] MFA Rules not processed for user `832b308a886243d693a31105c9a1ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:40.400837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:40.563025 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2920/5838] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:40.565147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:40.613286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:40.753699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a830f58-9e1b-4a5c-82f9-d0916ebad3ea admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:40.778072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:40.778819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:40.779110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:40.779395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:40.780107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:40.782157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:40.895257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:41.021194 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2919/5839] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:40 2022] POST /identity/v3/projects => generated 385 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:41.025776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:41.047049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532090-1ef5-4dbb-bc79-da4e38b62bd6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:41.137471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd4585-5ce5-4870-8507-5924df092725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:41.139691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd4585-5ce5-4870-8507-5924df092725 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:41.139691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd4585-5ce5-4870-8507-5924df092725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:41.139691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd4585-5ce5-4870-8507-5924df092725 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:41.160108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd4585-5ce5-4870-8507-5924df092725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:41.160108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd4585-5ce5-4870-8507-5924df092725 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:41.335306 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2921/5840] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:41 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:16:41.335526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:41.343925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a601f6-bc09-4279-b6c6-c6ebab935d07 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:41.360015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:41.360739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:41.361024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:41.361298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:41.362177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:41.364278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:41.384002 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2920/5841] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:41.391902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:41.403265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cfc2e-5b98-4585-abdd-c05b9f4930d7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:41.412554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d13b-74ee-444d-b177-c3734174b98f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:41.431593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cfc2e-5b98-4585-abdd-c05b9f4930d7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:41.432208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cfc2e-5b98-4585-abdd-c05b9f4930d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:41.443088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:41.446913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:41.447322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:41.447681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:41.448442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:41.450164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:41.473742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2921/5842] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:41.475003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:41.492000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c50cfc2e-5b98-4585-abdd-c05b9f4930d7 None None] MFA Rules not processed for user `08def8a420aa4a19b2cbf2e6988d2955`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:41.494111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfc64c-478a-4b5f-bc15-6a24cdb16532 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:41.494793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c50cfc2e-5b98-4585-abdd-c05b9f4930d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:41.510819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:41.511968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:41.520632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:41.520632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] PATH_INFO: `/v3/projects/526a3d7a1fc34b8198ceb7701acf39e4/users/9608bf3d142242d0bf8acc710315349f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:41.554164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=526a3d7a1fc34b8198ceb7701acf39e4, user_id=9608bf3d142242d0bf8acc710315349f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:41.560646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:41.645015 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2922/5843] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:41.696282 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2922/5844] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:41 2022] PUT /identity/v3/projects/526a3d7a1fc34b8198ceb7701acf39e4/users/9608bf3d142242d0bf8acc710315349f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:41.708655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10995440-3020-4786-bdad-fc484d688972 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:41.708958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10995440-3020-4786-bdad-fc484d688972 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:41.709242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10995440-3020-4786-bdad-fc484d688972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:41.739863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-10995440-3020-4786-bdad-fc484d688972 None None] MFA Rules not processed for user `9608bf3d142242d0bf8acc710315349f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:41.741098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-10995440-3020-4786-bdad-fc484d688972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:41.872433 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2923/5845] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:41.873648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:41.875614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:42.006072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce0e0-feae-400d-a638-3cb8af134c1e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:42.018813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541dded-0f33-46c0-a96a-cccbdd8066a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:42.020907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541dded-0f33-46c0-a96a-cccbdd8066a9 service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:42.022196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541dded-0f33-46c0-a96a-cccbdd8066a9 service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:42.022536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541dded-0f33-46c0-a96a-cccbdd8066a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:42.106201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:42.142826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541dded-0f33-46c0-a96a-cccbdd8066a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:42.144840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541dded-0f33-46c0-a96a-cccbdd8066a9 service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:42.171532 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2923/5846] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:42.686188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10995440-3020-4786-bdad-fc484d688972 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:42.699656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10995440-3020-4786-bdad-fc484d688972 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:42.704654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c84cd-65f2-4c7f-98ab-36877e8b4bb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:42.709721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c84cd-65f2-4c7f-98ab-36877e8b4bb6 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:42.709721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c84cd-65f2-4c7f-98ab-36877e8b4bb6 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:42.709721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c84cd-65f2-4c7f-98ab-36877e8b4bb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:42.717249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c84cd-65f2-4c7f-98ab-36877e8b4bb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:42.720667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c84cd-65f2-4c7f-98ab-36877e8b4bb6 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:42.737280 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2924/5847] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:42.815998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:43.737449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d866-8a3d-4715-af9e-2cf1afa8083f None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:43.737829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d866-8a3d-4715-af9e-2cf1afa8083f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:43.738214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d866-8a3d-4715-af9e-2cf1afa8083f None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:43.739696 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2924/5848] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:16:43.747128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:43.747719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:43.747719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:43.782950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:43.784606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:43.886664 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2925/5849] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:16:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:43.950294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716d866-8a3d-4715-af9e-2cf1afa8083f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:43.956222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0716d866-8a3d-4715-af9e-2cf1afa8083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:43.989480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716d866-8a3d-4715-af9e-2cf1afa8083f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:44.003453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f2e9-ae2c-4a8c-90b1-ca01c20f02e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:44.004085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f2e9-ae2c-4a8c-90b1-ca01c20f02e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:44.004375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f2e9-ae2c-4a8c-90b1-ca01c20f02e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:44.004647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f2e9-ae2c-4a8c-90b1-ca01c20f02e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:44.020572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6f2e9-ae2c-4a8c-90b1-ca01c20f02e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:44.022026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6f2e9-ae2c-4a8c-90b1-ca01c20f02e8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:44.046647 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2925/5850] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:44.065074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:44.184839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a9da-a488-4dfe-aa32-df30c4f26e1d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:44.193339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:44.194067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:44.194454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:44.194826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] PATH_INFO: `/v3/users/832b308a886243d693a31105c9a1ece1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:44.196905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832b308a886243d693a31105c9a1ece1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:44.200390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:44.523206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832b308a886243d693a31105c9a1ece1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:44.569823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832b308a886243d693a31105c9a1ece1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:44.599527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832b308a886243d693a31105c9a1ece1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:44.605421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832b308a886243d693a31105c9a1ece1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:44.606206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832b308a886243d693a31105c9a1ece1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:44.770581 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2926/5851] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:44 2022] DELETE /identity/v3/users/832b308a886243d693a31105c9a1ece1 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:44.774723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:44.775337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:44.775762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:44.806869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:44.808346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:44.911159 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2926/5852] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:44.936553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:44.942488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:45.073003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376aad-4471-4986-955f-2b874f7e6196 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:45.097344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:45.098135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:45.098426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:45.098704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:45.118479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:45.134048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:45.136308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:45.165101 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2927/5853] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:16:45.510057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:45.885237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:45.886977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:45.907917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f942c-72b1-4470-8f63-7b636bc4aef7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:45.913492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:45.914369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:45.914637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:45.915000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] PATH_INFO: `/v3/projects/c304ce9703914e75bb19283f045073ad` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:45.916702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c304ce9703914e75bb19283f045073ad)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:45.918781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:46.143907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c304ce9703914e75bb19283f045073ad', 'request_id': 'req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.151336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c304ce9703914e75bb19283f045073ad', 'request_id': 'req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.163234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c304ce9703914e75bb19283f045073ad', 'request_id': 'req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.309958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] The token cache is being invalidate because project c304ce9703914e75bb19283f045073ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:46.310165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.311576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.318342 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2927/5854] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:45 2022] DELETE /identity/v3/projects/c304ce9703914e75bb19283f045073ad => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:46.319710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:46.340572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9012ce-1f26-44e5-9f6d-1b6551e813a6 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:46.483433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:46.483433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:46.483433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:46.483433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] PATH_INFO: `/v3/users/9608bf3d142242d0bf8acc710315349f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:46.483847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9608bf3d142242d0bf8acc710315349f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:46.497571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:46.863057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9608bf3d142242d0bf8acc710315349f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.883349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9608bf3d142242d0bf8acc710315349f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.892187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9608bf3d142242d0bf8acc710315349f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.893743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9608bf3d142242d0bf8acc710315349f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:46.894637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54acda9d-50db-4563-99a5-fcde4c88d717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9608bf3d142242d0bf8acc710315349f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:47.126924 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2928/5855] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:46 2022] DELETE /identity/v3/users/9608bf3d142242d0bf8acc710315349f => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:48.114622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:48.117950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:48.140922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a7d7-d9e9-4294-aeca-54fe3a8f22e5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:48.279502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbe7fe-79a9-402f-bbb8-4f138ea4dcf5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:48.280113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbe7fe-79a9-402f-bbb8-4f138ea4dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:48.280113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbe7fe-79a9-402f-bbb8-4f138ea4dcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:48.303993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-40dbe7fe-79a9-402f-bbb8-4f138ea4dcf5 None None] MFA Rules not processed for user `38a9059e210e486aa34b724d5c497e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:48.305576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40dbe7fe-79a9-402f-bbb8-4f138ea4dcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:48.323352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:48.324267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:48.324725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:48.325171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] PATH_INFO: `/v3/projects/526a3d7a1fc34b8198ceb7701acf39e4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:48.326554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=526a3d7a1fc34b8198ceb7701acf39e4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:48.329765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:48.436877 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2929/5856] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:48.552220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526a3d7a1fc34b8198ceb7701acf39e4', 'request_id': 'req-e85bc80f-6886-475a-9e26-fbe3e75133ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:48.560035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526a3d7a1fc34b8198ceb7701acf39e4', 'request_id': 'req-e85bc80f-6886-475a-9e26-fbe3e75133ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:48.568306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526a3d7a1fc34b8198ceb7701acf39e4', 'request_id': 'req-e85bc80f-6886-475a-9e26-fbe3e75133ea'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:48.746306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] The token cache is being invalidate because project 526a3d7a1fc34b8198ceb7701acf39e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:16:48.746873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:48.748180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e85bc80f-6886-475a-9e26-fbe3e75133ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:48.762920 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2928/5857] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:16:48 2022] DELETE /identity/v3/projects/526a3d7a1fc34b8198ceb7701acf39e4 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:48.769440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:48.771107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:48.771834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:48.775238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:48.803239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:48.803239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:48.873725 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2930/5858] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:48.883222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:48.883501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:48.883770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:48.908483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:48.910596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:48.926726 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2929/5859] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:48.931982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:48.956137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e57a3-7b5e-4e50-89b7-896155bc953a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:48.959236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:48.965714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:48.965714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:48.965714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:48.965714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:48.966331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:16:48.966648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:48.976864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:49.002612 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2931/5860] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:16:49.003196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:49.029212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f78c1a-33af-4b30-b76c-69127bb741e9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:49.049287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:49.049952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:49.050234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:49.050724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:49.051566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:49.054263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:49.214848 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2930/5861] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:48 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:49.219153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:49.229671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f546-7d4e-4a9c-9ac0-f661f80c792a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:49.293160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:49.294026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:49.294137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:49.294412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:49.295163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:49.297128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:49.480018 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2932/5862] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:49 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:49.481547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:49.498685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701b92e-a6be-493d-9cf3-aee0360dd44e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:49.519758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:49.519758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:49.519758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:49.519758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:49.520116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:49.537769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:49.579803 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2931/5863] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:49.583693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:49.598368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57412046-b12f-42f5-8f0e-6f267656d4b9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:49.611853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a36e5-9df0-4151-a817-65470dc9c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:49.612812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a36e5-9df0-4151-a817-65470dc9c997 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:49.613098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a36e5-9df0-4151-a817-65470dc9c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:49.613369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a36e5-9df0-4151-a817-65470dc9c997 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:49.614658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a36e5-9df0-4151-a817-65470dc9c997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:49.617596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a36e5-9df0-4151-a817-65470dc9c997 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:49.631625 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2933/5864] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:49.637123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:49.654574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4357e-0a58-4902-9659-e6dc9d585c15 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:49.661414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:49.662427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:49.662991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:49.663425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] PATH_INFO: `/v3/projects/0338ca58862347b5928f25caec0dabfb/users/23a3973060cc4d69981c44437f7f170a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:49.681809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0338ca58862347b5928f25caec0dabfb, user_id=23a3973060cc4d69981c44437f7f170a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:49.685478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:49.912517 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2932/5865] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:49 2022] PUT /identity/v3/projects/0338ca58862347b5928f25caec0dabfb/users/23a3973060cc4d69981c44437f7f170a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:49.932685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b43af4-ee16-40b8-8c03-f3fe41213c89 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:49.932906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b43af4-ee16-40b8-8c03-f3fe41213c89 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:49.933167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b43af4-ee16-40b8-8c03-f3fe41213c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:49.984217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-72b43af4-ee16-40b8-8c03-f3fe41213c89 None None] MFA Rules not processed for user `23a3973060cc4d69981c44437f7f170a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:49.986746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-72b43af4-ee16-40b8-8c03-f3fe41213c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:50.121303 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2934/5866] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:50.125104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:50.345962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:50.417168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1f9b-c0fa-4576-8edd-090dbaa45165 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:50.430796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:50.431955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:50.432479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:50.433785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:50.435122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:50.437461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:50.486136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:50.486704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:50.487141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:50.577433 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2933/5867] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:50 2022] POST /identity/v3/projects => generated 381 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:50.584062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:50.672497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:50.674564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:50.689226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2935/5868] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:50 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 20:16:50.691758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:50.693656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:50.778553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3d41-bf8a-4dfe-9a03-e30299489a09 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:50.791743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:50.793443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:50.793754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:50.794069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:50.811085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:50.813713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:50.837503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bedba-d303-4ae8-a620-ff03964d06bc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:50.848362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:50.855731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feeeec-2562-4630-86fe-8dcf702681be tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:50.856698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feeeec-2562-4630-86fe-8dcf702681be tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:50.857282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feeeec-2562-4630-86fe-8dcf702681be tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:50.857282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feeeec-2562-4630-86fe-8dcf702681be tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:50.950635 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2934/5869] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:50 2022] POST /identity/v3/users => generated 291 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:16:50.951952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:50.977597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534305-f225-449a-a379-97dcf0f798e0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:51.006429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:51.007436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:51.007871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:51.008294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:51.009384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:51.012397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:51.031853 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2935/5870] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:51.036748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:51.054332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f6feeeec-2562-4630-86fe-8dcf702681be tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:51.073640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a8bd-dfbd-4d36-a777-1edaa0e7e3a9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:51.095945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:51.101663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:51.102012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:51.102267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:51.102978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:51.113503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:51.142424 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2936/5871] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:51.146304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:51.176033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2936/5872] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:50 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:51.192082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556857-557b-4916-8767-6e3395374854 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:51.213397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:51.215196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:51.215489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:51.215772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] PATH_INFO: `/v3/projects/52cfc216d5cd429b88a159c0fa464a44/users/d60c0f7e0fe349a0b6a27a37595c6cc5/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:51.271074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cfc216d5cd429b88a159c0fa464a44, user_id=d60c0f7e0fe349a0b6a27a37595c6cc5, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:51.275643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:51.377371 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2937/5873] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:51 2022] PUT /identity/v3/projects/52cfc216d5cd429b88a159c0fa464a44/users/d60c0f7e0fe349a0b6a27a37595c6cc5/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:51.387811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:51.388685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:51.388685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:51.431144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] MFA Rules not processed for user `d60c0f7e0fe349a0b6a27a37595c6cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:51.432668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:51.578348 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2937/5874] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:51.583222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:51.682649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:51.793657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d429c96-d0f0-4b68-9795-39277fdea1fc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:51.815050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c08d1-2e56-4065-b9d3-843795fddae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:51.815582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c08d1-2e56-4065-b9d3-843795fddae9 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:51.815879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c08d1-2e56-4065-b9d3-843795fddae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:51.816149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c08d1-2e56-4065-b9d3-843795fddae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:51.816804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c08d1-2e56-4065-b9d3-843795fddae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:51.818848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c08d1-2e56-4065-b9d3-843795fddae9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:51.957109 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2938/5875] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:16:51 2022] POST /identity/v3/projects => generated 381 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:51.958949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:51.976034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c494d-2a22-4d42-865b-aedbd5c5c602 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:52.101990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:52.106477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.106477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.106477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.106477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:52.115540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:52.182531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98131a77-2ae8-4b15-a42a-584e7aea89cc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.183091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98131a77-2ae8-4b15-a42a-584e7aea89cc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.183601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98131a77-2ae8-4b15-a42a-584e7aea89cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.232979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-98131a77-2ae8-4b15-a42a-584e7aea89cc None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:52.236887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-98131a77-2ae8-4b15-a42a-584e7aea89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:52.247224 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2939/5876] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:52 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:52.251910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d800b-9b45-4dfa-9b25-d2b67c110a63 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.252231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d800b-9b45-4dfa-9b25-d2b67c110a63 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.262538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d800b-9b45-4dfa-9b25-d2b67c110a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.367300 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2938/5877] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:16:51 2022] POST /identity/v3/users => generated 297 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:16:52.371559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:52.392328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286488-b8dd-45c3-a9c1-1e7a9aa06d7c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:52.417119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:52.417119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.418102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.418822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.419687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:52.428416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:52.456360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2939/5878] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:16:52.465661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-e64d800b-9b45-4dfa-9b25-d2b67c110a63 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 28 20:16:52.474909 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:16:52.476191 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 20:16:52.477367 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:16:52.478858 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2940/5879] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:52 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:16:52.483087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e26f9-47a4-4b9f-b71a-dd1a3c65d640 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.483523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e26f9-47a4-4b9f-b71a-dd1a3c65d640 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.483890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e26f9-47a4-4b9f-b71a-dd1a3c65d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.493956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaa3e2-fbec-4cd1-a2f3-ea70a51acbe7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:52.506156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:52.507908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.509767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.510210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] PATH_INFO: `/v3/projects/147908f7ac0d4eb3af9c484731deed28/users/36a996058c1d4b0e930792d4fc64a14d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.573790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147908f7ac0d4eb3af9c484731deed28, user_id=36a996058c1d4b0e930792d4fc64a14d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:52.576720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:52.658696 n-d-854121-7 devstack@keystone.service[82298]: WARNING keystone.server.flask.application [None req-a74e26f9-47a4-4b9f-b71a-dd1a3c65d640 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 20:16:52.660603 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2941/5880] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:52 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 178 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 20:16:52.665581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.666379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.666817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.769524 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2940/5881] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:52 2022] PUT /identity/v3/projects/147908f7ac0d4eb3af9c484731deed28/users/36a996058c1d4b0e930792d4fc64a14d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:52.773986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:52.842844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1a871-7335-4f72-9f57-35d025c90325 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:52.849128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:52.849774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.850080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.850361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.851055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:52.852707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:52.867486 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2941/5882] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:16:52.869555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:52.886805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2265f-0f8f-4b85-94f6-b762045d889e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:52.891717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a17e6-613f-47e0-b296-43e8daff70e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:52.892417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a17e6-613f-47e0-b296-43e8daff70e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.892699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a17e6-613f-47e0-b296-43e8daff70e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.892970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a17e6-613f-47e0-b296-43e8daff70e5 admin admin] PATH_INFO: `/v3/projects/147908f7ac0d4eb3af9c484731deed28/users/36a996058c1d4b0e930792d4fc64a14d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.894993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a17e6-613f-47e0-b296-43e8daff70e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147908f7ac0d4eb3af9c484731deed28, user_id=36a996058c1d4b0e930792d4fc64a14d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:52.897671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a17e6-613f-47e0-b296-43e8daff70e5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:52.918346 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2942/5883] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:16:52 2022] PUT /identity/v3/projects/147908f7ac0d4eb3af9c484731deed28/users/36a996058c1d4b0e930792d4fc64a14d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:52.924108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:52.924411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:52.924785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:52.929184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:52.930628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:52.962999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] MFA Rules not processed for user `36a996058c1d4b0e930792d4fc64a14d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:52.964849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:53.001578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:53.037070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2942/5884] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:53.038869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:53.058834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80c1a-6373-459b-9317-85629b409bd8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:53.071231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b90335-3ef3-48c5-bc69-9f1ccbc18286 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:53.072800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b90335-3ef3-48c5-bc69-9f1ccbc18286 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:53.073063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b90335-3ef3-48c5-bc69-9f1ccbc18286 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:53.073446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b90335-3ef3-48c5-bc69-9f1ccbc18286 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:53.125468 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2943/5885] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:53.137830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:53.150202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:53.211861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5c4ad-6993-4dfc-b976-99e34a485fc2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:53.215878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ee15e-3e2e-4859-9eda-123661dd6d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:53.216488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ee15e-3e2e-4859-9eda-123661dd6d4e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:53.216773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ee15e-3e2e-4859-9eda-123661dd6d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:53.217090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ee15e-3e2e-4859-9eda-123661dd6d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:53.275676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f5b90335-3ef3-48c5-bc69-9f1ccbc18286 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:53.304024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ee15e-3e2e-4859-9eda-123661dd6d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:53.307490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ee15e-3e2e-4859-9eda-123661dd6d4e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:53.318291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2944/5886] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:53.396695 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2943/5887] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:53 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:53.562386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:54.403816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:54.404232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:54.408363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:54.429059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:54.434536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:54.443840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2945/5888] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:54 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:54.452209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf66e55-b6d4-49d9-b7d1-22b69b241d3c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:54.455537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf66e55-b6d4-49d9-b7d1-22b69b241d3c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:54.455862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf66e55-b6d4-49d9-b7d1-22b69b241d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:54.496504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0cf66e55-b6d4-49d9-b7d1-22b69b241d3c None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:54.503103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0cf66e55-b6d4-49d9-b7d1-22b69b241d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:54.535839 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2944/5889] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:54.536034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:54.571308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93290-5753-41fc-a83c-b1dee6a7cec6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:54.596179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86605289-e298-4bbb-b4ea-c39e817d0b84 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:54.596853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86605289-e298-4bbb-b4ea-c39e817d0b84 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:54.597966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86605289-e298-4bbb-b4ea-c39e817d0b84 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:54.598630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86605289-e298-4bbb-b4ea-c39e817d0b84 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:54.808738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-86605289-e298-4bbb-b4ea-c39e817d0b84 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:54.925695 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2946/5890] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:54 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:16:55.626232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:55.932360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:55.932881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:55.933278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:55.990888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:55.994066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:56.003897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2945/5891] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:56.009079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f62a3-b6d1-4432-a3aa-2689837c1187 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:56.009628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f62a3-b6d1-4432-a3aa-2689837c1187 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:56.009628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f62a3-b6d1-4432-a3aa-2689837c1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:56.052049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ae6f62a3-b6d1-4432-a3aa-2689837c1187 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:56.055163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ae6f62a3-b6d1-4432-a3aa-2689837c1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:56.069535 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2947/5892] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:56.079584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:56.099943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dac129-8a2e-4d09-90bd-3f90497e8d21 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:56.116025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f266c14-9b59-4887-af37-edcb3af01b37 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88aa16b34a74af0b243eca60f80cc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9d385853a84022984423b141adcb68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:56.116707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f266c14-9b59-4887-af37-edcb3af01b37 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:56.118196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f266c14-9b59-4887-af37-edcb3af01b37 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:56.120265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f266c14-9b59-4887-af37-edcb3af01b37 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83/password` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:56.186518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:56.311817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0f266c14-9b59-4887-af37-edcb3af01b37 tempest-IdentityV3UsersTest-1236587774 tempest-IdentityV3UsersTest-1236587774-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:56.409753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2946/5893] 10.222.0.78 () {60 vars in 1269 bytes} [Sun Aug 28 20:16:56 2022] POST /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83/password => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:57.415818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:57.416295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:57.416652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:57.441345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:57.443398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:57.453148 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2948/5894] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 20:16:57.817787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:58.354400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:58.459281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177549e-2327-4986-8cf8-482d9177d1e0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:58.459569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177549e-2327-4986-8cf8-482d9177d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:58.460064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177549e-2327-4986-8cf8-482d9177d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:58.506832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1177549e-2327-4986-8cf8-482d9177d1e0 None None] MFA Rules not processed for user `e88aa16b34a74af0b243eca60f80cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:58.514556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1177549e-2327-4986-8cf8-482d9177d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:58.549053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2947/5895] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:16:58.550785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:58.552415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:58.730586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24bf63-5235-4a4a-a736-62c0f83cc822 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:58.762856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:58.763537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:58.763824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:58.764256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] PATH_INFO: `/v3/users/e88aa16b34a74af0b243eca60f80cc83` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:58.766761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88aa16b34a74af0b243eca60f80cc83)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:16:58.770904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:16:59.336177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:59.381319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:59.464798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:59.466502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:59.468702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88aa16b34a74af0b243eca60f80cc83'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:16:59.575821 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2949/5896] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:16:58 2022] DELETE /identity/v3/users/e88aa16b34a74af0b243eca60f80cc83 => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:16:59.582112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:59.582921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:59.582921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:16:59.596389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=1,keystone:DELETE=4,keystone:SELECT=95 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:16:59.641631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:16:59.642428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:59.719359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2948/5897] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:16:59.738260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:16:59.741208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:16:59.984150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c303-458a-433b-8c3e-998f0c4bd619 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:16:59.991149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f294-1911-4063-a505-1435eb5638d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:16:59.992915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f294-1911-4063-a505-1435eb5638d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:16:59.994052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f294-1911-4063-a505-1435eb5638d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:16:59.994697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f294-1911-4063-a505-1435eb5638d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:00.010682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712f294-1911-4063-a505-1435eb5638d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:00.017196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712f294-1911-4063-a505-1435eb5638d3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:00.046633 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2950/5898] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:00.148617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:00.827630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:00.829617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:00.855190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be7bcf-25e3-4c82-a532-13859e6096c0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:00.862027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:00.862853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:00.863273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:00.863751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] PATH_INFO: `/v3/projects/6a9d385853a84022984423b141adcb68` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:00.865292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9d385853a84022984423b141adcb68)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:00.867645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:01.011960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9d385853a84022984423b141adcb68', 'request_id': 'req-5e6d33b5-767d-4a65-86dd-42be3eddd73a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:01.026378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9d385853a84022984423b141adcb68', 'request_id': 'req-5e6d33b5-767d-4a65-86dd-42be3eddd73a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:01.039437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9d385853a84022984423b141adcb68', 'request_id': 'req-5e6d33b5-767d-4a65-86dd-42be3eddd73a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:01.174840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] The token cache is being invalidate because project 6a9d385853a84022984423b141adcb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:01.175121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:01.176255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5e6d33b5-767d-4a65-86dd-42be3eddd73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:01.182126 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2949/5899] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:00 2022] DELETE /identity/v3/projects/6a9d385853a84022984423b141adcb68 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:01.194688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:01.196245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:01.197066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:01.245053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:01.247386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:01.436801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2951/5900] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:01.439084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:01.439800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:01.440438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:01.512836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:01.514288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:01.543889 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2950/5901] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:01.546628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:01.561000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed3c91-b529-4c17-968c-88835acbcc5d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:01.575527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:01.576626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:01.577070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:01.577535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:01.578489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:01.579044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:01.584064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:01.621436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:01.622120 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2952/5902] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:01.640594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765252c-f6c4-4e5e-a219-8b0eab8cd942 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:01.653760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:01.655122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:01.656514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:01.656949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:01.663331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:01.664426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:01.844868 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2951/5903] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:01 2022] POST /identity/v3/projects => generated 371 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:17:01.856428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:01.920401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3bb25-c892-495f-95da-c568055a8214 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:02.072765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:02.073418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:02.073703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:02.074014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:02.074673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:02.076623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:02.239791 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2953/5904] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:01 2022] POST /identity/v3/users => generated 286 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:02.247377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:02.263837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b79bb-d462-48f0-b43e-4e5e8bf51c37 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:02.280450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:02.281271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:02.282278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:02.282695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:02.283502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:02.285250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:02.327434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:02.329029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2952/5905] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:02.343312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26631d9-b3cb-4fe3-a583-0cf2b5eab560 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:02.358844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a3fb4-727a-460f-9a58-b62262f78cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:02.359580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a3fb4-727a-460f-9a58-b62262f78cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:02.360600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a3fb4-727a-460f-9a58-b62262f78cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:02.361079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a3fb4-727a-460f-9a58-b62262f78cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:02.365963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a3fb4-727a-460f-9a58-b62262f78cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:02.374990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a3fb4-727a-460f-9a58-b62262f78cc5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:02.427405 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2954/5906] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:17:02.434888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:02.474992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77812-d2c3-4b47-961f-f7c136853661 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:02.501449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:02.502178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:02.502646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:02.503219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] PATH_INFO: `/v3/projects/fccd655ef7284542a148df8eaa60cb15/users/58ed10adb8ed4a9ca264ed44f0120bd2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:02.549064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccd655ef7284542a148df8eaa60cb15, user_id=58ed10adb8ed4a9ca264ed44f0120bd2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:02.551854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:02.736306 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2953/5907] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:02 2022] PUT /identity/v3/projects/fccd655ef7284542a148df8eaa60cb15/users/58ed10adb8ed4a9ca264ed44f0120bd2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:02.742748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:02.743173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:02.743578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:02.819482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] MFA Rules not processed for user `58ed10adb8ed4a9ca264ed44f0120bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:02.821474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:03.020957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2955/5908] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:03.032962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:03.036138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:03.066758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:03.146696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadd4d7-d170-4001-a031-33c46af80a0c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:03.153326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0ec4a-5c8f-42b2-bb01-12e93907a665 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:03.154706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0ec4a-5c8f-42b2-bb01-12e93907a665 service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:03.155329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0ec4a-5c8f-42b2-bb01-12e93907a665 service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:03.155907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0ec4a-5c8f-42b2-bb01-12e93907a665 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:03.167806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0ec4a-5c8f-42b2-bb01-12e93907a665 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:03.170373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0ec4a-5c8f-42b2-bb01-12e93907a665 service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:03.182781 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2954/5909] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:03.346485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:03.502496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:03.572527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045225-068c-49dd-8ec7-512fabfaa930 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:03.582418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:03.583462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:03.585026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:03.585546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] PATH_INFO: `/v3/users/58ed10adb8ed4a9ca264ed44f0120bd2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:03.588062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ed10adb8ed4a9ca264ed44f0120bd2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:03.593510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:04.043064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ed10adb8ed4a9ca264ed44f0120bd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:04.061931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ed10adb8ed4a9ca264ed44f0120bd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:04.073709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ed10adb8ed4a9ca264ed44f0120bd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:04.074976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ed10adb8ed4a9ca264ed44f0120bd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:04.075941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ed10adb8ed4a9ca264ed44f0120bd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:04.248336 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2956/5910] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:03 2022] DELETE /identity/v3/users/58ed10adb8ed4a9ca264ed44f0120bd2 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:04.255759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:04.255759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:04.255759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:04.283553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:04.284788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:04.366145 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2955/5911] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:04.385060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:04.387112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:04.530839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b650d-b32f-4133-964c-388118048c52 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:04.540956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92075eb-a85b-4ff0-9220-9f547ebc541e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:04.542966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92075eb-a85b-4ff0-9220-9f547ebc541e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:04.544159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92075eb-a85b-4ff0-9220-9f547ebc541e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:04.544676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92075eb-a85b-4ff0-9220-9f547ebc541e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:04.582094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92075eb-a85b-4ff0-9220-9f547ebc541e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:04.583690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92075eb-a85b-4ff0-9220-9f547ebc541e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:04.604115 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2957/5912] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:04.843489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:05.626488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:05.628564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:05.651163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac419-aee5-4531-b6d7-dd85438b789c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:05.659752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:05.660944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:05.661236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:05.661703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] PATH_INFO: `/v3/projects/fccd655ef7284542a148df8eaa60cb15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:05.663335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccd655ef7284542a148df8eaa60cb15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:05.666603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:05.741417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:05.848438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccd655ef7284542a148df8eaa60cb15', 'request_id': 'req-fe4359e7-8e12-4707-b508-9a294acfddd4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:05.862198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccd655ef7284542a148df8eaa60cb15', 'request_id': 'req-fe4359e7-8e12-4707-b508-9a294acfddd4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:05.875889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccd655ef7284542a148df8eaa60cb15', 'request_id': 'req-fe4359e7-8e12-4707-b508-9a294acfddd4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:05.984450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] The token cache is being invalidate because project fccd655ef7284542a148df8eaa60cb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:05.988076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:05.989467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe4359e7-8e12-4707-b508-9a294acfddd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:05.996579 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2956/5913] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:05 2022] DELETE /identity/v3/projects/fccd655ef7284542a148df8eaa60cb15 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:06.000767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:06.001735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:06.002243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:06.037969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:06.039444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:06.175186 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2958/5914] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:06.182787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:06.183596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:06.184335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:06.220335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:06.222842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:06.239538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:06.252621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2957/5915] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:06.253740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ade4f1-409e-4771-99c6-cbb97efc6342 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:06.269758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:06.270436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:06.270908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:06.271195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:06.271875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:06.272189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:06.278454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:06.299549 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2959/5916] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:06.312944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:06.321531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef0d5-9f8c-40c9-b385-4408e10cfa16 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:06.330563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:06.331205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:06.331504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:06.355291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:06.356307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:06.358285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:06.571414 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2958/5917] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:06 2022] POST /identity/v3/projects => generated 361 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:06.573366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:06.589832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049d9c0-b6a3-44dc-8372-23a1f92d8578 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:06.702194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:06.703994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:06.704516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:06.705930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:06.706924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:06.709999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:06.751973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:06.919402 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2960/5918] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:06 2022] POST /identity/v3/users => generated 281 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:06.924682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:06.946275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70743c81-2fc1-4a10-b9db-105f7953c65a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:06.960083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:06.960930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:06.961452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:06.961935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:06.962716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:06.964612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:06.980891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2959/5919] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:06.985303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:07.022710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c726-3543-478a-ab14-e8c22403cdb4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:07.029896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53cf55-3a9f-4431-bed5-e4697c89b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:07.032182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cf55-3a9f-4431-bed5-e4697c89b750 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:07.033756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cf55-3a9f-4431-bed5-e4697c89b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:07.034353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cf55-3a9f-4431-bed5-e4697c89b750 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:07.035419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53cf55-3a9f-4431-bed5-e4697c89b750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:07.037816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53cf55-3a9f-4431-bed5-e4697c89b750 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:07.058366 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2961/5920] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:17:07.065074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:07.087574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9ea5f-f883-4195-8828-6389f7b4bce1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:07.105089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:07.105089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:07.105089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:07.105089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] PATH_INFO: `/v3/projects/43a25f818109450aba3161e82f057a6e/users/9b9acff876284b6580d2308114f0e38b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:07.152216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a25f818109450aba3161e82f057a6e, user_id=9b9acff876284b6580d2308114f0e38b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:07.155119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:07.332939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2960/5921] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:07 2022] PUT /identity/v3/projects/43a25f818109450aba3161e82f057a6e/users/9b9acff876284b6580d2308114f0e38b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:07.340881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae1c06-3553-4824-a304-9ed78781689d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:07.341947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae1c06-3553-4824-a304-9ed78781689d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:07.341947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae1c06-3553-4824-a304-9ed78781689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:07.388163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e1ae1c06-3553-4824-a304-9ed78781689d None None] MFA Rules not processed for user `9b9acff876284b6580d2308114f0e38b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:07.389568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1ae1c06-3553-4824-a304-9ed78781689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:07.538132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2962/5922] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:07.540468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:07.569907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:07.651645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f14ad-ec6f-47c7-b9f7-34c78e6bc212 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:07.689276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:07.690544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:07.691082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:07.691947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] PATH_INFO: `/v3/users/9b9acff876284b6580d2308114f0e38b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:07.694514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9acff876284b6580d2308114f0e38b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:07.696999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:07.715283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:08.033347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9acff876284b6580d2308114f0e38b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:08.036563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9acff876284b6580d2308114f0e38b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:08.133828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9acff876284b6580d2308114f0e38b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:08.149652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9acff876284b6580d2308114f0e38b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:08.151290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9acff876284b6580d2308114f0e38b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:08.221752 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2961/5923] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:07 2022] DELETE /identity/v3/users/9b9acff876284b6580d2308114f0e38b => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:08.226575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:08.227473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:08.227757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:08.271901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:08.273498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:08.276194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:08.306032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:08.308555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:08.470586 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2963/5924] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:08.500517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d826bc7-e125-4cd2-baa0-566e1b9bbe0d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:08.512623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:08.514167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:08.514942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:08.515744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:08.520601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:08.521074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:08.523748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:08.542630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:08.545843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:08.549565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:08.575935 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2962/5925] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:08.658827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c9c9-0cd1-46f8-8a5e-02f6803f483a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:08.666405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce830ee5-0306-4e41-9f70-d8fd74795e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:08.667641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce830ee5-0306-4e41-9f70-d8fd74795e11 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:08.668097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce830ee5-0306-4e41-9f70-d8fd74795e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:08.668563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce830ee5-0306-4e41-9f70-d8fd74795e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:08.699777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce830ee5-0306-4e41-9f70-d8fd74795e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:08.706970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce830ee5-0306-4e41-9f70-d8fd74795e11 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:08.720364 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2964/5926] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:09.340012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:09.565384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:09.568468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:09.622363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769332d-eeb3-4867-93d6-26b321555d9e service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:09.645441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:09.647060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:09.647700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:09.648012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] PATH_INFO: `/v3/projects/43a25f818109450aba3161e82f057a6e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:09.650878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a25f818109450aba3161e82f057a6e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:09.659772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:09.882427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a25f818109450aba3161e82f057a6e', 'request_id': 'req-20a6a8eb-9f6f-49b1-8174-33d20316b55e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:09.897799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a25f818109450aba3161e82f057a6e', 'request_id': 'req-20a6a8eb-9f6f-49b1-8174-33d20316b55e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:09.906631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a25f818109450aba3161e82f057a6e', 'request_id': 'req-20a6a8eb-9f6f-49b1-8174-33d20316b55e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:10.004682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:10.043420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] The token cache is being invalidate because project 43a25f818109450aba3161e82f057a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:10.043420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:10.043420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20a6a8eb-9f6f-49b1-8174-33d20316b55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:10.044443 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2963/5927] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:09 2022] DELETE /identity/v3/projects/43a25f818109450aba3161e82f057a6e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:10.050314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.050592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.051061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.088183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:10.100320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:10.101568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:10.250408 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2965/5928] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:10.258304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.258593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.258871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.294903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:10.296197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:10.320030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2964/5929] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:10.324721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:10.341322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d8ad9-6f31-4c42-a9dd-ef0680f571df None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:10.359756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:10.360862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.361153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.361441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.362825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:10.363345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:10.367363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:10.388238 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2966/5930] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:10.391270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:10.414282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e23ce-110d-4ae7-a679-7c2b66759f92 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:10.431143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:10.431755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.432092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.432371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.433139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:10.435439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:10.587255 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2965/5931] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:10 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:10.591917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:10.603589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2814f-2d94-4b8f-ae99-9300dee48a20 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:10.699242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:10.700412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.700699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.701100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.701641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:10.704226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:10.869214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2967/5932] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:10 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:10.873340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:10.888554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10b03-4cb2-46a9-bee4-6240652505d7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:10.896352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:10.897163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.897922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.898293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.902212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:10.902212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:10.913138 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2966/5933] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:10.917637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:10.960085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ce1fa-dac3-4cda-8974-54547fa6baa0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:10.966459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578301b8-3651-4f84-b72e-17d947b1943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:10.967406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578301b8-3651-4f84-b72e-17d947b1943c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.968600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578301b8-3651-4f84-b72e-17d947b1943c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.969363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578301b8-3651-4f84-b72e-17d947b1943c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.970299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578301b8-3651-4f84-b72e-17d947b1943c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:10.972286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578301b8-3651-4f84-b72e-17d947b1943c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:10.985917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2968/5934] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:17:10.990319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:11.023064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4a2a2-4468-4a77-a6b3-7277e9f6a6d3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:11.034329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:11.037653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:11.038200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:11.038955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] PATH_INFO: `/v3/projects/9a91328a58da43feb2bc437d856e56cd/users/a56a56dcaed34fb790e0c192dc846e03/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:11.082854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a91328a58da43feb2bc437d856e56cd, user_id=a56a56dcaed34fb790e0c192dc846e03, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:11.089605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:11.228336 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2967/5935] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:10 2022] PUT /identity/v3/projects/9a91328a58da43feb2bc437d856e56cd/users/a56a56dcaed34fb790e0c192dc846e03/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:11.339563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:11.340496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:11.340966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:11.406550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] MFA Rules not processed for user `a56a56dcaed34fb790e0c192dc846e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:11.408279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:11.650163 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2969/5936] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:11.651685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:11.699452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:11.828382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f68a7-0c62-4591-aed6-cc5721c61110 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:11.835275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:11.837216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:11.837688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:11.838460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:11.839300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:11.841727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:11.850417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:11.987649 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2968/5937] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:11 2022] POST /identity/v3/projects => generated 367 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:11.991187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.007887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384b162-1ebc-4c71-af8f-d3d4f1e0486b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.102818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.104268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.104562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.104836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.106248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.110334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.209028 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2970/5938] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:11 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:12.213432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.239679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a369d9-cd19-44d9-9139-50e3c01f5d54 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.247972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.248879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.249326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.249905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.250792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.253785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.266693 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2969/5939] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:12.270660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.292574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587f300-28e3-4f2c-b755-dec3bdfa6b4f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.313189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.314232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.314757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.315327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] PATH_INFO: `/v3/projects/44cd7a49738b45d7ba4b65a3243c34a5/users/d5041f8e55734ae180795b144e3ebaed/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.363223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cd7a49738b45d7ba4b65a3243c34a5, user_id=d5041f8e55734ae180795b144e3ebaed, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.366067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.387897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.395232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:12.428440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3172246-5f05-4ffe-ba30-f9edbbdde650 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.438093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.440207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.440207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.440207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] PATH_INFO: `/v3/users/d5dd54ded7ec498faceb5c0a0eaa2c94` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.441986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dd54ded7ec498faceb5c0a0eaa2c94)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.452269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.478207 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2971/5940] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:12 2022] PUT /identity/v3/projects/44cd7a49738b45d7ba4b65a3243c34a5/users/d5041f8e55734ae180795b144e3ebaed/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:12.482453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.570734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190fea9-600d-47da-acf7-2c6d0bf28847 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.580036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.580881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.581244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.581528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.583193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.585401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.605526 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2972/5941] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:17:12.607597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.621607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e08e-4b37-4d86-b42c-f5d5afdabc82 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.636927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5b21-a8c1-4eda-bacc-8c9cdcd48459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.636927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5b21-a8c1-4eda-bacc-8c9cdcd48459 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.636927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5b21-a8c1-4eda-bacc-8c9cdcd48459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.636927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5b21-a8c1-4eda-bacc-8c9cdcd48459 admin admin] PATH_INFO: `/v3/projects/44cd7a49738b45d7ba4b65a3243c34a5/users/d5041f8e55734ae180795b144e3ebaed/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.638241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5b21-a8c1-4eda-bacc-8c9cdcd48459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cd7a49738b45d7ba4b65a3243c34a5, user_id=d5041f8e55734ae180795b144e3ebaed, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.641788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5b21-a8c1-4eda-bacc-8c9cdcd48459 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.665613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2973/5942] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:12 2022] PUT /identity/v3/projects/44cd7a49738b45d7ba4b65a3243c34a5/users/d5041f8e55734ae180795b144e3ebaed/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:12.679109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.679925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.680465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.746437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] MFA Rules not processed for user `d5041f8e55734ae180795b144e3ebaed`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:12.746437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:12.793941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dd54ded7ec498faceb5c0a0eaa2c94'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:12.795004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dd54ded7ec498faceb5c0a0eaa2c94'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:12.806633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:12.839538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2974/5943] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:17:12.851079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.852796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:12.895406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dd54ded7ec498faceb5c0a0eaa2c94'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:12.935351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dd54ded7ec498faceb5c0a0eaa2c94'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:12.938130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670898e5-f0d0-4e72-9211-03d19fd56fb0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.939828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2ca2956a-4192-43e1-a788-737ca621a285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dd54ded7ec498faceb5c0a0eaa2c94'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:12.951505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.954583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.955047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.955521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.959576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:12.984443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:13.010406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:13.016502 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2970/5944] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:12 2022] DELETE /identity/v3/users/d5dd54ded7ec498faceb5c0a0eaa2c94 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:13.020539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:13.021077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:13.021750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:13.043341 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2975/5945] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:13.081485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:13.084730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:13.253605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:13.255603 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2971/5946] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:13.256102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:13.269614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:13.271123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:13.273380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7833d8-c9e0-420b-aa01-e1b8851e7575 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:13.372394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:13.373253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:13.373346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:13.373576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:13.373731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:13.382861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dd597-2370-4fe8-9863-ad5e18c274a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:13.382984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:13.389194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:13.391192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:13.391192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:13.391542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:13.430646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:13.432100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:13.463361 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2972/5947] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:13.497715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:13.499253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29addc-97dd-4a88-b7d2-d4cc9c04c684 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:13.516271 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2976/5948] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:13.780312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:13.783679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:13.816743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6c839-23f8-4565-b4fe-3c564a6d12d8 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:13.827839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:13.829773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:13.830483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:13.830922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] PATH_INFO: `/v3/projects/7330eace4daf4db0a7cb0c149eb48669` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:13.832637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7330eace4daf4db0a7cb0c149eb48669)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:13.836306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:13.905995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:14.001955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7330eace4daf4db0a7cb0c149eb48669', 'request_id': 'req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:14.009141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7330eace4daf4db0a7cb0c149eb48669', 'request_id': 'req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:14.022818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7330eace4daf4db0a7cb0c149eb48669', 'request_id': 'req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:14.122129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] The token cache is being invalidate because project 7330eace4daf4db0a7cb0c149eb48669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:14.122588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:14.123271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-111cbf9d-a2b0-4a21-865d-8f7a64e9ad1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:14.125381 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2973/5949] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:13 2022] DELETE /identity/v3/projects/7330eace4daf4db0a7cb0c149eb48669 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:14.130646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.131009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.131343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.162889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:14.165528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:14.288714 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2977/5950] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:14.297449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.298043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.298499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.324777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:14.327021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:14.342793 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2974/5951] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:14.348349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:14.377976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792331d-a0ff-4cf4-bd0f-f4f3937069e0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:14.385314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:14.385718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.386233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.386890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.387777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:14.388272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:14.390358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:14.419313 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2978/5952] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:14.421254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:14.435688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd5103-384e-4289-9154-bef952ee3c5b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:14.446138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:14.449154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.449154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.449154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.449154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:14.451686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:14.591037 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2975/5953] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:14 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:14.595382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:14.606877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a13ae-2fc3-4c16-aa2b-3d69a25f40ea admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:14.692551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:14.693429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.693993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.694501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.695528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:14.697934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:14.806740 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2979/5954] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:14 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:17:14.811919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:14.826417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256298-e5f8-4f31-b17d-375a6c6653c4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:14.835971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:14.837315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.837840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.838349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.840384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:14.842563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:14.854755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2976/5955] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:17:14.860788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:14.874357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcc68-fd38-4c72-b6a4-fba7b6c7bac4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:14.881578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb013d1-b62b-4bb3-bbc0-2ba5150a615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:14.882252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb013d1-b62b-4bb3-bbc0-2ba5150a615c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.886851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb013d1-b62b-4bb3-bbc0-2ba5150a615c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.886851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb013d1-b62b-4bb3-bbc0-2ba5150a615c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.886851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb013d1-b62b-4bb3-bbc0-2ba5150a615c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:14.886851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb013d1-b62b-4bb3-bbc0-2ba5150a615c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:14.907181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:14.918653 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2980/5956] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:14.918905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:14.932206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7502b-5c98-42de-8452-c71985b422ee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:14.938011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:14.942768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.942768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.942768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] PATH_INFO: `/v3/projects/02e0dcbc271e416e8412dac35e8935ef/users/1f9d7dcb12e74a1ebfb4b3f2737377ed/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.960485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e0dcbc271e416e8412dac35e8935ef, user_id=1f9d7dcb12e74a1ebfb4b3f2737377ed, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:14.965349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:15.052197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2977/5957] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:14 2022] PUT /identity/v3/projects/02e0dcbc271e416e8412dac35e8935ef/users/1f9d7dcb12e74a1ebfb4b3f2737377ed/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:15.060731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:15.060938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:15.061216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:15.093177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] MFA Rules not processed for user `1f9d7dcb12e74a1ebfb4b3f2737377ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:15.094495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:15.179323 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2981/5958] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:15.195283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:15.210626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:15.213927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:15.351032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425dab6-ae0f-4c1d-ad46-0785f5a37790 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:15.355948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:15.356582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:15.356869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:15.357149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:15.384740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:15.388294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:15.411482 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2978/5959] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:15.974192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:16.795402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:17.298439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:18.984487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:19.283220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:20.043188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:20.904928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:21.229379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:21.782782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:22.568693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:23.282840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:23.361188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:23.382152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f53a-5554-4572-a2f1-286c3a76fbd4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:23.396916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:23.399362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:23.401155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:23.401512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:23.411942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:23.589794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:23.591329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:23.613180 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2982/5960] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:24.015750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:24.259152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:25.556900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:25.819131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:26.625441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:26.916318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:27.543209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:27.548032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:27.744541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fad13-224a-4ca5-91b1-1ad01d95d677 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:27.762137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5041f8e55734ae180795b144e3ebaed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44cd7a49738b45d7ba4b65a3243c34a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:27.762873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:27.763230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:27.763573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:27.765242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:27.765640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:27.770099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:27.798485 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2979/5961] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:27.808162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:27.825518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5dc92-9b14-4c19-82a5-369a322d322e service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:27.838245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5041f8e55734ae180795b144e3ebaed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44cd7a49738b45d7ba4b65a3243c34a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:27.838245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:27.838245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:27.838566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:27.838566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:27.840948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:27.993032 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2983/5962] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:27 2022] POST /identity/v3/projects => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:27.997783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:28.014298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8d2b0-8392-4712-8c3d-ae367ca0ad91 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:28.131564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:28.135924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:28.198024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5041f8e55734ae180795b144e3ebaed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44cd7a49738b45d7ba4b65a3243c34a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:28.198669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:28.198953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:28.201728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:28.204979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:28.206261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:28.206805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:28.208688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:28.251831 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2980/5963] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:28.307449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b9d04-54d0-4cdd-bf77-3fbeae926c51 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:28.313704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:28.314547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:28.315409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:28.315409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] PATH_INFO: `/v3/users/38a9059e210e486aa34b724d5c497e5c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:28.316453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a9059e210e486aa34b724d5c497e5c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:28.319333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:28.400973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:28.581341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a9059e210e486aa34b724d5c497e5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:28.610176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a9059e210e486aa34b724d5c497e5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:28.632219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a9059e210e486aa34b724d5c497e5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:28.633182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a9059e210e486aa34b724d5c497e5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:28.634638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a9059e210e486aa34b724d5c497e5c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:28.814060 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2984/5964] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:28 2022] DELETE /identity/v3/users/38a9059e210e486aa34b724d5c497e5c => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:29.191077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:29.203782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:29.207874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:29.226482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:29.230821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:29.252784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbeae5-4a26-4257-bcfd-56150639c428 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:29.383682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2d30c-9312-4649-a4d3-c2ba19e734cd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:29.391910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5041f8e55734ae180795b144e3ebaed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44cd7a49738b45d7ba4b65a3243c34a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:29.393666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:29.395560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:29.396279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] PATH_INFO: `/v3/projects/750d44f5fca842bb879d7f04d5a0812d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:29.397966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorizing `identity:delete_project(project_id=750d44f5fca842bb879d7f04d5a0812d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:29.400153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:29.417328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2529-6099-4737-b893-24735757a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:29.420661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2529-6099-4737-b893-24735757a323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:29.420661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2529-6099-4737-b893-24735757a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:29.420661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2529-6099-4737-b893-24735757a323 admin admin] PATH_INFO: `/v3/users/a6a0649833504704915d8ee791018442` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:29.421777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed2529-6099-4737-b893-24735757a323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a0649833504704915d8ee791018442)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:29.424556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed2529-6099-4737-b893-24735757a323 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:29.704888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750d44f5fca842bb879d7f04d5a0812d', 'request_id': 'req-a53bf396-381f-4f64-9e3b-e2cd1d031f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:29.705194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a0649833504704915d8ee791018442'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:29.705651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a0649833504704915d8ee791018442'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:29.733720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750d44f5fca842bb879d7f04d5a0812d', 'request_id': 'req-a53bf396-381f-4f64-9e3b-e2cd1d031f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:29.748186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750d44f5fca842bb879d7f04d5a0812d', 'request_id': 'req-a53bf396-381f-4f64-9e3b-e2cd1d031f42'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.025363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a0649833504704915d8ee791018442'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.037041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a0649833504704915d8ee791018442'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.038445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a0649833504704915d8ee791018442'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.085488 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2981/5965] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:29 2022] DELETE /identity/v3/users/a6a0649833504704915d8ee791018442 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:30.086853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:30.088664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:30.131142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] The token cache is being invalidate because project 750d44f5fca842bb879d7f04d5a0812d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:30.131585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.133362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a53bf396-381f-4f64-9e3b-e2cd1d031f42 tempest-RoutersAdminTest-149085916 tempest-RoutersAdminTest-149085916-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.138175 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2985/5966] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:29 2022] DELETE /identity/v3/projects/750d44f5fca842bb879d7f04d5a0812d => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:30.140431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:30.142785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:30.145653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:30.202780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:30.204752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:30.232627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2529-6099-4737-b893-24735757a323 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:30.241458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:30.242426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:30.243552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:30.244081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] PATH_INFO: `/v3/projects/89c95f91e3874db2bda39bfa0b90962b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:30.245900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c95f91e3874db2bda39bfa0b90962b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:30.248426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:30.327631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:30.388849 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2986/5967] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:30.393719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:30.393719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:30.418669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c95f91e3874db2bda39bfa0b90962b', 'request_id': 'req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.428250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c95f91e3874db2bda39bfa0b90962b', 'request_id': 'req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.437121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c95f91e3874db2bda39bfa0b90962b', 'request_id': 'req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.549259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] The token cache is being invalidate because project 89c95f91e3874db2bda39bfa0b90962b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:30.550257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.554560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:30.557710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f78e-e3c2-44b8-b9dd-f0c1508a3b88 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:30.563007 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2982/5968] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:30 2022] DELETE /identity/v3/projects/89c95f91e3874db2bda39bfa0b90962b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:30.563007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:30.563534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:30.700950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:30.701588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:30.702468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:30.702822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:30.705964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:30.756145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21cd3-18e7-4916-bdb2-2da76caf6d0f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:30.768220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:30.768978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:30.769541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:30.769541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:30.775454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:30.895914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:30.932303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:30.938347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ec0-d66a-4677-8590-334af665cde0 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:30.964409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2987/5969] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:30.966775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:30.973574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:30.973574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:31.034211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:31.035829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b96c-030c-4e92-91f9-82f503e3baca service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:31.077062 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2983/5970] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:31.128483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:31.131330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:31.175865 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2988/5971] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:31.184503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:31.185832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:31.187777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:31.218172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:31.256457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:31.263076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:31.298739 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2984/5972] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:31.307960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:31.312128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:31.320212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75d2f3-b73d-493b-8e8d-60e00443a0e9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:31.326355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:31.327807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:31.328449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:31.328619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:31.329445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:31.329893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:31.332018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:31.351761 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2989/5973] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:31.356881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:31.370845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d0fbb-715b-42b6-a789-9d485868298c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:31.380633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:31.381151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:31.381649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:31.382812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:31.384803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:31.387241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:31.532745 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2985/5974] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:31 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:31.536073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:31.569564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102760-544c-4c93-b5b5-3ed9388320ed admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:31.732948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:31.734835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:31.735121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:31.735396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:31.736039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:31.738016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:31.913997 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2990/5975] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:31 2022] POST /identity/v3/users => generated 292 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:31.920941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:31.941078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324783ef-691a-499f-a9fc-8473a6bdcdbf admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:31.954623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:31.955513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:31.955513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:31.955818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:31.956593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:31.958315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:31.995272 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2986/5976] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:32.000273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:32.015271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a000-1ea7-412a-a319-b9ca03d4d915 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:32.031286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40deae-e71a-4378-850a-3342e90e7c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:32.036330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40deae-e71a-4378-850a-3342e90e7c36 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:32.041176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40deae-e71a-4378-850a-3342e90e7c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:32.041176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40deae-e71a-4378-850a-3342e90e7c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:32.041176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40deae-e71a-4378-850a-3342e90e7c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:32.041176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40deae-e71a-4378-850a-3342e90e7c36 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:32.073020 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2991/5977] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:32.078566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:32.103405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aa9e6-6a12-4929-918f-5718121fb184 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:32.120345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:32.130300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:32.131012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:32.131376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:32.131536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] PATH_INFO: `/v3/projects/1f3d88210ef349d683da9136977a9045/users/e7dd48af7ed648759108feddcae3e200/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:32.161327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:32.185650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3d88210ef349d683da9136977a9045, user_id=e7dd48af7ed648759108feddcae3e200, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:32.194242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:32.343496 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2987/5978] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:32 2022] PUT /identity/v3/projects/1f3d88210ef349d683da9136977a9045/users/e7dd48af7ed648759108feddcae3e200/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:32.350261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:32.350968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:32.350968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:32.411999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:32.416017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:32.514139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:32.514139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:32.636497 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2992/5979] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:17:32.659251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:32.668621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:32.812474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94efc9-23d6-436a-8ff2-41f2a6da3281 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:32.835018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:32.836173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:32.836744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:32.837240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] PATH_INFO: `/v3/projects/aa104329df3245cb8477ead234930fb1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:32.844537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa104329df3245cb8477ead234930fb1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:32.848548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:32.933124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf487-7c56-46af-abb9-53e3e92835d9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:32.969580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7f77-6937-4fef-8a7a-f8b3b4ce7c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:32.973404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7f77-6937-4fef-8a7a-f8b3b4ce7c65 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:32.976333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7f77-6937-4fef-8a7a-f8b3b4ce7c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:32.977086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7f77-6937-4fef-8a7a-f8b3b4ce7c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:33.036411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7f77-6937-4fef-8a7a-f8b3b4ce7c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:33.049799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7f77-6937-4fef-8a7a-f8b3b4ce7c65 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:33.120304 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2993/5980] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:33.153688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa104329df3245cb8477ead234930fb1', 'request_id': 'req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:33.164871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa104329df3245cb8477ead234930fb1', 'request_id': 'req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:33.184325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa104329df3245cb8477ead234930fb1', 'request_id': 'req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:33.291180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] The token cache is being invalidate because project aa104329df3245cb8477ead234930fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:33.291523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:33.294299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9d51bc5c-254e-4621-bb9a-aa214b92a8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:33.298249 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2988/5981] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:32 2022] DELETE /identity/v3/projects/aa104329df3245cb8477ead234930fb1 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:33.303554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:33.303922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:33.304221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:33.349037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:33.355227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:33.528773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:33.534684 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2994/5982] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:17:33.542445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:33.544830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:33.544830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:33.584917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:33.586873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:33.610309 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2989/5983] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:33.614980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:33.632069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74644a0e-6ead-4c1d-821b-ea0e7511a66e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:33.643238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:33.644016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:33.644398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:33.647448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:33.647622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:33.648164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:33.649781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:33.678254 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2995/5984] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:17:33.680028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:33.694244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4baeaa-2f13-47a7-8c99-629419b6ab0a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:33.701624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:33.702332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:33.702675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:33.702967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:33.703678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:33.706220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:33.885531 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2990/5985] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:33 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:17:33.890151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:33.908498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b5f4-8f4b-48c3-a0c4-ddeb9e86075d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:33.973570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:34.020837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:34.021498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.021787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.022099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.022827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:34.025185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:34.222565 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2996/5986] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:33 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:17:34.228922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:34.246718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722d0c6-a62a-4b11-8393-113a5d1fb622 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:34.254304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:34.255128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.255725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.256156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.257575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:34.260124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:34.274278 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2991/5987] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:34.278205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:34.291211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361c84-d7c7-4a6a-9987-9aa7f70f5c23 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:34.298487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e5de4-fcd9-43fe-b281-06f7d6bd98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:34.299344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e5de4-fcd9-43fe-b281-06f7d6bd98ff admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.299997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e5de4-fcd9-43fe-b281-06f7d6bd98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.300448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e5de4-fcd9-43fe-b281-06f7d6bd98ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.301364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e5de4-fcd9-43fe-b281-06f7d6bd98ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:34.303978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e5de4-fcd9-43fe-b281-06f7d6bd98ff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:34.319462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2997/5988] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:17:34.325539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:34.347547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a85b1-6d84-49bf-a380-11ad1e4ebeef admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:34.353431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:34.360511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.360511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.360511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] PATH_INFO: `/v3/projects/1961709682a04c8f9f56d60a1a5330aa/users/8b324fee7ec94fd4926fc95f2ad954ac/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.376329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1961709682a04c8f9f56d60a1a5330aa, user_id=8b324fee7ec94fd4926fc95f2ad954ac, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:34.379782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:34.489314 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2992/5989] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:34 2022] PUT /identity/v3/projects/1961709682a04c8f9f56d60a1a5330aa/users/8b324fee7ec94fd4926fc95f2ad954ac/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:34.492716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.493242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.493515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.538558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] MFA Rules not processed for user `8b324fee7ec94fd4926fc95f2ad954ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:34.540286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:34.647612 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2998/5990] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:34.659900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:34.662257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:34.802779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d9ddc-ea4d-45a2-adea-1b1bae44b5ac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:34.807434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b39d29-6907-448d-9119-a495493c78c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:34.808080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39d29-6907-448d-9119-a495493c78c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.808366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39d29-6907-448d-9119-a495493c78c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.808647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39d29-6907-448d-9119-a495493c78c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.828042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b39d29-6907-448d-9119-a495493c78c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:34.829613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b39d29-6907-448d-9119-a495493c78c8 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:34.841035 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2993/5991] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:34.964554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:34.968235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:34.969342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:35.007578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a540b-e219-4839-b661-fb3000128e1e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:35.022542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:35.024385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:35.025513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:35.026787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:35.035944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:35.209889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:35.213187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:35.266788 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 2999/5992] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:35.297713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:37.150885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:37.297230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:38.260085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579bf6-f6bb-4516-b5a2-7263ec56c0ef None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:38.261298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579bf6-f6bb-4516-b5a2-7263ec56c0ef None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:38.261769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579bf6-f6bb-4516-b5a2-7263ec56c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:38.353271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f9579bf6-f6bb-4516-b5a2-7263ec56c0ef None None] MFA Rules not processed for user `8b324fee7ec94fd4926fc95f2ad954ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:38.360656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f9579bf6-f6bb-4516-b5a2-7263ec56c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:38.386636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2994/5993] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:17:38.836992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:39.763231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:40.941043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:42.085897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:43.351391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:43.644623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:43.647438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:43.786726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee2d9-3f23-4bfd-991b-a703c235c462 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:43.816942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:43.818131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:43.818570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:43.818923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] PATH_INFO: `/v3/users/23a3973060cc4d69981c44437f7f170a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:43.820500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a3973060cc4d69981c44437f7f170a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:43.822675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:44.330606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a3973060cc4d69981c44437f7f170a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:44.406901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a3973060cc4d69981c44437f7f170a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:44.435332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a3973060cc4d69981c44437f7f170a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:44.436814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a3973060cc4d69981c44437f7f170a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:44.437791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a3973060cc4d69981c44437f7f170a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:44.553708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3000/5994] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:43 2022] DELETE /identity/v3/users/23a3973060cc4d69981c44437f7f170a => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:44.563649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:44.563649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:44.564299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:44.614569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:44.620460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:44.793540 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2995/5995] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:44.990380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:44.994891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:45.192987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4c4a3-6e89-4b91-bea1-3b4e1a4c131a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:45.197720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:45.198629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:45.199011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:45.199385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:45.212961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:45.214712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:45.228485 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3001/5996] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:45.475091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:45.993226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:45.994971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:46.010945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe459db2-6169-4431-b90d-7cafcb65fade None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:46.024286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:46.025384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:46.026390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:46.026951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] PATH_INFO: `/v3/projects/0338ca58862347b5928f25caec0dabfb` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:46.028775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0338ca58862347b5928f25caec0dabfb)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:46.032112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:46.190652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0338ca58862347b5928f25caec0dabfb', 'request_id': 'req-09bc2d14-441b-4609-95c5-70a6c709dd75'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:46.212592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0338ca58862347b5928f25caec0dabfb', 'request_id': 'req-09bc2d14-441b-4609-95c5-70a6c709dd75'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:46.212592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0338ca58862347b5928f25caec0dabfb', 'request_id': 'req-09bc2d14-441b-4609-95c5-70a6c709dd75'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:46.277561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] The token cache is being invalidate because project 0338ca58862347b5928f25caec0dabfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:46.277968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:46.279142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:46.291855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:46.293420 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2996/5997] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:45 2022] DELETE /identity/v3/projects/0338ca58862347b5928f25caec0dabfb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:46.308667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7246089-6e95-45c1-a93c-73e020833f48 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:46.337084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:46.339955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:46.458580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:46.461937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:46.463448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:46.465017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] PATH_INFO: `/v3/users/d60c0f7e0fe349a0b6a27a37595c6cc5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:46.468272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60c0f7e0fe349a0b6a27a37595c6cc5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:46.474438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:46.497965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2d14-441b-4609-95c5-70a6c709dd75 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:46.508306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:46.510136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:46.512017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:46.512700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:46.518933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:46.550343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:46.754924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:46.756988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:46.781908 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2997/5998] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:46.783564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:46.785392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:46.997622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60c0f7e0fe349a0b6a27a37595c6cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:47.030810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0b3a6-5a3c-40ee-8190-6a0a119b4a4f service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:47.067818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:47.068493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:47.068781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:47.069062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:47.082182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:47.091373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60c0f7e0fe349a0b6a27a37595c6cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:47.117174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60c0f7e0fe349a0b6a27a37595c6cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:47.122097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60c0f7e0fe349a0b6a27a37595c6cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:47.125584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60c0f7e0fe349a0b6a27a37595c6cc5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:47.180436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:47.182344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:47.230083 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3002/5999] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:46 2022] DELETE /identity/v3/users/d60c0f7e0fe349a0b6a27a37595c6cc5 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:47.267352 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2998/6000] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:47.469974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:48.361443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:48.919507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:48.921530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:49.077134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebaa83-e53a-4df2-a440-7bf6cf68dde1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:49.082116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:49.082770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:49.083051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:49.083506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] PATH_INFO: `/v3/projects/52cfc216d5cd429b88a159c0fa464a44` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:49.084599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cfc216d5cd429b88a159c0fa464a44)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:49.086688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:49.299153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cfc216d5cd429b88a159c0fa464a44', 'request_id': 'req-5ae9f9e7-1893-4129-b065-a32a37adda78'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:49.313282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cfc216d5cd429b88a159c0fa464a44', 'request_id': 'req-5ae9f9e7-1893-4129-b065-a32a37adda78'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:49.327128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cfc216d5cd429b88a159c0fa464a44', 'request_id': 'req-5ae9f9e7-1893-4129-b065-a32a37adda78'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:49.509435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] The token cache is being invalidate because project 52cfc216d5cd429b88a159c0fa464a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:49.510430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:49.512105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:49.522759 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3003/6001] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:48 2022] DELETE /identity/v3/projects/52cfc216d5cd429b88a159c0fa464a44 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:49.538161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:49.538161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:49.565167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8c332-6e90-4ea0-a5f2-4ac559676c7f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:49.688023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:49.745893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:49.746959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:49.747615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:49.748902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] PATH_INFO: `/v3/users/36a996058c1d4b0e930792d4fc64a14d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:49.750610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a996058c1d4b0e930792d4fc64a14d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:49.754114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:49.779506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:50.042927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a996058c1d4b0e930792d4fc64a14d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:50.050482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a996058c1d4b0e930792d4fc64a14d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:50.173876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a996058c1d4b0e930792d4fc64a14d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:50.189415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a996058c1d4b0e930792d4fc64a14d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:50.190434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72086939-b521-4504-a644-e9ef62225654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a996058c1d4b0e930792d4fc64a14d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:50.249072 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 2999/6002] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:49 2022] DELETE /identity/v3/users/36a996058c1d4b0e930792d4fc64a14d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:50.987614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:50.991319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.030991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217877e-bf0a-4adb-b3ca-572e0b9469e9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.032316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217877e-bf0a-4adb-b3ca-572e0b9469e9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.033094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217877e-bf0a-4adb-b3ca-572e0b9469e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.047943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f9e7-1893-4129-b065-a32a37adda78 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:51.138860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9217877e-bf0a-4adb-b3ca-572e0b9469e9 None None] MFA Rules not processed for user `e7dd48af7ed648759108feddcae3e200`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:51.144858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9217877e-bf0a-4adb-b3ca-572e0b9469e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.200020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:51.200958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.201323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.201612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] PATH_INFO: `/v3/projects/147908f7ac0d4eb3af9c484731deed28` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.203116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147908f7ac0d4eb3af9c484731deed28)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:51.205369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:51.345091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3000/6003] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:51.364849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.368898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.368898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.406709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147908f7ac0d4eb3af9c484731deed28', 'request_id': 'req-4e5da79c-2913-4dd3-a489-a744c34c81b1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:51.417554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147908f7ac0d4eb3af9c484731deed28', 'request_id': 'req-4e5da79c-2913-4dd3-a489-a744c34c81b1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:51.447103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147908f7ac0d4eb3af9c484731deed28', 'request_id': 'req-4e5da79c-2913-4dd3-a489-a744c34c81b1'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:51.454868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] MFA Rules not processed for user `e7dd48af7ed648759108feddcae3e200`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:51.461734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.533207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] The token cache is being invalidate because project 147908f7ac0d4eb3af9c484731deed28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:17:51.533781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:51.535092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4e5da79c-2913-4dd3-a489-a744c34c81b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:17:51.542652 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3004/6004] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:17:50 2022] DELETE /identity/v3/projects/147908f7ac0d4eb3af9c484731deed28 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:17:51.544526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cd92-eb67-435b-a653-dd5d087b2a32 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.545378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cd92-eb67-435b-a653-dd5d087b2a32 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.545714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cd92-eb67-435b-a653-dd5d087b2a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.575949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8312cd92-eb67-435b-a653-dd5d087b2a32 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:51.579031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8312cd92-eb67-435b-a653-dd5d087b2a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.629675 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3001/6005] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:51.642871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:51.646176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.727839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=1,keystone:DELETE=10,keystone:SELECT=89 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:51.783692 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3005/6006] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:51.785125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab437-430f-4031-aaab-24949799846a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.788087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab437-430f-4031-aaab-24949799846a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.789423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab437-430f-4031-aaab-24949799846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.834515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e010cf5-a1b7-4c3f-a70d-ae8206e36cd5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:51.839379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-33aab437-430f-4031-aaab-24949799846a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:51.841005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-33aab437-430f-4031-aaab-24949799846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.850060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:51.851273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.852246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.852858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.852981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:51.855953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:51.864681 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3006/6007] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:51.865546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab437-430f-4031-aaab-24949799846a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:51.877082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab437-430f-4031-aaab-24949799846a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:51.886594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:51.887294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.892914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.892914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.892914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:17:51.892914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:51.900043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:51.908743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:51.914302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:51.927883 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3007/6008] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:17:51.930798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:51.957156 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3002/6009] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:51.974570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8803d-b247-4180-aca1-767fef973bcc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:51.991977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:51.992926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.993221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.994639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.996033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:52.008209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:52.321156 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3008/6010] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:51 2022] POST /identity/v3/projects => generated 367 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:52.322557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:52.346281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd15ec-452f-45c7-8666-9286fec8bedb service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:52.439896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:52.440780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:52.441147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:52.441591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:52.442359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:52.444366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:52.497472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:52.500417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:52.586410 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3003/6011] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:52 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:52.594832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:52.620048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e976-58f2-457e-baf6-19157692754b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:52.628195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a36a94-e52c-4299-91eb-34943ec73ccb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:52.639124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:52.639367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:52.642390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:52.642390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:52.642390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:52.643100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:52.643415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:52.643692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:52.644916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:52.654779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:52.656610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:52.676649 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3004/6012] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:52.682030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:52.695426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4a69f-3f87-43ab-bf6b-c3376e74187e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:52.706208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:52.714279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:52.714279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:52.714279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:52.714279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:52.714279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:52.730471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3005/6013] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:52.735312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:52.751758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545d5b-1781-4c7d-93eb-ba0a7297f395 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:52.761905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:52.763082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:52.764390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:52.764390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] PATH_INFO: `/v3/projects/ea8c490a8fd3465b9bb3b6a5c8948986/users/6215f668dc8f4ac6a605a06c1923e194/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:52.787932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8c490a8fd3465b9bb3b6a5c8948986, user_id=6215f668dc8f4ac6a605a06c1923e194, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:52.788954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:52.790468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8e516-c4d9-4206-86d5-55af65252664 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:52.791636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:52.803424 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3009/6014] 10.222.0.78 () {60 vars in 1396 bytes} [Sun Aug 28 20:17:52 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:52.906182 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3006/6015] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:52 2022] PUT /identity/v3/projects/ea8c490a8fd3465b9bb3b6a5c8948986/users/6215f668dc8f4ac6a605a06c1923e194/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:52.917326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:52.917617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:52.917951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:52.965835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] MFA Rules not processed for user `6215f668dc8f4ac6a605a06c1923e194`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:52.967183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:53.061263 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3010/6016] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:53.062514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:53.193349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ab339-b1a3-4e1c-88dc-d719eb9686ea admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:53.207549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:53.208160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:53.208446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:53.217972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:53.221168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:53.221168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:53.355744 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3007/6017] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:17:53 2022] POST /identity/v3/projects => generated 369 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:17:53.360163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:53.382097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256705e-7f88-4b54-97fe-9247cf5eba05 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:53.506999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:53.507704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:53.507997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:53.509457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:53.509792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:53.512071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:53.680544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3011/6018] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:17:53 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:17:53.684699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:53.711261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b6b5-8da9-4326-b7e8-b1fd657548bc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:53.727109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:53.734704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:53.735429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:53.735790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:53.736607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:53.738516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:53.767347 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3008/6019] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:53.768937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:53.786099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d390-99d0-40e7-be10-514ac8df500e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:53.798131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:53.798744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:53.799308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:53.799594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] PATH_INFO: `/v3/projects/c93250799b36409d8107bcf2a3e90f7d/users/db847ede0e544469ba572897a60618b9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:53.839977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93250799b36409d8107bcf2a3e90f7d, user_id=db847ede0e544469ba572897a60618b9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:53.843623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:54.301300 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3012/6020] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:53 2022] PUT /identity/v3/projects/c93250799b36409d8107bcf2a3e90f7d/users/db847ede0e544469ba572897a60618b9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:54.311124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:54.311124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6680f-88ff-4fc7-87a1-950108ceae55 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:54.311124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028daa-0ad5-43cf-9400-649b25d7b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:54.311124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028daa-0ad5-43cf-9400-649b25d7b21d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:54.312001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028daa-0ad5-43cf-9400-649b25d7b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:54.312001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028daa-0ad5-43cf-9400-649b25d7b21d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:54.312001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0028daa-0ad5-43cf-9400-649b25d7b21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:54.312001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0028daa-0ad5-43cf-9400-649b25d7b21d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:54.312001 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3009/6021] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:17:54.312897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:54.312897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259366b-d0c4-4722-9cc0-b226371a20b2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:54.312897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:54.312897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:54.313797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:54.313797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] PATH_INFO: `/v3/projects/c93250799b36409d8107bcf2a3e90f7d/users/db847ede0e544469ba572897a60618b9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:54.315113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93250799b36409d8107bcf2a3e90f7d, user_id=db847ede0e544469ba572897a60618b9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:54.328841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:54.333498 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3013/6022] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:17:54 2022] PUT /identity/v3/projects/c93250799b36409d8107bcf2a3e90f7d/users/db847ede0e544469ba572897a60618b9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:17:54.344955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:54.346243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:54.346243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:54.423704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] MFA Rules not processed for user `db847ede0e544469ba572897a60618b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:54.430496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:54.538695 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3010/6023] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:17:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:54.546493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:54.553373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:54.795970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:54.870585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d10f1b-4d4c-434f-b678-444470b5b547 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:54.881405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af2763-6e81-4345-b558-118bee238779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:54.883397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af2763-6e81-4345-b558-118bee238779 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:54.883685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af2763-6e81-4345-b558-118bee238779 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:54.883958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af2763-6e81-4345-b558-118bee238779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:54.948209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af2763-6e81-4345-b558-118bee238779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:54.949741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af2763-6e81-4345-b558-118bee238779 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:54.979532 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3014/6024] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:55.269763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:58.989340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:59.762174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:59.843142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b95bd-7c95-4a20-b082-affa401febfc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:59.847902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:59.848569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:59.848907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:59.849185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] PATH_INFO: `/v3/users/6215f668dc8f4ac6a605a06c1923e194` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:59.850422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] RBAC: Authorizing `identity:delete_user(user_id=6215f668dc8f4ac6a605a06c1923e194)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:59.852403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:00.366654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6215f668dc8f4ac6a605a06c1923e194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:00.368042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6215f668dc8f4ac6a605a06c1923e194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:00.541764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6215f668dc8f4ac6a605a06c1923e194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:00.574984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6215f668dc8f4ac6a605a06c1923e194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:00.576539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6215f668dc8f4ac6a605a06c1923e194'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:00.661499 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3011/6025] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:17:59 2022] DELETE /identity/v3/users/6215f668dc8f4ac6a605a06c1923e194 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:00.662172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa63e-5518-40c0-95a9-6f4d188b4df4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:00.663103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa63e-5518-40c0-95a9-6f4d188b4df4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:00.663807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa63e-5518-40c0-95a9-6f4d188b4df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:00.722240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-419aa63e-5518-40c0-95a9-6f4d188b4df4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:00.722240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-419aa63e-5518-40c0-95a9-6f4d188b4df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:00.906873 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3015/6026] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:00.931218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:00.932959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:00.962451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:01.044270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0592b6-81b7-47fc-b686-1665b29704db admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:01.049018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:01.050005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:01.050513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:01.051033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:01.062505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:01.066503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:01.078944 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3012/6027] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:01.127700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:02.319763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:02.320782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:02.321269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:02.368814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:02.371359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:02.519828 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3016/6028] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:18:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:02.763904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:02.766249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:02.937196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fa232-bad1-436f-86c8-d9e4d40abd55 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:02.951636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:02.952304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:02.952584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:02.953448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:02.995125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:02.996769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:03.024857 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3013/6029] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:18:03.176244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:03.178025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:03.213113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9f394-9e7e-486a-b582-a18c6fede20a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:03.239658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:03.240331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:03.240617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:03.240895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] PATH_INFO: `/v3/projects/ea8c490a8fd3465b9bb3b6a5c8948986` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:03.250860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8c490a8fd3465b9bb3b6a5c8948986)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:03.253025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:03.594671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8c490a8fd3465b9bb3b6a5c8948986', 'request_id': 'req-6d29417b-f2d8-49e7-9f66-afbab88ff1df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:03.602440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8c490a8fd3465b9bb3b6a5c8948986', 'request_id': 'req-6d29417b-f2d8-49e7-9f66-afbab88ff1df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:03.611033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8c490a8fd3465b9bb3b6a5c8948986', 'request_id': 'req-6d29417b-f2d8-49e7-9f66-afbab88ff1df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:03.956300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] The token cache is being invalidate because project ea8c490a8fd3465b9bb3b6a5c8948986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:18:03.956723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:03.959092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d29417b-f2d8-49e7-9f66-afbab88ff1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:03.968414 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3017/6030] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:18:03 2022] DELETE /identity/v3/projects/ea8c490a8fd3465b9bb3b6a5c8948986 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:03.974414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:03.999672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fd5f5-7c00-4b69-bc13-ca8ba5927202 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:04.227606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:04.228194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:04.228476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:04.228865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] PATH_INFO: `/v3/users/db847ede0e544469ba572897a60618b9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:04.230424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=db847ede0e544469ba572897a60618b9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:04.232441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:04.649592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db847ede0e544469ba572897a60618b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:04.651372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db847ede0e544469ba572897a60618b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:04.791295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db847ede0e544469ba572897a60618b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:04.805086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db847ede0e544469ba572897a60618b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:04.805086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db847ede0e544469ba572897a60618b9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:04.862164 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3014/6031] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:18:03 2022] DELETE /identity/v3/users/db847ede0e544469ba572897a60618b9 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:05.337689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:05.817024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:05.817770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:05.818087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:05.818369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:05.896918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:05.899117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:06.022224 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3018/6032] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:06.068422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:06.070065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:06.307000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72414a24-4718-42b5-a03c-49470e7ee9aa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:06.324235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36d33a-b3f7-4b93-b310-54b35d213a1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:06.324875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d33a-b3f7-4b93-b310-54b35d213a1e service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:06.325971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d33a-b3f7-4b93-b310-54b35d213a1e service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:06.326499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d33a-b3f7-4b93-b310-54b35d213a1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:06.338079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36d33a-b3f7-4b93-b310-54b35d213a1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:06.341053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36d33a-b3f7-4b93-b310-54b35d213a1e service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:06.364318 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3015/6033] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:18:06.870900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:06.873293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:07.109925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273f54-ea25-4da4-ba55-3f79464c4caf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:07.125722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:07.126418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:07.126701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:07.126978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] PATH_INFO: `/v3/projects/c93250799b36409d8107bcf2a3e90f7d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:07.128777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93250799b36409d8107bcf2a3e90f7d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:07.134064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:07.372011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93250799b36409d8107bcf2a3e90f7d', 'request_id': 'req-22074566-e893-483f-9dc9-2278d67d387b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:07.397533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93250799b36409d8107bcf2a3e90f7d', 'request_id': 'req-22074566-e893-483f-9dc9-2278d67d387b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:07.411167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93250799b36409d8107bcf2a3e90f7d', 'request_id': 'req-22074566-e893-483f-9dc9-2278d67d387b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:07.551117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] The token cache is being invalidate because project c93250799b36409d8107bcf2a3e90f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:18:07.551537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:07.552370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22074566-e893-483f-9dc9-2278d67d387b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:07.555090 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3019/6034] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:18:06 2022] DELETE /identity/v3/projects/c93250799b36409d8107bcf2a3e90f7d => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:07.560091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:07.560639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:07.561022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:07.603398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:07.607064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:07.738679 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3016/6035] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:07.748203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:07.748784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:07.749265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:07.775406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:07.777672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:07.788478 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3020/6036] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:07.793536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:07.804969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b44dba-fd8d-40a8-97ad-86e8398f6a43 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:07.811269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:07.812227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:07.814054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:07.814054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:07.814054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:18:07.814054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:07.816190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074d68d-319a-4eec-b663-2f67e240b76a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:07.857602 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3017/6037] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:18:07.862483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:07.876492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9a349-7a33-4da9-bdf7-99858fe960ef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:07.888368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:07.889560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:07.890312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:07.891789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:07.892628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:07.897563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:08.176004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:08.176651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:08.177184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:08.202523 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3021/6038] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:18:07 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:08.205955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:08.220951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:08.223049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:08.362895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:08.419697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6c39-6607-430a-a51a-ee6a000c17e2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:08.431607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:08.433525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:08.435448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:08.438623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:08.440264 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3018/6039] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:18:08.448401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:08.452271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:08.460503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:08.462248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:08.625050 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3022/6040] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:18:08 2022] POST /identity/v3/users => generated 289 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:08.626402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:08.640239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722622c7-0916-4ad4-9fc9-ba5252e69195 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:08.658420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:08.659401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:08.659856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:08.660309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:08.666707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9f2e-b8f8-46fb-b03d-cef74c751643 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:08.704215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:08.705253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:08.707478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:08.708109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:08.709076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:08.719771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:08.719934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:08.720025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:08.726120 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3023/6041] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:08.730010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:08.737543 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3019/6042] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:18:08.752705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0238f-1813-4d77-adf4-e4cb8aeef64c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:08.763429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabd4d5-fd1a-4617-abae-e25279ba6ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:08.764004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabd4d5-fd1a-4617-abae-e25279ba6ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:08.764478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabd4d5-fd1a-4617-abae-e25279ba6ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:08.783799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabd4d5-fd1a-4617-abae-e25279ba6ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:08.786338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabd4d5-fd1a-4617-abae-e25279ba6ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:08.793606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabd4d5-fd1a-4617-abae-e25279ba6ca7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:08.798084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:08.821133 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3024/6043] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:08.826572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:08.873576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4886-d14c-4ea4-ab9e-62632b958f3a service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:08.919255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:08.919973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:08.920296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:08.920597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] PATH_INFO: `/v3/projects/1862ae3dd69d4435abe9cbff41e56409/users/8d0cbea10090462da00ba3f884bb4006/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:08.998893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1862ae3dd69d4435abe9cbff41e56409, user_id=8d0cbea10090462da00ba3f884bb4006, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:09.006907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:09.157558 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3020/6044] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:18:08 2022] PUT /identity/v3/projects/1862ae3dd69d4435abe9cbff41e56409/users/8d0cbea10090462da00ba3f884bb4006/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:09.179165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:09.179968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:09.179968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:09.300167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] MFA Rules not processed for user `8d0cbea10090462da00ba3f884bb4006`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:09.308282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:09.555444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:09.584242 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3025/6045] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:09.846825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577c15-44a5-474d-8e4c-e435c51a622e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:09.868867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c31ece-f64e-4400-a0c6-3d47d7efb0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:09.870183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c31ece-f64e-4400-a0c6-3d47d7efb0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:09.870634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c31ece-f64e-4400-a0c6-3d47d7efb0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:09.871072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c31ece-f64e-4400-a0c6-3d47d7efb0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:09.871896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c31ece-f64e-4400-a0c6-3d47d7efb0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:09.876859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c31ece-f64e-4400-a0c6-3d47d7efb0d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:10.074830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:10.084687 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3021/6046] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:18:09 2022] POST /identity/v3/projects => generated 373 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:10.094816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d1989-9d80-4673-a6dc-a975e2b9c143 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:10.297280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:10.298678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:10.299070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:10.300318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:10.301082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:10.306368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:10.349766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:10.350082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:10.350696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:10.432157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:10.440227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:10.488688 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3026/6047] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:18:10 2022] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:18:10.495296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:10.537681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35f483-f690-4a8b-8b4f-b9ee99ac29d9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:10.569248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:10.573209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:10.577506 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3022/6048] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:18:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:10.578854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:10.579095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:10.579814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:10.581480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:10.631339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:10.635762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3027/6049] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:18:10.661091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad176-8f50-4e05-942c-4d1cc30d7001 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:10.662587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:10.670817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:10.671993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:10.672536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:10.673054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] PATH_INFO: `/v3/projects/bdf71dc037a942c2adee45509fdf5b74/users/b65a854f4ad84f13a78d8cc476858171/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:10.708238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf71dc037a942c2adee45509fdf5b74, user_id=b65a854f4ad84f13a78d8cc476858171, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:10.727151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:10.877342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c9a2f-30eb-4921-b2c9-04a0e1f700c1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:10.894798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460572-c25f-4424-918d-47af579296e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:10.895809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460572-c25f-4424-918d-47af579296e5 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:10.896334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460572-c25f-4424-918d-47af579296e5 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:10.896783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460572-c25f-4424-918d-47af579296e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:10.906997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460572-c25f-4424-918d-47af579296e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:10.909219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460572-c25f-4424-918d-47af579296e5 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:10.941117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3028/6050] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:18:11.027170 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3023/6051] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:18:10 2022] PUT /identity/v3/projects/bdf71dc037a942c2adee45509fdf5b74/users/b65a854f4ad84f13a78d8cc476858171/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:11.034907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460572-c25f-4424-918d-47af579296e5 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:11.053764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460572-c25f-4424-918d-47af579296e5 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:11.210422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0d47f-3133-48bd-b6f5-e885d2779ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:11.212110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0d47f-3133-48bd-b6f5-e885d2779ece admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:11.212851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0d47f-3133-48bd-b6f5-e885d2779ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:11.213580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0d47f-3133-48bd-b6f5-e885d2779ece admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:11.220967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0d47f-3133-48bd-b6f5-e885d2779ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:11.223211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0d47f-3133-48bd-b6f5-e885d2779ece admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:11.252067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3029/6052] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:11.257063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:11.277193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95209ff-996d-4383-98b5-9b6f4ce5db76 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:11.286834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:11.288404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:11.289027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:11.289557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] PATH_INFO: `/v3/projects/bdf71dc037a942c2adee45509fdf5b74/users/b65a854f4ad84f13a78d8cc476858171/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:11.298803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:11.300280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf71dc037a942c2adee45509fdf5b74, user_id=b65a854f4ad84f13a78d8cc476858171, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:11.303285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:11.341966 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3024/6053] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:18:11 2022] PUT /identity/v3/projects/bdf71dc037a942c2adee45509fdf5b74/users/b65a854f4ad84f13a78d8cc476858171/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:11.350258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3b0d-fe46-4105-b8e9-c967efc42d1d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:11.356836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3b0d-fe46-4105-b8e9-c967efc42d1d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:11.357236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3b0d-fe46-4105-b8e9-c967efc42d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:11.402435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b2dd3b0d-fe46-4105-b8e9-c967efc42d1d None None] MFA Rules not processed for user `b65a854f4ad84f13a78d8cc476858171`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:11.404526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b2dd3b0d-fe46-4105-b8e9-c967efc42d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:11.486237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:11.601596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3030/6054] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:11.615843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:11.617821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:11.935475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ac72-babe-48bb-9d29-c90bfce389b5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:11.963975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:11.972594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:11.973107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:11.974382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:12.005147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:12.006722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:12.053677 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3025/6055] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:12.081292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:12.228092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:12.228377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:12.229064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:12.262829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:12.264943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:12.399108 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3031/6056] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:18:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:12.421391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:12.625948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6e4f0-f396-4475-8aba-b2126c99477a service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:12.635664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9643ad8-c63e-45dc-ae70-7a7a1cf86131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:12.636676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643ad8-c63e-45dc-ae70-7a7a1cf86131 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:12.638553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643ad8-c63e-45dc-ae70-7a7a1cf86131 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:12.642261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643ad8-c63e-45dc-ae70-7a7a1cf86131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:12.651278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9643ad8-c63e-45dc-ae70-7a7a1cf86131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:12.653845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9643ad8-c63e-45dc-ae70-7a7a1cf86131 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:12.668700 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3026/6057] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:18:12.900779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:13.170066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:13.925649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:14.302130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:15.138105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:15.947076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:16.302681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:17.068329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:17.165696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:18.452467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:19.334626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:19.531480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:20.743922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:20.806929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:21.552924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:21.555594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:21.852613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae321d0-c2f9-42d2-9c65-a64b0e3d6669 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:21.859226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:21.859890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:21.860172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:21.866318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] PATH_INFO: `/v3/users/8b324fee7ec94fd4926fc95f2ad954ac` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:21.868030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b324fee7ec94fd4926fc95f2ad954ac)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:21.870329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:22.745473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:22.785146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b324fee7ec94fd4926fc95f2ad954ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:22.839082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b324fee7ec94fd4926fc95f2ad954ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:22.854412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b324fee7ec94fd4926fc95f2ad954ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:22.857942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b324fee7ec94fd4926fc95f2ad954ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:22.861323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b324fee7ec94fd4926fc95f2ad954ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:23.036745 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3032/6058] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:18:21 2022] DELETE /identity/v3/users/8b324fee7ec94fd4926fc95f2ad954ac => generated 0 bytes in 1480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:23.038012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:23.038655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:23.038655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:23.066112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:23.067610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:23.151646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3027/6059] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:18:23.161988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:23.163911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:23.245154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:23.258458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad382b9-3ce1-4595-bb24-8aea4529e9aa admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:23.262265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71354d-36b5-4011-aec1-9d327a3d1942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:23.262931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71354d-36b5-4011-aec1-9d327a3d1942 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:23.263218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71354d-36b5-4011-aec1-9d327a3d1942 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:23.263497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71354d-36b5-4011-aec1-9d327a3d1942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:23.276224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71354d-36b5-4011-aec1-9d327a3d1942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:23.278447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71354d-36b5-4011-aec1-9d327a3d1942 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:23.302804 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3033/6060] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:18:23.690468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:24.313889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:24.316156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:24.358417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9027a82-717c-490f-a900-2b8d401415a7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:24.379393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:24.381110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:24.381638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:24.382224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] PATH_INFO: `/v3/projects/1961709682a04c8f9f56d60a1a5330aa` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:24.383892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1961709682a04c8f9f56d60a1a5330aa)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:24.387262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:24.558252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1961709682a04c8f9f56d60a1a5330aa', 'request_id': 'req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:24.577973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1961709682a04c8f9f56d60a1a5330aa', 'request_id': 'req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:24.587346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:24.596519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1961709682a04c8f9f56d60a1a5330aa', 'request_id': 'req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:24.812543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] The token cache is being invalidate because project 1961709682a04c8f9f56d60a1a5330aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:18:24.812880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:24.813569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-66f6d936-ec64-4b6c-82fb-315fbb2c1be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:24.815417 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3028/6061] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:18:24 2022] DELETE /identity/v3/projects/1961709682a04c8f9f56d60a1a5330aa => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:24.821441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:24.822418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:24.822890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:24.867613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:24.878786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:24.971773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:24.972428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:24.972943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:24.975038 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3034/6062] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:25.001289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:25.006739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:25.022068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:25.037777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19e39-d734-4018-b16e-e8708f090faf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:25.038137 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3029/6063] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:25.046677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:25.047610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:25.048073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:25.048539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:25.049667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:18:25.050184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:25.056193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:25.068435 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3035/6064] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:18:25.073314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:25.094222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eef66-4fce-48e6-ba44-9de09088eb45 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:25.102720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:25.103336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:25.107341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:25.118468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:25.118468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:25.118468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:25.186832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:25.320925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:25.328952 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3030/6065] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:18:25 2022] POST /identity/v3/projects => generated 391 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:25.339480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ed24-5a4b-4ad8-9c7e-0d45a1bb4634 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:25.432342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:25.432985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:25.433335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:25.433681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:25.434516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:25.436670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:25.610444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3036/6066] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:18:25 2022] POST /identity/v3/users => generated 296 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:25.612297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:25.632447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9f241-9f37-4d8b-afef-628def60b12e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:25.648341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:25.648341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:25.648341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:25.648341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:25.650111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:25.651733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:25.672497 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3031/6067] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:25.673885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:25.687889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bfd93-3307-430b-94b6-50b162eb8bc9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:25.699016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b8857-26b6-404c-8141-e7cab554a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:25.700607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b8857-26b6-404c-8141-e7cab554a22f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:25.701127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b8857-26b6-404c-8141-e7cab554a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:25.701578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b8857-26b6-404c-8141-e7cab554a22f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:25.702606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b8857-26b6-404c-8141-e7cab554a22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:25.704955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b8857-26b6-404c-8141-e7cab554a22f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:25.725808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3037/6068] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:25.727245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:25.745723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00596a5-ffdf-4e7f-9bf0-cc7576bcb1fe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:25.756835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:25.758077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:25.758723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:25.759181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] PATH_INFO: `/v3/projects/ed8f2083dea94eaf996a7d601d36c5cb/users/adf2e87bb1204bb4880b6c0306b31a95/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:25.836203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8f2083dea94eaf996a7d601d36c5cb, user_id=adf2e87bb1204bb4880b6c0306b31a95, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:25.846582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:25.992048 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3032/6069] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:18:25 2022] PUT /identity/v3/projects/ed8f2083dea94eaf996a7d601d36c5cb/users/adf2e87bb1204bb4880b6c0306b31a95/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:26.008181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:26.008776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:26.008776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:26.114293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] MFA Rules not processed for user `adf2e87bb1204bb4880b6c0306b31a95`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:26.115668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:26.335763 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3038/6070] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:26.348011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:26.355478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:26.474516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:26.553547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f28f4-72cd-48b7-9915-e2f1be5fda9b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:26.573958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:26.574653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:26.574939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:26.575219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:26.599489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:26.600892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:26.631385 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3033/6071] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:26.971502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:28.747425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:29.230030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:29.232172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:29.452433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9438-a108-4f7b-b455-bd93bafc607d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:29.462803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:29.463454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:29.463798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:29.465102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:29.472252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:29.503948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:29.505535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:29.541421 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3039/6072] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:29.591704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:30.280377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=15,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:31.186468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:31.397533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:32.606920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:32.744817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:32.755508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:32.832975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd9f0f-26b7-49b3-8faf-457c3808e6cb service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:32.838466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65a854f4ad84f13a78d8cc476858171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf71dc037a942c2adee45509fdf5b74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:32.839109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:32.839438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:32.840171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:32.841735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:18:32.842312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:32.844111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:32.858344 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3034/6073] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:18:32.862418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:32.863118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:32.877155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8276a7-d151-4b0f-aab6-31499e328237 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:32.883369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65a854f4ad84f13a78d8cc476858171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf71dc037a942c2adee45509fdf5b74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:32.884318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:32.884771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:32.885257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:32.886153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:32.889026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:32.992697 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3040/6074] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:18:32 2022] POST /identity/v3/projects => generated 347 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:32.996814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:33.013912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6d8f4-9f45-4c0f-81f1-0b3400779f7b tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:33.154105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65a854f4ad84f13a78d8cc476858171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf71dc037a942c2adee45509fdf5b74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:33.154804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:33.155278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:33.155714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:33.156590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:18:33.157303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:33.161557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:33.184133 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3035/6075] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:18:33.916222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:33.983159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:34.545877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:34.696666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:34.698907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:34.789126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0204-e73b-4dca-8421-ce727a55eb2c tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:34.796958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:34.798010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:34.799013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:34.799496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:34.801629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:34.889680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:34.892525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:34.914315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3041/6076] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:18:34.997702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:35.019032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e15fec-fb65-4e49-a6cc-a8e035def3b6 tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:35.033446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65a854f4ad84f13a78d8cc476858171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdf71dc037a942c2adee45509fdf5b74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:35.033446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:35.033446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:35.034237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] PATH_INFO: `/v3/projects/c792ddb2de2a4f1bab7b0bead10c32ca` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:35.034237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c792ddb2de2a4f1bab7b0bead10c32ca)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:35.035322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:35.247223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c792ddb2de2a4f1bab7b0bead10c32ca', 'request_id': 'req-37b1359b-04d5-4791-a945-ff2eb48e176e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:35.258987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c792ddb2de2a4f1bab7b0bead10c32ca', 'request_id': 'req-37b1359b-04d5-4791-a945-ff2eb48e176e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:35.279977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c792ddb2de2a4f1bab7b0bead10c32ca', 'request_id': 'req-37b1359b-04d5-4791-a945-ff2eb48e176e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:35.417783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] The token cache is being invalidate because project c792ddb2de2a4f1bab7b0bead10c32ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:18:35.418115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:35.419121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:35.422999 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3036/6077] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:18:34 2022] DELETE /identity/v3/projects/c792ddb2de2a4f1bab7b0bead10c32ca => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:35.452701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:35.454195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:35.542966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:35.593248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc51a8e-9b57-47cb-b250-adb40e2be828 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:35.600608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:35.706796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:35.707499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:35.707972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:35.708419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:35.710546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:35.811153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:35.813104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:35.836386 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3042/6078] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:36.943837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:37.177385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:37.763357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:38.729633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:38.918295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:38.923857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:38.966584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1359b-04d5-4791-a945-ff2eb48e176e tempest-RoutersIpV6AdminTest-12536914 tempest-RoutersIpV6AdminTest-12536914-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:38.973926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:38.975971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:38.976583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:38.977137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:38.980247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:39.163825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:39.165535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:39.195815 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3037/6079] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:39.476809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:40.649158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:40.664051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:40.666794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:40.766656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb97635-a822-4aee-86df-cf86b533f88a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:40.779197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:40.780257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:40.780528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:40.780869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] PATH_INFO: `/v3/users/e7dd48af7ed648759108feddcae3e200` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:40.782289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7dd48af7ed648759108feddcae3e200)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:40.784523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:41.116847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7dd48af7ed648759108feddcae3e200'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:41.140486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7dd48af7ed648759108feddcae3e200'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:41.166572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7dd48af7ed648759108feddcae3e200'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:41.169996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7dd48af7ed648759108feddcae3e200'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:41.170765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4a3a1ba3-f769-48c1-8f26-35ce979afa9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7dd48af7ed648759108feddcae3e200'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:41.356275 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3043/6080] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:18:40 2022] DELETE /identity/v3/users/e7dd48af7ed648759108feddcae3e200 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:41.723012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:42.951572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:42.987187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba3b82-eb9a-4c1b-9777-48b4d7375842 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:43.137312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:43.138268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:43.139089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:43.141423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] PATH_INFO: `/v3/projects/1f3d88210ef349d683da9136977a9045` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:43.148370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3d88210ef349d683da9136977a9045)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:43.151673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:43.156083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:43.398199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3d88210ef349d683da9136977a9045', 'request_id': 'req-c816bae0-d418-4ccc-b75e-1095671b34f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:43.432235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3d88210ef349d683da9136977a9045', 'request_id': 'req-c816bae0-d418-4ccc-b75e-1095671b34f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:43.439679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3d88210ef349d683da9136977a9045', 'request_id': 'req-c816bae0-d418-4ccc-b75e-1095671b34f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:43.535463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] The token cache is being invalidate because project 1f3d88210ef349d683da9136977a9045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:18:43.535770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:43.536439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c816bae0-d418-4ccc-b75e-1095671b34f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:18:43.538494 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3038/6081] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:18:42 2022] DELETE /identity/v3/projects/1f3d88210ef349d683da9136977a9045 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:43.543682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:43.544281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:43.544281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:43.599005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:43.599005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:43.709724 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3044/6082] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:43.711007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:43.711517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:43.712030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:43.756161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:43.757411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:43.789571 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3039/6083] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:43.790867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:43.812753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149c8e4-6659-4e6e-ae81-7720a6e65e4b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:43.820290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:43.820940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:43.821359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:43.821698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:43.822991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:18:43.823331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:43.827823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:43.892898 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3045/6084] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:18:43.896486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:43.909805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5308a2-2727-4aca-b414-0d7a28e7e161 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:43.943700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44847766-45f5-4a72-b2f8-84079d2295b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:43.944347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44847766-45f5-4a72-b2f8-84079d2295b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:43.944625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44847766-45f5-4a72-b2f8-84079d2295b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:43.945126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44847766-45f5-4a72-b2f8-84079d2295b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:43.946023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44847766-45f5-4a72-b2f8-84079d2295b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:43.948507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44847766-45f5-4a72-b2f8-84079d2295b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:44.110109 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3040/6085] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:18:43 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:44.113351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:44.130718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3816ae-f926-41a6-84e4-9cb191c3d3c4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:44.159917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:44.277038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:44.279820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.280112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.280396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.281314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:44.286100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:44.369054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.369780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.370240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.426593 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3046/6086] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:18:44 2022] POST /identity/v3/users => generated 291 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:18:44.430400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:44.457479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:44.458771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:44.458910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc1940-3986-43ac-9090-c2932267df9e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:44.478446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:44.478446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.478446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.478446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.479494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:44.485352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:44.513341 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3047/6087] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:44.519587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:44.541646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f3e2-10ec-44d6-841e-a6dadf8f9b22 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:44.549649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:44.550538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.550821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.551519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.551743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:44.553397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:44.568493 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3048/6088] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:18:44.573982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:44.595088 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3041/6089] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:18:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:44.603616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f320-8dd6-4a9a-8a51-20edf0bc63ba admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:44.610273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:44.612010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:44.619195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:44.621423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.621782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.622186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] PATH_INFO: `/v3/projects/1ef756e5aaed4ea699c082fcea8a5c5c/users/60a170763d884dda858c4f79fd24b1c0/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.651123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef756e5aaed4ea699c082fcea8a5c5c, user_id=60a170763d884dda858c4f79fd24b1c0, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:44.654498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:44.743581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e141a1-ab05-470a-aeed-15cbe6be0f79 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:44.750503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea3627-5237-475f-a825-0149ddc4d60b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:44.751679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea3627-5237-475f-a825-0149ddc4d60b service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.753186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea3627-5237-475f-a825-0149ddc4d60b service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.753447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea3627-5237-475f-a825-0149ddc4d60b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.768977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea3627-5237-475f-a825-0149ddc4d60b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:44.773247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea3627-5237-475f-a825-0149ddc4d60b service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:44.790475 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3042/6090] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:18:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:18:44.803371 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3049/6091] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:18:44 2022] PUT /identity/v3/projects/1ef756e5aaed4ea699c082fcea8a5c5c/users/60a170763d884dda858c4f79fd24b1c0/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:18:44.815053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:44.815666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:44.816133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:44.851693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:18:44.852981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:44.947345 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3043/6092] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:18:44.971205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:44.974741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:45.145328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27420a7-e229-4967-91d7-f2d401dc1abc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:45.153744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:45.154573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:45.154948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:45.155703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:45.193612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:45.195470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:45.242730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:45.264936 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3050/6093] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:46.169569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:48.198547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:48.313222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:49.843672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:50.321179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:50.620138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:51.591458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:51.931671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:52.097601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:52.122630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2fc61-f4c1-4bec-9973-043b75a6a306 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:52.167490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:52.184905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:52.197080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:52.205280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:52.296426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:18:52.321023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:52.323812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906ac1-3337-49ba-9e31-6a2954e878e4 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:52.344316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3044/6094] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:52.632222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:55.722614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:56.540393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:56.970987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:58.207851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:59.000274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:00.551186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:00.839021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:01.917394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:02.544702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:03.196183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:03.370360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:03.617425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:05.020707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:05.216588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:06.106615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:06.109418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:06.207420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3c3b3-980e-45eb-81ca-155a35938c98 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:06.238624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:06.240062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:06.240839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:06.241578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] PATH_INFO: `/v3/users/adf2e87bb1204bb4880b6c0306b31a95` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:06.245774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf2e87bb1204bb4880b6c0306b31a95)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:06.252368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:06.549982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf2e87bb1204bb4880b6c0306b31a95'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:06.587435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf2e87bb1204bb4880b6c0306b31a95'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:06.605192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:06.661172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf2e87bb1204bb4880b6c0306b31a95'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:06.668783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf2e87bb1204bb4880b6c0306b31a95'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:06.673041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf2e87bb1204bb4880b6c0306b31a95'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:06.711609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:06.821667 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3051/6095] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:19:06 2022] DELETE /identity/v3/users/adf2e87bb1204bb4880b6c0306b31a95 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:06.826788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:06.827216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:06.827603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:06.878628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:06.882457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:07.183096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3045/6096] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:07.255366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:07.256834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:07.462615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:07.496345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0fce1-648b-4c1a-a135-11a67f210d6b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:07.510176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb03b3d-80e3-4c0e-a7c1-a632bd3cd187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:07.510811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb03b3d-80e3-4c0e-a7c1-a632bd3cd187 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:07.511091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb03b3d-80e3-4c0e-a7c1-a632bd3cd187 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:07.511363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb03b3d-80e3-4c0e-a7c1-a632bd3cd187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:07.537105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb03b3d-80e3-4c0e-a7c1-a632bd3cd187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:07.538915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb03b3d-80e3-4c0e-a7c1-a632bd3cd187 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:07.614231 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3052/6097] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:07.767140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:08.563128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:09.771039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:09.772737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:09.795415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a8c01-8538-4f9d-a953-4ef2ab494a40 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:09.806386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:09.814549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:09.815268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:09.815775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] PATH_INFO: `/v3/projects/ed8f2083dea94eaf996a7d601d36c5cb` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:09.818349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8f2083dea94eaf996a7d601d36c5cb)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:09.824377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:10.122381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8f2083dea94eaf996a7d601d36c5cb', 'request_id': 'req-0858ffe5-1d66-41f7-a827-e59b7c833308'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:10.133156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8f2083dea94eaf996a7d601d36c5cb', 'request_id': 'req-0858ffe5-1d66-41f7-a827-e59b7c833308'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:10.142072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8f2083dea94eaf996a7d601d36c5cb', 'request_id': 'req-0858ffe5-1d66-41f7-a827-e59b7c833308'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:10.207705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] The token cache is being invalidate because project ed8f2083dea94eaf996a7d601d36c5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:19:10.208008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:10.211440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0858ffe5-1d66-41f7-a827-e59b7c833308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:10.219978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:10.220502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:10.220648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:10.221373 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3046/6098] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:19:09 2022] DELETE /identity/v3/projects/ed8f2083dea94eaf996a7d601d36c5cb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:10.291995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:10.293372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:10.332874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1296b-9543-40d8-bd96-34b7611ce5df None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:10.333164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1296b-9543-40d8-bd96-34b7611ce5df None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:10.333450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1296b-9543-40d8-bd96-34b7611ce5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:10.381458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:10.399418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c6f1296b-9543-40d8-bd96-34b7611ce5df None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:10.400743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c6f1296b-9543-40d8-bd96-34b7611ce5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:10.512515 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3053/6099] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:10.513798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:10.515700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:10.531969 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3047/6100] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:19:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:19:10.538167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:10.538585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:10.539003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:10.570653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6cbd9-1cbf-41e1-82e3-08c7406f5974 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:10.579610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:10.591843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:10.592834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:10.593303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:10.593748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] PATH_INFO: `/v3/users/a56a56dcaed34fb790e0c192dc846e03` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:10.594255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:10.595373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56a56dcaed34fb790e0c192dc846e03)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:10.597589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:10.597932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:10.625207 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3048/6101] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:10.625207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:10.627354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:10.863087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ea6c-0997-43a3-963d-6e513665dab0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:10.887301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:10.888374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:10.889708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:10.890237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:10.905983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:10.911439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:10.943074 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3049/6102] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:19:10.943074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:11.022376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f162a24-236b-426f-ada6-5d9f37250f31 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:11.027234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56a56dcaed34fb790e0c192dc846e03'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:11.036834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:11.038248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.038783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.039300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.040434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:19:11.041591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:11.043779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:11.053883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56a56dcaed34fb790e0c192dc846e03'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:11.062238 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3050/6103] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:19:11.067094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:11.077059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56a56dcaed34fb790e0c192dc846e03'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:11.078132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56a56dcaed34fb790e0c192dc846e03'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:11.079052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dce31353-8c1d-4ec6-8ab0-d53cddc1756d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56a56dcaed34fb790e0c192dc846e03'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:11.084496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63829b7-6446-42f5-93aa-fe8a265659cd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:11.092717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:11.094160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.094160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.094160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.095029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:11.097781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:11.303679 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3054/6104] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:19:10 2022] DELETE /identity/v3/users/a56a56dcaed34fb790e0c192dc846e03 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:11.305590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.305952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.306234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.371938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:11.373223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:11.410159 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3051/6105] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:19:11 2022] POST /identity/v3/projects => generated 393 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:19:11.414738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:11.417566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:11.519890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3055/6106] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:11.558808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:11.559420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea3f4-11f4-40ab-8a33-be3a982e96d8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:11.560170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:11.566477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:11.572321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.572321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.572321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.572321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:11.572321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:11.675344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0159f-d0d4-498b-8b59-edafaed59461 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:11.774308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3052/6107] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:19:11 2022] POST /identity/v3/users => generated 297 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:19:11.780032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:11.790314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:11.790575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.791623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.792072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.805788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:11.809726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:11.825376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ed57-f8d7-41b6-bf45-e6708dfb50b1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:11.849684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:11.850370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.850660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.850937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.851875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:11.859746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:11.874085 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3056/6108] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:11.890163 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3053/6109] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:19:11.891996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:11.910378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc5dbb-bf9b-4e34-be9f-61ffdb6907aa service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:11.929007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432918ed-c631-485f-af60-a79896cdf351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:11.929965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432918ed-c631-485f-af60-a79896cdf351 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:11.930806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432918ed-c631-485f-af60-a79896cdf351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:11.931287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432918ed-c631-485f-af60-a79896cdf351 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:11.932715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432918ed-c631-485f-af60-a79896cdf351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:11.934677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432918ed-c631-485f-af60-a79896cdf351 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:11.969117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3057/6110] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:19:11.972886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:12.005519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c223-e212-448b-a02e-c37d6e25da22 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:12.012364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:12.014106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:12.014708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:12.015352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] PATH_INFO: `/v3/projects/19747ba661ca427ea056cf5402e7450c/users/f34ef02913674b04b2822574c2c478f9/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:12.073742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=19747ba661ca427ea056cf5402e7450c, user_id=f34ef02913674b04b2822574c2c478f9, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:12.091429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:12.125922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:12.255026 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3054/6111] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:19:11 2022] PUT /identity/v3/projects/19747ba661ca427ea056cf5402e7450c/users/f34ef02913674b04b2822574c2c478f9/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:12.265873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:12.266169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:12.266447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:12.282431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:12.338536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] MFA Rules not processed for user `f34ef02913674b04b2822574c2c478f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:12.342881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:12.537607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:12.542645 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3058/6112] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:12.714804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdd3ed-6216-403b-a730-765e5ec376ff admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:12.720070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:12.730782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:12.731979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:12.732663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:12.733439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:12.736011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:12.738504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:12.935717 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3055/6113] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:19:12 2022] POST /identity/v3/projects => generated 391 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:19:12.937981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:12.955934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e253801-01b3-453c-8dbd-b2e316a55451 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:13.070842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:13.071706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:13.072392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:13.072874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:13.074021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:13.077740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:13.212773 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3059/6114] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:19:12 2022] POST /identity/v3/users => generated 302 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:19:13.216890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:13.229468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c1df-6689-472d-bf2a-4fcee6387add admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:13.234694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:13.239616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:13.239616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:13.239616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:13.239616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:13.239616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:13.267203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:13.276323 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3056/6115] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:19:13.284677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21fe3-be82-4d02-ad11-f3f1d153ed7c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:13.293677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:13.294970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:13.295540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:13.296121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] PATH_INFO: `/v3/projects/8f626f7d7d214deb95c600f193e75b12/users/bf15db78388644c1888ce853c4032635/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:13.323565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f626f7d7d214deb95c600f193e75b12, user_id=bf15db78388644c1888ce853c4032635, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:13.327237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:13.439561 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3060/6116] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:19:13 2022] PUT /identity/v3/projects/8f626f7d7d214deb95c600f193e75b12/users/bf15db78388644c1888ce853c4032635/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:13.441156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:13.474303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335930-f624-4b2a-93fb-597c3561be21 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:13.508180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:13.586285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14ac18-625a-4887-839f-5c38605e705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:13.588446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14ac18-625a-4887-839f-5c38605e705d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:13.588946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14ac18-625a-4887-839f-5c38605e705d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:13.589422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14ac18-625a-4887-839f-5c38605e705d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:13.590385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14ac18-625a-4887-839f-5c38605e705d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:13.592206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14ac18-625a-4887-839f-5c38605e705d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:13.617802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:13.627254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3057/6117] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:19:13.632727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc748ab-63fd-4cf3-a52b-f4cd4770ccc1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:13.641897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:13.643513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:13.643994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:13.644479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] PATH_INFO: `/v3/projects/8f626f7d7d214deb95c600f193e75b12/users/bf15db78388644c1888ce853c4032635/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:13.650148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f626f7d7d214deb95c600f193e75b12, user_id=bf15db78388644c1888ce853c4032635, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:13.654274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:13.670582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3061/6118] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:19:13 2022] PUT /identity/v3/projects/8f626f7d7d214deb95c600f193e75b12/users/bf15db78388644c1888ce853c4032635/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:13.684109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549fe3-5a82-4cb6-b1c9-f920666d2b13 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:13.684660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549fe3-5a82-4cb6-b1c9-f920666d2b13 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:13.685138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549fe3-5a82-4cb6-b1c9-f920666d2b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:13.733304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ed549fe3-5a82-4cb6-b1c9-f920666d2b13 None None] MFA Rules not processed for user `bf15db78388644c1888ce853c4032635`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:13.734757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ed549fe3-5a82-4cb6-b1c9-f920666d2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:13.882142 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3058/6119] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:13.896588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:13.898538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:14.033334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d5279-fdd7-4f6e-9b4d-d079d1eedb8d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:14.040116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a4540-6e6c-46bf-ab0e-519ab481bae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:14.040758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a4540-6e6c-46bf-ab0e-519ab481bae8 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:14.041583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a4540-6e6c-46bf-ab0e-519ab481bae8 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:14.041898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a4540-6e6c-46bf-ab0e-519ab481bae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:14.110162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a4540-6e6c-46bf-ab0e-519ab481bae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:14.111855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a4540-6e6c-46bf-ab0e-519ab481bae8 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:14.124013 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3062/6120] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:14.218772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:14.219550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:14.220568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:14.284319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] MFA Rules not processed for user `60a170763d884dda858c4f79fd24b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:14.292906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:14.351840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:14.477961 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3059/6121] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:14.483030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:14.483519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:14.483612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:14.520223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] MFA Rules not processed for user `60a170763d884dda858c4f79fd24b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:14.521516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:14.532354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3063/6122] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:19:14.553777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:14.556487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:14.589464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8430f-fd47-42ed-8179-d115c9bd5242 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:14.610728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:14.618558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:14.622655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:14.624686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:14.624686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:14.624686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:14.649651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:14.652737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:14.690061 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3060/6123] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:14.746912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:14.787160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b83c6-5ecd-44cf-82dd-c7b21cb338db None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:14.802630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:14.803194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:14.803477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:14.803756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] PATH_INFO: `/v3/projects/9a91328a58da43feb2bc437d856e56cd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:14.805263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a91328a58da43feb2bc437d856e56cd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:14.808529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:15.018124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a91328a58da43feb2bc437d856e56cd', 'request_id': 'req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.042818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a91328a58da43feb2bc437d856e56cd', 'request_id': 'req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.063530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a91328a58da43feb2bc437d856e56cd', 'request_id': 'req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.176275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] The token cache is being invalidate because project 9a91328a58da43feb2bc437d856e56cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:19:15.182313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.182313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.182313 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3064/6124] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:19:14 2022] DELETE /identity/v3/projects/9a91328a58da43feb2bc437d856e56cd => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:19:15.191227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:15.220070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8802f-0508-4fa9-aef3-0123a58cc26e service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:15.420177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:15.421106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:15.421403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:15.421682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] PATH_INFO: `/v3/users/d5041f8e55734ae180795b144e3ebaed` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:15.425619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5041f8e55734ae180795b144e3ebaed)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:15.433732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:15.711227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:15.783904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:15.827749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5041f8e55734ae180795b144e3ebaed'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.829755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5041f8e55734ae180795b144e3ebaed'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.912824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5041f8e55734ae180795b144e3ebaed'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.926575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5041f8e55734ae180795b144e3ebaed'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:15.927781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-097eb1f4-ffe9-404c-8bc0-ccd8f321976f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5041f8e55734ae180795b144e3ebaed'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:16.010751 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3061/6125] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:19:15 2022] DELETE /identity/v3/users/d5041f8e55734ae180795b144e3ebaed => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:16.972068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:16.973432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:16.997226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233ba6-17ae-4562-90f3-63bf7d3d3b8b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:17.188996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:17.190184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:17.190760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:17.191263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] PATH_INFO: `/v3/projects/44cd7a49738b45d7ba4b65a3243c34a5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:17.193525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44cd7a49738b45d7ba4b65a3243c34a5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:17.199224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:17.353650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:17.469545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44cd7a49738b45d7ba4b65a3243c34a5', 'request_id': 'req-24365fd1-29eb-4b4b-be69-d603baddabc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:17.488556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44cd7a49738b45d7ba4b65a3243c34a5', 'request_id': 'req-24365fd1-29eb-4b4b-be69-d603baddabc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:17.505326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44cd7a49738b45d7ba4b65a3243c34a5', 'request_id': 'req-24365fd1-29eb-4b4b-be69-d603baddabc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:17.665475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:17.670650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] The token cache is being invalidate because project 44cd7a49738b45d7ba4b65a3243c34a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:19:17.671000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:17.671751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-24365fd1-29eb-4b4b-be69-d603baddabc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:19:17.674088 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3065/6126] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:19:16 2022] DELETE /identity/v3/projects/44cd7a49738b45d7ba4b65a3243c34a5 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:17.679503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:17.679867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:17.680214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:17.742593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:17.745903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:17.898041 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3062/6127] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:17.909215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab604b-459f-48f8-9037-920945491eaf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:17.909888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab604b-459f-48f8-9037-920945491eaf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:17.910503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab604b-459f-48f8-9037-920945491eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:17.940071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4dab604b-459f-48f8-9037-920945491eaf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:17.948248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4dab604b-459f-48f8-9037-920945491eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:17.967814 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3066/6128] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:17.974384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:18.006068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12e19-531d-455b-95d0-81fa8bf8ff13 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:18.012741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:18.013606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.013917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.014629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:18.015237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:19:18.015575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:18.017956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:18.074209 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3063/6129] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:19:18.078637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab604b-459f-48f8-9037-920945491eaf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:18.095332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab604b-459f-48f8-9037-920945491eaf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:18.109164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:18.110404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.110934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.111391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:18.112218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:18.118113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:18.266060 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3067/6130] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:19:18 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:19:18.272016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:18.286303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee80e78-3120-4f76-ab6a-33558647c22b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:18.411628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:18.413029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.413548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.414055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:18.415043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:18.417545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:18.547774 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3064/6131] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:19:18 2022] POST /identity/v3/users => generated 295 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:19:18.549512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:18.576617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86343a-25cd-47da-aa65-5e327746381e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:18.582471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:18.583423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.583927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.584446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:18.585642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:18.587768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:18.610464 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3068/6132] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:19:18.610599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:18.629758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1b096-8431-40ff-8b05-35bc2acbbc27 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:18.642522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add5fb5-8c90-43fb-8d53-5840e91e1e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:18.643744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add5fb5-8c90-43fb-8d53-5840e91e1e74 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.644313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add5fb5-8c90-43fb-8d53-5840e91e1e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.645065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add5fb5-8c90-43fb-8d53-5840e91e1e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:18.645781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add5fb5-8c90-43fb-8d53-5840e91e1e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:18.648129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add5fb5-8c90-43fb-8d53-5840e91e1e74 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:18.673573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:18.683335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3065/6133] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:19:18.689780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3fc7-8381-4895-a6cb-823ab1f3e412 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:18.703977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:18.703977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.703977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.703977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] PATH_INFO: `/v3/projects/90e469bdc63249e6b7e665cc59dd29bf/users/5e7ab7880c01441493a865b88e2dd533/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:18.744341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e469bdc63249e6b7e665cc59dd29bf, user_id=5e7ab7880c01441493a865b88e2dd533, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:18.748250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:18.902244 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3069/6134] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:19:18 2022] PUT /identity/v3/projects/90e469bdc63249e6b7e665cc59dd29bf/users/5e7ab7880c01441493a865b88e2dd533/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:19:18.913186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:18.913821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:18.914228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:19.000746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] MFA Rules not processed for user `5e7ab7880c01441493a865b88e2dd533`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:19.003532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:19.130894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3066/6135] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:19.142038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:19.144554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:19.328181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcca2af-fddd-4be1-ae03-7d290ffd5360 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:19.340896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:19.341990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:19.343897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:19.344341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:19.385246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:19.392395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:19.425917 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3070/6136] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:20.305081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:20.350017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:23.795569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:23.911718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:25.558334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:25.565019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:25.845448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:25.899029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ebe8-23c4-4d56-9ff6-58b0f0b7f3a7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:25.918222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:25.919489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:25.919781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:25.922727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:25.933750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:25.959080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:25.960763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:25.989625 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3067/6137] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:26.460492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:26.530683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:27.038011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:27.349792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:28.355656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:28.694649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:29.804920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:29.833631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:31.622297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:31.623910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:31.664574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca490-3366-4452-9d0d-066cecd5578e service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:31.690768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:31.692006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:31.694770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:31.695340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:31.701258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:31.726713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:31.976456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:31.992629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:31.997476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc56a7-9e38-43a6-a156-4530bcce7520 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:32.033211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3071/6138] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:32.641372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:32.737563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:33.494999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:19:33.525230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77b00e-708a-496a-a37a-5e8a57661849 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:19:33.536531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:19:33.537741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:33.538065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:33.538346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:33.543579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:33.598007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:19:33.600113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:19:33.648644 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3068/6139] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:19:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:19:34.364706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:34.725821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:35.707584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:35.897266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:36.861740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:37.221339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:37.817902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:38.194386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:38.480539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:38.777722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:39.806572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:39.875619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:40.302003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:40.457282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:40.795878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:41.055711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:41.834473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:41.961181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:42.981394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:43.610396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:44.310479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:44.782758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:44.811893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:45.223747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:45.361087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:45.436805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:19:45.438710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:19:45.439177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:19:45.490553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] MFA Rules not processed for user `f34ef02913674b04b2822574c2c478f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:19:45.491786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:19:45.802399 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3072/6140] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:19:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:19:46.283764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:47.235681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:48.257804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:49.190232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:50.018432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:51.206122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:52.146997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:52.222676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:52.504116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:52.948714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:53.656866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:54.171367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:54.514046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:54.919522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:55.342700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:56.755780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:56.874348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:19:58.330756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:00.863210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:02.896424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:03.267428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:03.596602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:03.598899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:03.746449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b35f30-eabb-4b21-9fcc-3a1dd542e917 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:03.753696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:03.754893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:03.755207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:03.755517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] PATH_INFO: `/v3/users/60a170763d884dda858c4f79fd24b1c0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:03.756995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a170763d884dda858c4f79fd24b1c0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:03.760221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:04.088173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a170763d884dda858c4f79fd24b1c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:04.088974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a170763d884dda858c4f79fd24b1c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:04.199023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a170763d884dda858c4f79fd24b1c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:04.218006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a170763d884dda858c4f79fd24b1c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:04.220547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-787ac7e8-9f0e-4899-9655-4e3c9fe6e9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a170763d884dda858c4f79fd24b1c0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:04.278797 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3069/6141] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:03 2022] DELETE /identity/v3/users/60a170763d884dda858c4f79fd24b1c0 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:04.487153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:04.770634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:04.772401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:04.793428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462e97e-817b-4975-a60c-a9ef88c1dae9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:04.885814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:04.886866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:04.887324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:04.887779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] PATH_INFO: `/v3/users/1f9d7dcb12e74a1ebfb4b3f2737377ed` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:04.889292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9d7dcb12e74a1ebfb4b3f2737377ed)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:04.892142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:05.135213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9d7dcb12e74a1ebfb4b3f2737377ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:05.231525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9d7dcb12e74a1ebfb4b3f2737377ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:05.250320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9d7dcb12e74a1ebfb4b3f2737377ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:05.251268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9d7dcb12e74a1ebfb4b3f2737377ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:05.252308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9d7dcb12e74a1ebfb4b3f2737377ed'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:05.343087 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3073/6142] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:04 2022] DELETE /identity/v3/users/1f9d7dcb12e74a1ebfb4b3f2737377ed => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:05.347248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:05.347775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:05.347775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:05.391799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:05.391799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:05.461952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:05.465302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:05.467388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:05.540171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:05.590662 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3070/6143] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:05.635461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a31e5a-05f2-480d-9a4e-5f394f6b4a15 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:05.644081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:05.654511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:05.655235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:05.657073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:05.657356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:05.659806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ecb9f-a48e-4b42-b8a5-f1fc87be284a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:05.668089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:05.675404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ba1c9-4bec-4116-b9f2-ad8d226d95c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:05.676031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ba1c9-4bec-4116-b9f2-ad8d226d95c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:05.677115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ba1c9-4bec-4116-b9f2-ad8d226d95c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:05.678138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ba1c9-4bec-4116-b9f2-ad8d226d95c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:05.732412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:05.733924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:05.738671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ba1c9-4bec-4116-b9f2-ad8d226d95c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:05.745803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ba1c9-4bec-4116-b9f2-ad8d226d95c6 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:05.785598 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3074/6145] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:20:05.785820 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3071/6145] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:20:06.450435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:06.539535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:06.541505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:06.562679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112d07-9827-47aa-a932-2b769d2d9a3c service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:06.574882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:06.576050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:06.576517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:06.577125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] PATH_INFO: `/v3/projects/1ef756e5aaed4ea699c082fcea8a5c5c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:06.580572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef756e5aaed4ea699c082fcea8a5c5c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:06.586128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:06.760160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef756e5aaed4ea699c082fcea8a5c5c', 'request_id': 'req-71586cad-2d42-438e-96d8-1dfd3718049d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:06.775380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef756e5aaed4ea699c082fcea8a5c5c', 'request_id': 'req-71586cad-2d42-438e-96d8-1dfd3718049d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:06.791671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef756e5aaed4ea699c082fcea8a5c5c', 'request_id': 'req-71586cad-2d42-438e-96d8-1dfd3718049d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:06.942605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] The token cache is being invalidate because project 1ef756e5aaed4ea699c082fcea8a5c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:06.951248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:06.951248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:06.951248 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3075/6146] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:06 2022] DELETE /identity/v3/projects/1ef756e5aaed4ea699c082fcea8a5c5c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:06.951564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba13e-a7ee-469e-ad11-65a98a4524c9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:06.953104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba13e-a7ee-469e-ad11-65a98a4524c9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:06.953629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba13e-a7ee-469e-ad11-65a98a4524c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:06.962924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:06.967629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:07.051444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-236ba13e-a7ee-469e-ad11-65a98a4524c9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:07.054657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-236ba13e-a7ee-469e-ad11-65a98a4524c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:07.188016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586cad-2d42-438e-96d8-1dfd3718049d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.206129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.206861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.207150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.207427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] PATH_INFO: `/v3/projects/02e0dcbc271e416e8412dac35e8935ef` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.211584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e0dcbc271e416e8412dac35e8935ef)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.216382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:07.246245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3072/6147] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:07.255198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.255744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.256217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.267124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:07.287993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:07.290191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:07.304843 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3073/6148] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:07.305819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:07.316195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2472e90-b263-4b07-8736-ebf91094a6be None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.321605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.326675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.327712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.328647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.330417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:07.331919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.334968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:07.363124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e0dcbc271e416e8412dac35e8935ef', 'request_id': 'req-322650c8-6535-4666-97e6-d5af36d0cd2f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:07.377112 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3074/6149] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:07.378974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:07.380556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e0dcbc271e416e8412dac35e8935ef', 'request_id': 'req-322650c8-6535-4666-97e6-d5af36d0cd2f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:07.394672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e0dcbc271e416e8412dac35e8935ef', 'request_id': 'req-322650c8-6535-4666-97e6-d5af36d0cd2f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:07.406268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ff73-8dd9-44ef-a1eb-9aad0d000d20 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.534834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.535623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.535914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.536200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.536858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.540214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:07.565966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] The token cache is being invalidate because project 02e0dcbc271e416e8412dac35e8935ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:07.566197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:07.566834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-322650c8-6535-4666-97e6-d5af36d0cd2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:07.571929 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3076/6150] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:06 2022] DELETE /identity/v3/projects/02e0dcbc271e416e8412dac35e8935ef => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:07.576556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1bd8-d1d7-4e9e-9ef1-c0ddf52010e2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.576923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1bd8-d1d7-4e9e-9ef1-c0ddf52010e2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.577145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1bd8-d1d7-4e9e-9ef1-c0ddf52010e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.626036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d34b1bd8-d1d7-4e9e-9ef1-c0ddf52010e2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:07.627768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d34b1bd8-d1d7-4e9e-9ef1-c0ddf52010e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:07.650780 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3077/6151] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:07.660708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.661234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.661726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.692163 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3075/6152] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:07 2022] POST /identity/v3/projects => generated 381 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:07.694512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:07.698743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:07.724822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:07.727839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:07.775518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:07.811097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505076c-1af1-407e-b305-7838db33c270 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.817541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.818374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.818790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.819170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.820552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.822882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:07.877266 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3078/6153] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:07.881199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:07.899279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa8c5-7b15-4921-9336-cd9921667dad None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.909746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.910677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.911193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.911737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.912596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:07.914157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.916108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:07.931771 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3079/6154] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:07.938160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:07.955772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3076/6155] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:07 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:07.956325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b69c-515a-4a97-bbdd-131430add19c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.956942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:07.964478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.967403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.968746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.969327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.970782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.973759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501779-93c2-4302-bc4f-ccf6fa144d62 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:07.975457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:07.987163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:07.987802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:07.988090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:07.988368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:07.989027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:07.990684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.039307 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3077/6156] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:08.039905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.044859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:08.063076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a42b3-6547-496c-afd1-bee9c412973d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.068581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.069824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.069824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.069824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.070456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.072094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.084139 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3078/6157] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:08.089351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.104081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962360f-3121-487e-a137-773a64b3cf2a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.112245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd296-2193-4845-9223-73bb09fd67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.113042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd296-2193-4845-9223-73bb09fd67a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.113343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd296-2193-4845-9223-73bb09fd67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.113626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd296-2193-4845-9223-73bb09fd67a3 admin admin] PATH_INFO: `/v3/projects/c7702797e53d4acc8c8e392b81d0bcc9/users/9f510dcda9de43a398b2dc7cbcbe5185/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.140186 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3080/6158] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:07 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:08.140186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.169828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fd296-2193-4845-9223-73bb09fd67a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7702797e53d4acc8c8e392b81d0bcc9, user_id=9f510dcda9de43a398b2dc7cbcbe5185, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.173012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fd296-2193-4845-9223-73bb09fd67a3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.302712 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3079/6159] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:08 2022] PUT /identity/v3/projects/c7702797e53d4acc8c8e392b81d0bcc9/users/9f510dcda9de43a398b2dc7cbcbe5185/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:08.311407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.311986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.312471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.358841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab908f-a4c1-42f2-9a7f-97bb50e9fa3c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.402326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:08.402790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:08.440932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.441602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.441919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.442254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.442904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.445124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.555107 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3080/6160] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:08.574460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.576587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:08.601737 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3081/6161] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:08 2022] POST /identity/v3/users => generated 291 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:20:08.605653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.640563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04287cb-f1db-4854-b56a-3c878d2d7c78 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.646894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.649179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.649673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.650180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.651321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.653325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.667377 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3082/6162] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:08.672490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.684954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e5e2-2113-4794-b3e5-f7349ebd22fa admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.692771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.693750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.694239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.695222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.696127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.698491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.714141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3083/6163] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:08.718791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:08.736028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2ca2c-2960-49bf-b2a3-f34a858402ef admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.739966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791395e-3cc6-485c-8b94-39a970a711fa None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:08.744401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.746158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.746722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.747331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] PATH_INFO: `/v3/projects/cf34571ea6104d649614b71931a689de/users/396b3414ea4c481b9e196592dc07f029/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.752457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce61ab-4bb9-4ee1-9732-362945cdf7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:08.753187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce61ab-4bb9-4ee1-9732-362945cdf7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.753475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce61ab-4bb9-4ee1-9732-362945cdf7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.753750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce61ab-4bb9-4ee1-9732-362945cdf7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:08.771982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce61ab-4bb9-4ee1-9732-362945cdf7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.774257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce61ab-4bb9-4ee1-9732-362945cdf7c8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.783829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf34571ea6104d649614b71931a689de, user_id=396b3414ea4c481b9e196592dc07f029, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:08.787044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:08.797638 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3081/6164] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:08.952508 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3084/6165] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:08 2022] PUT /identity/v3/projects/cf34571ea6104d649614b71931a689de/users/396b3414ea4c481b9e196592dc07f029/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:20:08.982277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:08.983735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:08.984323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:09.075363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] MFA Rules not processed for user `396b3414ea4c481b9e196592dc07f029`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:09.086378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:09.153477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:09.299624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3082/6166] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:09.329935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:09.514376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023e277-f29d-41fd-9fdf-a62dc23b0e8f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:09.526469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918aa1a-37fe-4be8-a3a1-7ab40cbec648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:09.527466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918aa1a-37fe-4be8-a3a1-7ab40cbec648 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:09.527466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918aa1a-37fe-4be8-a3a1-7ab40cbec648 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:09.527798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918aa1a-37fe-4be8-a3a1-7ab40cbec648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:09.550992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918aa1a-37fe-4be8-a3a1-7ab40cbec648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:09.552496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918aa1a-37fe-4be8-a3a1-7ab40cbec648 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:09.578862 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3085/6167] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:09.739853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:12.021713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:12.405095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:13.804565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:14.439465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:14.441585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:14.704273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81792e3-04ea-4b4f-b404-41f28e0c4676 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:14.714909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:14.715938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:14.716651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:14.717404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] PATH_INFO: `/v3/users/5e7ab7880c01441493a865b88e2dd533` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:14.720702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7ab7880c01441493a865b88e2dd533)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:14.724950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:15.030656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7ab7880c01441493a865b88e2dd533'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:15.039401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7ab7880c01441493a865b88e2dd533'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:15.192758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7ab7880c01441493a865b88e2dd533'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:15.206650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7ab7880c01441493a865b88e2dd533'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:15.208322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7ab7880c01441493a865b88e2dd533'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:15.262810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3083/6168] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:14 2022] DELETE /identity/v3/users/5e7ab7880c01441493a865b88e2dd533 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:15.263255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:15.264109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:15.264583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:15.302635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:15.304485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:15.437497 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3086/6169] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:20:15.481950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:15.489649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:15.591697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:15.649608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910687e-30b6-4655-8a95-4ae47d9fa8f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:15.656757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1f18-6507-4bf2-8b38-b84537bb0b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:15.657804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1f18-6507-4bf2-8b38-b84537bb0b89 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:15.658617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1f18-6507-4bf2-8b38-b84537bb0b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:15.659082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1f18-6507-4bf2-8b38-b84537bb0b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:15.676243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d1f18-6507-4bf2-8b38-b84537bb0b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:15.678226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d1f18-6507-4bf2-8b38-b84537bb0b89 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:15.700258 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3084/6170] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:15.804498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:17.243631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:17.245816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:17.273190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a381-fc11-494f-b832-8a4d478dcbc3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:17.277743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:17.280377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:17.281211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:17.287780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] PATH_INFO: `/v3/projects/90e469bdc63249e6b7e665cc59dd29bf` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:17.290035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e469bdc63249e6b7e665cc59dd29bf)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:17.292116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:17.508593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e469bdc63249e6b7e665cc59dd29bf', 'request_id': 'req-f573572d-94e5-43d5-a28e-cfe251adfe92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:17.522000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e469bdc63249e6b7e665cc59dd29bf', 'request_id': 'req-f573572d-94e5-43d5-a28e-cfe251adfe92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:17.550769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e469bdc63249e6b7e665cc59dd29bf', 'request_id': 'req-f573572d-94e5-43d5-a28e-cfe251adfe92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:17.678843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] The token cache is being invalidate because project 90e469bdc63249e6b7e665cc59dd29bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:17.679255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:17.682328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f573572d-94e5-43d5-a28e-cfe251adfe92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:17.684226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3087/6171] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:17 2022] DELETE /identity/v3/projects/90e469bdc63249e6b7e665cc59dd29bf => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:17.699913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:17.700680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:17.700680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:17.770381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:17.775649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:17.973720 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3085/6172] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:17.982522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:17.983047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:17.984506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:18.050067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:18.051960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:18.072721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:18.074840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:18.108630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dfe2-fc47-4070-a24d-7d92a7ffdcd9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:18.125824 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3088/6173] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:18.142769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:18.173287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:18.173999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:18.174288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:18.174592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] PATH_INFO: `/v3/users/8d0cbea10090462da00ba3f884bb4006` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:18.175908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0cbea10090462da00ba3f884bb4006)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:18.180187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:18.192502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580e744-6494-41f5-9466-0b7bc548803e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:18.213179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:18.213812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:18.214142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:18.214416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:18.215095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:18.215490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:18.217239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:18.262117 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3089/6174] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:18.266484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:18.296505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5ba8-f489-4417-a575-ba19f1c9d323 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:18.344497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:18.345200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:18.345487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:18.345841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:18.346473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:18.353055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:18.473899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0cbea10090462da00ba3f884bb4006'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:18.490549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0cbea10090462da00ba3f884bb4006'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:18.501423 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3090/6175] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:18 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:20:18.506177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:18.601469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:18.603688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0cbea10090462da00ba3f884bb4006'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:18.620246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0cbea10090462da00ba3f884bb4006'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:18.626429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fbc3ce04-9d7b-4bfd-bed7-a9dc053e73bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0cbea10090462da00ba3f884bb4006'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:18.681698 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3086/6176] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:18 2022] DELETE /identity/v3/users/8d0cbea10090462da00ba3f884bb4006 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:18.691454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:18.691795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:18.692024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:18.711987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13ee87-5b14-49e0-bc12-4cbf8b9f1918 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:18.753470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:18.754748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:18.883884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:18.884821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:18.886365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:18.887325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:18.888257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:18.891070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:18.903519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:18.921896 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3087/6177] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:20:18.988456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:18.992532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:19.104701 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3091/6178] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:18 2022] POST /identity/v3/users => generated 287 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:20:19.113131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:19.115778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:19.143036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751667c3-eb0a-41cd-a12e-d4a4c9e35c19 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:19.167171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c9b6e-7178-4375-b52e-ac1039651bf1 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:19.168351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:19.168351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:19.168854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:19.168854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:19.180309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:19.180309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:19.180666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:19.180666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:19.180666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:19.180666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:19.203429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:19.208294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:19.222732 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3088/6179] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:20:19.225485 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3092/6180] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:19.229452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:19.256541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0234be4-dd0d-46ce-8607-ff160fc18955 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:19.269744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0131-7df6-4db0-9e91-c31af6fc4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:19.270500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0131-7df6-4db0-9e91-c31af6fc4770 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:19.270862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0131-7df6-4db0-9e91-c31af6fc4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:19.271206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0131-7df6-4db0-9e91-c31af6fc4770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:19.271941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d0131-7df6-4db0-9e91-c31af6fc4770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:19.279660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d0131-7df6-4db0-9e91-c31af6fc4770 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:19.299131 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3089/6181] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:19.303358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:19.317783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ddcb6-7411-48e0-8173-1ce1b5dca567 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:19.329528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:19.330569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:19.331044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:19.331507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] PATH_INFO: `/v3/projects/8129ec23ad034066b881f1b2a15714cb/users/0680c008e03a4c84bcd590724717ccde/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:19.378459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8129ec23ad034066b881f1b2a15714cb, user_id=0680c008e03a4c84bcd590724717ccde, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:19.381346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:19.468048 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3093/6182] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:19 2022] PUT /identity/v3/projects/8129ec23ad034066b881f1b2a15714cb/users/0680c008e03a4c84bcd590724717ccde/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:19.480647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:19.480944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:19.481229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:19.567826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] MFA Rules not processed for user `0680c008e03a4c84bcd590724717ccde`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:19.568275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:19.774041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:19.779890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:19.803456 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3090/6183] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:19.988307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1ef9c-78ac-4a11-b90b-93b2a4d3a0e7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:20.015151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:20.016028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:20.016492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:20.017076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:20.042779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:20.044589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:20.070174 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3094/6184] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:20.484119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:20.485630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:20.671164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae22c-3493-4854-a441-045cb10dfea4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:20.682956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:20.684935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:20.684935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:20.684935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] PATH_INFO: `/v3/users/08def8a420aa4a19b2cbf2e6988d2955` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:20.685750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08def8a420aa4a19b2cbf2e6988d2955)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:20.689788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:20.728880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:20.970233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:20.972021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:21.009876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5ba1-992e-42ef-9005-63b2402091fb service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:21.011240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08def8a420aa4a19b2cbf2e6988d2955'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.011728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08def8a420aa4a19b2cbf2e6988d2955'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.020185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:21.020852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:21.021155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:21.021415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] PATH_INFO: `/v3/projects/1862ae3dd69d4435abe9cbff41e56409` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:21.025450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1862ae3dd69d4435abe9cbff41e56409)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:21.027647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:21.100611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08def8a420aa4a19b2cbf2e6988d2955'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.109844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08def8a420aa4a19b2cbf2e6988d2955'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.112281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08def8a420aa4a19b2cbf2e6988d2955'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.140827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:21.172396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3091/6185] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:20 2022] DELETE /identity/v3/users/08def8a420aa4a19b2cbf2e6988d2955 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:21.173435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1862ae3dd69d4435abe9cbff41e56409', 'request_id': 'req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.188774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1862ae3dd69d4435abe9cbff41e56409', 'request_id': 'req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.207321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1862ae3dd69d4435abe9cbff41e56409', 'request_id': 'req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.368689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] The token cache is being invalidate because project 1862ae3dd69d4435abe9cbff41e56409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:21.368689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.368689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:21.368689 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3095/6186] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:20 2022] DELETE /identity/v3/projects/1862ae3dd69d4435abe9cbff41e56409 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:21.371934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:21.374794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:21.635662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577291-5774-4095-be60-8208a286fe74 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:21.664598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:21.667601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:21.668472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:21.668472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] PATH_INFO: `/v3/users/b65a854f4ad84f13a78d8cc476858171` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:21.671157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65a854f4ad84f13a78d8cc476858171)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:21.675358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:21.961463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:21.963084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:22.063457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65a854f4ad84f13a78d8cc476858171'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.064199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65a854f4ad84f13a78d8cc476858171'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.159677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65a854f4ad84f13a78d8cc476858171'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.165511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1760d0-45e7-4a5f-8162-f8cbabf63f3c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:22.173279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65a854f4ad84f13a78d8cc476858171'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.174126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65a854f4ad84f13a78d8cc476858171'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.181629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:22.182338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:22.182625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:22.182908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] PATH_INFO: `/v3/users/0680c008e03a4c84bcd590724717ccde` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:22.186329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0680c008e03a4c84bcd590724717ccde)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:22.188651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:22.246094 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3092/6187] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:21 2022] DELETE /identity/v3/users/b65a854f4ad84f13a78d8cc476858171 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:22.246094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:22.252131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:22.310589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:22.464380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0680c008e03a4c84bcd590724717ccde'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.472800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d485-5e58-4878-aa7d-e4395296a34a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:22.488115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:22.490377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:22.491302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:22.492238 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] PATH_INFO: `/v3/projects/939fd477be214483874d147e32cb6a35` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:22.497166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] RBAC: Authorizing `identity:delete_project(project_id=939fd477be214483874d147e32cb6a35)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:22.498129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0680c008e03a4c84bcd590724717ccde'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.502686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:22.515559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0680c008e03a4c84bcd590724717ccde'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.520611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0680c008e03a4c84bcd590724717ccde'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.523090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5cb6b1b0-ddea-459e-a7f9-0ed4f87e5588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0680c008e03a4c84bcd590724717ccde'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.633468 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3096/6188] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:21 2022] DELETE /identity/v3/users/0680c008e03a4c84bcd590724717ccde => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:20:22.637710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:22.638084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:22.638363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:22.681701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:22.685965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:22.718293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939fd477be214483874d147e32cb6a35', 'request_id': 'req-f199ae13-7124-40e6-a248-66da555b358f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.736813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939fd477be214483874d147e32cb6a35', 'request_id': 'req-f199ae13-7124-40e6-a248-66da555b358f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.762381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939fd477be214483874d147e32cb6a35', 'request_id': 'req-f199ae13-7124-40e6-a248-66da555b358f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.863771 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3097/6189] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:20:22.902940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] The token cache is being invalidate because project 939fd477be214483874d147e32cb6a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:22.903236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.904239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:22.905112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f199ae13-7124-40e6-a248-66da555b358f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:22.906255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:22.909691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3093/6190] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:22 2022] DELETE /identity/v3/projects/939fd477be214483874d147e32cb6a35 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:22.915243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13caca-07c4-427f-92f2-6b0ae4de3722 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:22.915823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13caca-07c4-427f-92f2-6b0ae4de3722 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:22.916461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13caca-07c4-427f-92f2-6b0ae4de3722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:22.976567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fb13caca-07c4-427f-92f2-6b0ae4de3722 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:22.979883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb13caca-07c4-427f-92f2-6b0ae4de3722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:23.017423 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3094/6191] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:20:23.026530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.026818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.027092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.064914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:23.070957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:23.101189 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3095/6192] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:20:23.105490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:23.128293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2838c19-91ce-4527-ae2a-532618fe077f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:23.143756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:23.144689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.150525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.150525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.150525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:23.150525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:23.150525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:23.176374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923687-8379-4522-a863-fbc78908cb82 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:23.191167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3096/6193] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:20:23.193371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:23.194664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.194947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.195225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.197061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:23.204662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:23.233510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:23.236153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:23.244828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b307-cd3d-4083-b243-214a287d131b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:23.276447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:23.277765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.278342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.279427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.280886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:23.286220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:23.295420 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3098/6194] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:23.345241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:23.397009 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3097/6195] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:23 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:20:23.401126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:23.411764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2cb98-1be3-435a-bbdd-5522987dfca5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:23.656482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:23.657117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.657403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.657677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.658703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:23.660823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:23.830316 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3099/6196] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:23 2022] POST /identity/v3/users => generated 288 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:23.835534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:23.861193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8360d-beae-4aba-abaf-d23716d7fff1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:23.876224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:23.879799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.880758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.882151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.887706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:23.894502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:23.932929 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3098/6197] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:23.938501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:23.963730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2122-f084-42d2-9660-f508b8cf4794 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:23.987822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4112-7810-495f-a405-45141e09c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:23.988469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4112-7810-495f-a405-45141e09c5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:23.988753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4112-7810-495f-a405-45141e09c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:23.989029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4112-7810-495f-a405-45141e09c5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:23.998022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4112-7810-495f-a405-45141e09c5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:24.007005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4112-7810-495f-a405-45141e09c5f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:24.031797 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3100/6198] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:24.037489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:24.068055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45156825-beaf-4c8f-aad3-be88d5bc0be2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:24.089696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:24.093040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:24.093335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:24.093621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] PATH_INFO: `/v3/projects/25929238d35e4de0b4f6bff77f18b544/users/ed9ff24f139b4ff59e3659b0dcc4a3f3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:24.160888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25929238d35e4de0b4f6bff77f18b544, user_id=ed9ff24f139b4ff59e3659b0dcc4a3f3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:24.163724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:24.288966 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3099/6199] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:24 2022] PUT /identity/v3/projects/25929238d35e4de0b4f6bff77f18b544/users/ed9ff24f139b4ff59e3659b0dcc4a3f3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:24.297246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:24.297798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:24.297798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:24.327267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:24.329029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:24.483264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3101/6200] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:24.553303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:24.555458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:24.616850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:24.726944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:24.730708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:24.753210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732e74-45a4-4c28-803a-381a3c0cb7f5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:24.757208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:24.771216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d7c48-623f-48e3-89a7-bd254ef79f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:24.773019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d7c48-623f-48e3-89a7-bd254ef79f34 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:24.773019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d7c48-623f-48e3-89a7-bd254ef79f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:24.774857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3c156-3267-441b-94ba-ccbd3ab2b262 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:24.777169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d7c48-623f-48e3-89a7-bd254ef79f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:24.798549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:24.799209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:24.799496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:24.799771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] PATH_INFO: `/v3/projects/bdf71dc037a942c2adee45509fdf5b74` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:24.803680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf71dc037a942c2adee45509fdf5b74)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:24.809643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:24.810684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d7c48-623f-48e3-89a7-bd254ef79f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:24.812462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d7c48-623f-48e3-89a7-bd254ef79f34 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:24.841996 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3100/6201] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:25.078749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf71dc037a942c2adee45509fdf5b74', 'request_id': 'req-ef6972ce-cf9d-44f7-998f-142a357f0e6b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:25.096612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf71dc037a942c2adee45509fdf5b74', 'request_id': 'req-ef6972ce-cf9d-44f7-998f-142a357f0e6b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:25.138476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf71dc037a942c2adee45509fdf5b74', 'request_id': 'req-ef6972ce-cf9d-44f7-998f-142a357f0e6b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:25.263708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] The token cache is being invalidate because project bdf71dc037a942c2adee45509fdf5b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:25.264432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:25.266296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ef6972ce-cf9d-44f7-998f-142a357f0e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:25.269697 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3102/6202] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:24 2022] DELETE /identity/v3/projects/bdf71dc037a942c2adee45509fdf5b74 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:20:25.275288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:25.275851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:25.275851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:25.329018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:25.330437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:25.503012 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3101/6203] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:25.503629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:25.504266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:25.504266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:25.548517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:25.550120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:25.579780 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3103/6204] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:25.584092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:25.626509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7907-ac89-442b-9626-ed66d8ba24fe None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:25.648170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:25.649996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:25.651907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:25.653522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:25.655156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:25.660264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:25.667565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:25.750297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:25.757084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3102/6205] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:25.763242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bf50c-95db-48c8-a28d-8ffbdc907dee None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:25.792931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:25.794417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:25.795105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:25.795824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:25.796777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:25.802994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:25.992316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:26.003390 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3104/6206] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:25 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:26.008669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ebe85-d703-42f8-aea7-1777c33ea7e6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:26.295569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:26.296422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:26.296808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:26.297925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:26.299113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:26.301958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:26.364459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:26.367337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:26.414077 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3103/6207] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:25 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:26.416027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:26.420231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81794d55-315c-4bec-816f-83cb05d83401 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:26.446770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:26.449335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:26.457499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44c5f-f204-493f-8124-547cb1f662ee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:26.458305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:26.458791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] PATH_INFO: `/v3/projects/8129ec23ad034066b881f1b2a15714cb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:26.460454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8129ec23ad034066b881f1b2a15714cb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:26.464460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:26.485351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:26.491288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:26.491288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:26.491288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:26.496732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:26.501026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:26.545724 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3104/6208] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:26.567574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:26.603329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40363f68-4102-45e6-9b4d-b29a3bab82cb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:26.612210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:26.613992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:26.614547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:26.615065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:26.626033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:26.630910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:26.666812 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3105/6209] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:26.668149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:26.701117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913a02-f0fb-4a0e-975e-dd98521c0f3f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:26.722316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:26.723378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:26.723873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:26.724454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] PATH_INFO: `/v3/projects/2088e80403004992ac337aa8334096a5/users/1be2c257dcc04e788627770ffd23f26f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:26.829702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8129ec23ad034066b881f1b2a15714cb', 'request_id': 'req-9dcab1f5-e884-4987-bb4e-92ca76a234b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:26.846664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2088e80403004992ac337aa8334096a5, user_id=1be2c257dcc04e788627770ffd23f26f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:26.859138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:26.868112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:26.884621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8129ec23ad034066b881f1b2a15714cb', 'request_id': 'req-9dcab1f5-e884-4987-bb4e-92ca76a234b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:26.925589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8129ec23ad034066b881f1b2a15714cb', 'request_id': 'req-9dcab1f5-e884-4987-bb4e-92ca76a234b0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:27.077688 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3106/6210] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:26 2022] PUT /identity/v3/projects/2088e80403004992ac337aa8334096a5/users/1be2c257dcc04e788627770ffd23f26f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:27.088615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:27.101411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:27.112343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] The token cache is being invalidate because project 8129ec23ad034066b881f1b2a15714cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:27.112343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:27.116481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9dcab1f5-e884-4987-bb4e-92ca76a234b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:27.119037 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3105/6211] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:26 2022] DELETE /identity/v3/projects/8129ec23ad034066b881f1b2a15714cb => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:27.121520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9099-667c-4817-83f2-3919f499698d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.121788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9099-667c-4817-83f2-3919f499698d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.125239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9099-667c-4817-83f2-3919f499698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.280280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dc5b9099-667c-4817-83f2-3919f499698d None None] MFA Rules not processed for user `1be2c257dcc04e788627770ffd23f26f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:27.281944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dc5b9099-667c-4817-83f2-3919f499698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:27.380314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df50e-afc1-4e6c-943a-a6debaacae6c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:27.394656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:27.395455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:27.395852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.396310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.397488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.407346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:27.496735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3106/6212] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:27.498273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.503983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.503983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.523504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:27.526715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:27.541780 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3107/6213] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:27.542978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:27.544549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:27.559744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed70516-6f05-4f4e-ac72-c66c0a4dc819 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:27.562624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:27.564328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4f53-c9c1-46e4-8553-44302e2a5cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:27.564500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:27.565310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4f53-c9c1-46e4-8553-44302e2a5cca service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.565768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4f53-c9c1-46e4-8553-44302e2a5cca service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.566242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4f53-c9c1-46e4-8553-44302e2a5cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.576682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4f53-c9c1-46e4-8553-44302e2a5cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:27.578423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4f53-c9c1-46e4-8553-44302e2a5cca service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:27.590965 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3108/6214] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:27.597941 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3107/6215] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:27.606537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.607332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.607861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.637383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:27.637383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:27.648404 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3109/6216] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:27.649176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:27.663917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a847e-4e56-453a-854e-a1a560e1a3b5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:27.682693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:27.685604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.686064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.690875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.691703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:27.692258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:27.718586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:27.786099 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3108/6217] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:27.788443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:27.800900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8f516-94e8-412b-8c8f-71a95b316c7b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:27.806579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:27.807348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:27.809473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:27.809473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:27.809473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:27.811839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:27.988302 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3110/6218] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:27 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:27.993804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:28.009431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085532f6-93c7-4ca0-8932-a8b332694ed6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:28.177459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:28.179021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:28.179349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:28.179630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:28.180296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:28.182328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:28.332803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:28.334156 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3109/6219] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:27 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:28.349670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512cec-904a-42f8-85d9-4be0fac3bc86 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:28.364278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:28.365201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:28.368166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:28.368823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:28.369763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:28.372858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:28.399559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3111/6220] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:28.405453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:28.421108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16222c-bf23-495a-b522-54a3488d6da2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:28.437417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c302ae6-503c-4155-8ee8-be61ec83cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:28.438145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c302ae6-503c-4155-8ee8-be61ec83cb2f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:28.438442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c302ae6-503c-4155-8ee8-be61ec83cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:28.438719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c302ae6-503c-4155-8ee8-be61ec83cb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:28.440006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c302ae6-503c-4155-8ee8-be61ec83cb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:28.443953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c302ae6-503c-4155-8ee8-be61ec83cb2f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:28.479299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:28.490709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3110/6221] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:28.494210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb9509-a54f-4778-9a34-8b1f8ce5bd5d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:28.506685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:28.507383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:28.507869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:28.509099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] PATH_INFO: `/v3/projects/bb76c3a27bc64b0ea32f9875da05877e/users/a0c7835afec94929b31fbef68338eac9/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:28.555124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb76c3a27bc64b0ea32f9875da05877e, user_id=a0c7835afec94929b31fbef68338eac9, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:28.563778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:28.678647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536337-ff94-458e-9490-65731313d162 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:28.678932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536337-ff94-458e-9490-65731313d162 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:28.679431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536337-ff94-458e-9490-65731313d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:28.682408 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3112/6222] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:28 2022] PUT /identity/v3/projects/bb76c3a27bc64b0ea32f9875da05877e/users/a0c7835afec94929b31fbef68338eac9/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:20:28.783223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d3536337-ff94-458e-9490-65731313d162 None None] MFA Rules not processed for user `a0c7835afec94929b31fbef68338eac9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:28.784547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d3536337-ff94-458e-9490-65731313d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:28.962080 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3111/6223] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:28.987716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:29.049836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:29.109456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814e5bf-a7b8-4058-93fa-d6c7c9162c78 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:29.124750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:29.125813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:29.127876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:29.127876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:29.144536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:29.148128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:29.165941 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3113/6224] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:31.909221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:31.910772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:31.910772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:31.971606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] MFA Rules not processed for user `9f510dcda9de43a398b2dc7cbcbe5185`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:31.971606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:31.975435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:32.061785 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3112/6225] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:32.071754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:32.073218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:32.257031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11d13-c23c-406a-8f88-54d79760150e service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:32.282806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad0bcc-671d-4a79-86ef-d36ebff57c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:32.285789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad0bcc-671d-4a79-86ef-d36ebff57c18 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:32.286547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad0bcc-671d-4a79-86ef-d36ebff57c18 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:32.287167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad0bcc-671d-4a79-86ef-d36ebff57c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:32.298570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad0bcc-671d-4a79-86ef-d36ebff57c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:32.300508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad0bcc-671d-4a79-86ef-d36ebff57c18 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:32.326749 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3114/6226] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:39.971098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:39.974282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:40.185743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29d88b-fd7d-459e-89cd-c63ee5d1123a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:40.192696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:40.193593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:40.194014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:40.194417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:40.197563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:40.216093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:40.218553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:40.235121 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3113/6227] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:42.309088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=48 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:46.361877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:46.363280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:46.363583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:46.426450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] MFA Rules not processed for user `ed9ff24f139b4ff59e3659b0dcc4a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:46.428739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:46.621627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3115/6228] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:46.637984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:46.667962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1dcb-1a58-4b42-ad56-0be0535b1084 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:46.702733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842a16-1538-42b8-998e-0b9f456a28d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:46.703384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842a16-1538-42b8-998e-0b9f456a28d2 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:46.703672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842a16-1538-42b8-998e-0b9f456a28d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:46.703952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842a16-1538-42b8-998e-0b9f456a28d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:46.733453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842a16-1538-42b8-998e-0b9f456a28d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:46.735160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842a16-1538-42b8-998e-0b9f456a28d2 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:46.754369 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3114/6229] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:20:47.017928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:47.019826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:47.205600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675156e-d5dd-4cf8-8b59-e376525a7402 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:47.211290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:47.212161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:47.212544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:47.212921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] PATH_INFO: `/v3/users/1be2c257dcc04e788627770ffd23f26f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:47.214389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be2c257dcc04e788627770ffd23f26f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:47.221316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:47.478081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be2c257dcc04e788627770ffd23f26f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:47.478873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be2c257dcc04e788627770ffd23f26f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:47.545953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be2c257dcc04e788627770ffd23f26f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:47.571302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be2c257dcc04e788627770ffd23f26f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:47.571901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be2c257dcc04e788627770ffd23f26f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:47.627607 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3116/6230] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:47 2022] DELETE /identity/v3/users/1be2c257dcc04e788627770ffd23f26f => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:47.632556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:47.633256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:47.633692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:47.669193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:47.674091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:47.856904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3115/6231] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:47.951684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:47.955113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:47.977822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:48.048579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a112c3-f8e9-4bb7-8c01-821665093019 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:48.052536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:48.053995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:48.054341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:48.054684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:48.070182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:48.072732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:48.088513 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3117/6232] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:48.123194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:48.124657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:48.144552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2921-f393-4edd-ac08-6037de415c4c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:48.155845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:48.156776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:48.157703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:48.158244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] PATH_INFO: `/v3/users/9f510dcda9de43a398b2dc7cbcbe5185` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:48.161316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f510dcda9de43a398b2dc7cbcbe5185)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:48.165058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:48.175585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:48.433371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f510dcda9de43a398b2dc7cbcbe5185'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:48.475344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f510dcda9de43a398b2dc7cbcbe5185'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:48.488760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f510dcda9de43a398b2dc7cbcbe5185'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:48.490628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f510dcda9de43a398b2dc7cbcbe5185'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:48.491536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8fef7ab8-64d3-472b-8ccf-5976034a0816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f510dcda9de43a398b2dc7cbcbe5185'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:48.611412 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3116/6233] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:48 2022] DELETE /identity/v3/users/9f510dcda9de43a398b2dc7cbcbe5185 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:49.091423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:49.100393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:49.154253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cd3c-a86b-4437-899e-07a20852a927 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:49.362114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:49.365241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:49.365241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:49.365241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] PATH_INFO: `/v3/projects/2088e80403004992ac337aa8334096a5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:49.365241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2088e80403004992ac337aa8334096a5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:49.368395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:49.576447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2088e80403004992ac337aa8334096a5', 'request_id': 'req-dd6a2a2e-d0e8-4e18-9026-db756c27be92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:49.592799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2088e80403004992ac337aa8334096a5', 'request_id': 'req-dd6a2a2e-d0e8-4e18-9026-db756c27be92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:49.602218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2088e80403004992ac337aa8334096a5', 'request_id': 'req-dd6a2a2e-d0e8-4e18-9026-db756c27be92'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:49.794921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] The token cache is being invalidate because project 2088e80403004992ac337aa8334096a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:49.795234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:49.796070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:49.799788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3118/6234] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:49 2022] DELETE /identity/v3/projects/2088e80403004992ac337aa8334096a5 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:49.804783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877993-5653-4847-993e-eb95f2376b78 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:49.805606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877993-5653-4847-993e-eb95f2376b78 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:49.806077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877993-5653-4847-993e-eb95f2376b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:49.852061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-42877993-5653-4847-993e-eb95f2376b78 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:49.858367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42877993-5653-4847-993e-eb95f2376b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:49.910450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:49.912018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:50.015059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3117/6235] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:50.025420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.027862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.028967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.085200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2a2e-d0e8-4e18-9026-db756c27be92 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:50.105768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:50.105974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:50.106488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.107040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.107528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] PATH_INFO: `/v3/projects/c7702797e53d4acc8c8e392b81d0bcc9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.108603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:50.109274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7702797e53d4acc8c8e392b81d0bcc9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:50.111584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:50.124045 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3118/6236] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:20:50.131990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:50.141405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:50.152737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3185-f7d8-44bd-be17-e64eaa2845ad None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:50.163864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:50.165015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.165747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.166256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.167559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:50.168113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:50.172192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:50.232419 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3119/6237] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:50.241400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:50.261836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94bec-4fd3-430f-bfd6-7204079875e4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:50.273138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:50.276781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.277292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.278066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.282873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:50.288066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:50.301796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7702797e53d4acc8c8e392b81d0bcc9', 'request_id': 'req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:50.315351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7702797e53d4acc8c8e392b81d0bcc9', 'request_id': 'req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:50.329894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7702797e53d4acc8c8e392b81d0bcc9', 'request_id': 'req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:50.427103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] The token cache is being invalidate because project c7702797e53d4acc8c8e392b81d0bcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:50.428254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:50.428654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f8ff8e90-a1cc-4a8c-a2da-70841c124bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:50.430644 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3119/6238] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:49 2022] DELETE /identity/v3/projects/c7702797e53d4acc8c8e392b81d0bcc9 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:20:50.439045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772284-2525-456c-b42e-64057032935e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.439639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772284-2525-456c-b42e-64057032935e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.440224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772284-2525-456c-b42e-64057032935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.481552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-63772284-2525-456c-b42e-64057032935e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:50.484520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-63772284-2525-456c-b42e-64057032935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:50.523810 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3120/6239] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:50.525173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:50.535189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:50.631079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:50.661036 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3120/6240] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:50.670242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.670758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.671191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.680604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a334-5d00-4e27-8aec-c7eb5b3fb771 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:50.697605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:50.698507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.698795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.699421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.700238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:50.702455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:50.710440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:50.711951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:50.730083 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3121/6241] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:50.731577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:50.754092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ebbec-4a7b-47b8-a724-fe67da9c2718 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:50.764696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:50.765349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.766517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.766517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.766976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:50.767285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:50.769569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:50.799818 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3122/6242] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:50.802197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:50.829787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88a7a5-12be-47a2-83d7-1ce5b9b2d156 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:50.843686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:50.845740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:50.861773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:50.863104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:50.865338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:50.869537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:50.958047 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3121/6243] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:50 2022] POST /identity/v3/users => generated 292 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:50.962278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:50.988946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f734f9-3b68-440e-894d-02da349dc240 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.004752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.004752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.005531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.005531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.006794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.008206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.038031 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3122/6244] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:51.042306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.069114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4067f0c-5513-4315-85f6-eac809f931c2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.080887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.081714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.082188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.082393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.083145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.084912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.105745 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3123/6245] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:51.107950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.122741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9fcb5-2b58-4ba7-8a69-936fe315e886 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.128887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882671-5860-435d-99f8-fca5f543f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.131198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882671-5860-435d-99f8-fca5f543f19b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.131703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882671-5860-435d-99f8-fca5f543f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.132292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882671-5860-435d-99f8-fca5f543f19b admin admin] PATH_INFO: `/v3/projects/cea50ceeed82418c936c5f73381e40e9/users/24f1bebd009a4a0a918702421cdb333c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.135240 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3123/6246] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:50 2022] POST /identity/v3/projects => generated 381 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:51.139235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.156230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882671-5860-435d-99f8-fca5f543f19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea50ceeed82418c936c5f73381e40e9, user_id=24f1bebd009a4a0a918702421cdb333c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.160096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882671-5860-435d-99f8-fca5f543f19b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.262042 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3124/6247] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:51 2022] PUT /identity/v3/projects/cea50ceeed82418c936c5f73381e40e9/users/24f1bebd009a4a0a918702421cdb333c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:51.283321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.283321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.283321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.320165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe08daa-4c6f-409f-898f-4adb7377d93b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.386542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] MFA Rules not processed for user `24f1bebd009a4a0a918702421cdb333c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:51.387996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:51.497823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.498903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.499445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.499988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.500943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.503999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.537275 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3125/6248] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:51.614895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.614895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:51.652710 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3124/6249] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:51 2022] POST /identity/v3/users => generated 291 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:51.657289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.691761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398906a9-cc70-4220-9589-a0aadd16a18d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.718296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.720002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.720165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c48a-7e60-4b03-bd00-f473a99b24c0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.721753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.722605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.724548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.726270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.727096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.727382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.727660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.728352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.738096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.739842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.745125 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3125/6250] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:51.750224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.752783 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3126/6251] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:51.773983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b373f-766a-4871-9f2b-70d0774bc4f2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.797773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546502d-023c-4c3e-83b7-21f3d2830325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.804613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546502d-023c-4c3e-83b7-21f3d2830325 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.804613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546502d-023c-4c3e-83b7-21f3d2830325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.804613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546502d-023c-4c3e-83b7-21f3d2830325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.804613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546502d-023c-4c3e-83b7-21f3d2830325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.806937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546502d-023c-4c3e-83b7-21f3d2830325 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.827276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3126/6252] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:51.827889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:51.843654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc418-34ed-4493-b52d-692db582b352 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:51.857034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.857329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.859838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.867698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bbd9-534f-4bd8-b864-59e27689a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:51.869209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bbd9-534f-4bd8-b864-59e27689a3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:51.870055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bbd9-534f-4bd8-b864-59e27689a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:51.872358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bbd9-534f-4bd8-b864-59e27689a3c0 admin admin] PATH_INFO: `/v3/projects/4dce5b0fe7b344798afba0361d13f457/users/0244b5ea667d4543827500408b2a7f47/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:51.900172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061bbd9-534f-4bd8-b864-59e27689a3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dce5b0fe7b344798afba0361d13f457, user_id=0244b5ea667d4543827500408b2a7f47, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:51.917012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] MFA Rules not processed for user `ed9ff24f139b4ff59e3659b0dcc4a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:51.918713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061bbd9-534f-4bd8-b864-59e27689a3c0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:51.921963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:52.040378 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3127/6253] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:51 2022] PUT /identity/v3/projects/4dce5b0fe7b344798afba0361d13f457/users/0244b5ea667d4543827500408b2a7f47/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:20:52.049690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:52.050020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:52.050298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:52.106552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:52.108060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:52.162583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3127/6254] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:52.191636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:52.321280 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3128/6255] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:52.356186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:52.389345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee811b-e1a7-46d0-9279-c49ca21e559f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:52.440854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:52.459108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da986562-4978-4a3f-b0e0-50907c417554 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:52.468816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:52.469492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:52.469837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:52.470155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] PATH_INFO: `/v3/users/24f1bebd009a4a0a918702421cdb333c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:52.474513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f1bebd009a4a0a918702421cdb333c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:52.482401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:52.517499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c71135-2dda-4b37-a908-18bc9089360a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:52.517499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c71135-2dda-4b37-a908-18bc9089360a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:52.517796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c71135-2dda-4b37-a908-18bc9089360a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:52.519743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c71135-2dda-4b37-a908-18bc9089360a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:52.543366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c71135-2dda-4b37-a908-18bc9089360a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:52.550685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c71135-2dda-4b37-a908-18bc9089360a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:52.563243 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3128/6256] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:52.859891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f1bebd009a4a0a918702421cdb333c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:52.879601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f1bebd009a4a0a918702421cdb333c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:52.893558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f1bebd009a4a0a918702421cdb333c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:52.894797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f1bebd009a4a0a918702421cdb333c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:52.895981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f1bebd009a4a0a918702421cdb333c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:53.040143 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3129/6257] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:52 2022] DELETE /identity/v3/users/24f1bebd009a4a0a918702421cdb333c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:53.045561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:53.046048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:53.046833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:53.080117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:53.095610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:53.198354 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3129/6258] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:53.240729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:53.246836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:53.358200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:53.361740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:53.401825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c25e-d125-443e-ad23-d2887d6ec7cd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:53.404590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:53.408833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:53.414842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:53.415420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:53.423785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:53.450332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:53.451916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:53.470696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3130/6259] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:53.493316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8763d9-71e1-4855-bb16-57cf00f419d3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:53.498407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:53.499383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:53.499947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:53.500616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:53.511791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:53.546755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:53.552995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:53.574913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3130/6260] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:54.590877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:54.594730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:54.785763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90cc7f-e540-45a3-b67c-9925317dbff3 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:54.796424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:54.798495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:54.799021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:54.816224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:54.820239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:54.842038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:54.844772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6b7b-32f7-4571-bb0c-cc9d104b66a5 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:54.854224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:54.865566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3131/6261] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:54.905305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:54.915636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:54.917099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:54.947538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee78fae-55d5-4943-9d1c-7ae1c56e5439 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:54.963897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:54.963897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:54.963897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:54.963897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] PATH_INFO: `/v3/projects/cea50ceeed82418c936c5f73381e40e9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:54.964975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea50ceeed82418c936c5f73381e40e9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:54.971493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:55.136839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea50ceeed82418c936c5f73381e40e9', 'request_id': 'req-0da7bec9-4895-47c2-b06f-526d933072d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:55.144086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea50ceeed82418c936c5f73381e40e9', 'request_id': 'req-0da7bec9-4895-47c2-b06f-526d933072d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:55.152511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea50ceeed82418c936c5f73381e40e9', 'request_id': 'req-0da7bec9-4895-47c2-b06f-526d933072d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:55.283383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] The token cache is being invalidate because project cea50ceeed82418c936c5f73381e40e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:55.285544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:55.285544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0da7bec9-4895-47c2-b06f-526d933072d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:55.293361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:55.293653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:55.293958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:55.296768 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3131/6262] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:54 2022] DELETE /identity/v3/projects/cea50ceeed82418c936c5f73381e40e9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:55.334356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:55.336009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:55.542592 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3132/6263] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:55.550560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:55.551413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:55.551413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:55.594474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:55.597573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:55.611442 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3132/6264] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:55.612350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:55.629496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a2f3-d2ac-4374-8946-276298102658 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:55.636594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:55.638130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:55.638620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:55.639323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:55.640263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:20:55.640918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:55.643083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:55.669570 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3133/6265] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:20:55.673773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:55.700524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3b053-d9c9-4d37-9793-6e76bd13cfa8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:55.707467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:55.708751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:55.709772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:55.710231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:55.711064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:55.714183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:55.749573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:55.875442 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3133/6266] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:20:55 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:20:55.879499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:55.899014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30179177-0b5c-4770-9500-a17e9eaaed2e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:56.033044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:56.033977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:56.035424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:56.037533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:56.039276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:56.042594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:56.155969 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3134/6267] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:20:55 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:20:56.157597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:56.174745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb0d64-7851-4b4b-859a-4c6a116efabe admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:56.210459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:56.211122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:56.211386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:56.211665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:56.214842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:56.219740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:56.237136 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3134/6268] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:20:56.238600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:56.252317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882986b7-a961-4582-9b8b-e84df3bd832d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:56.264285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c330a5-8b30-4503-88b7-8319f5e8ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:56.264918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c330a5-8b30-4503-88b7-8319f5e8ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:56.265200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c330a5-8b30-4503-88b7-8319f5e8ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:56.265487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c330a5-8b30-4503-88b7-8319f5e8ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:56.266272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c330a5-8b30-4503-88b7-8319f5e8ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:56.267816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c330a5-8b30-4503-88b7-8319f5e8ce22 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:56.295718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3135/6269] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:20:56.299740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:56.322524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97bc9-5d54-408e-a356-509ef202d128 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:56.334123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:56.334919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:56.335490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:56.335836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] PATH_INFO: `/v3/projects/2ad2e60f35c14eef8d2f43fe942193db/users/14058d5524844940ba76b0ec13dab362/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:56.361614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad2e60f35c14eef8d2f43fe942193db, user_id=14058d5524844940ba76b0ec13dab362, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:56.367662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:56.475999 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3135/6270] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:20:56 2022] PUT /identity/v3/projects/2ad2e60f35c14eef8d2f43fe942193db/users/14058d5524844940ba76b0ec13dab362/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:56.479895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:56.479895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:56.479895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:56.524415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:56.572505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] MFA Rules not processed for user `14058d5524844940ba76b0ec13dab362`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:20:56.587750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:56.685482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3136/6271] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:20:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:20:56.748656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:56.751333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:56.844561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:56.848065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:56.908616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c5e7-d60e-44a9-9c86-1b1f7821670e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:56.921058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:56.925237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:56.925531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:56.925813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:56.947407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:56.970161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:57.008877 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3136/6272] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:57.066982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003ead-13af-498d-bb79-ffde0e357a01 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:57.075119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:57.075928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:57.076384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:57.076768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] PATH_INFO: `/v3/users/df46ce1cbcc44a47b7d6bd88c230cb0c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:57.078082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df46ce1cbcc44a47b7d6bd88c230cb0c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:57.080281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:57.412443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df46ce1cbcc44a47b7d6bd88c230cb0c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:57.485361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df46ce1cbcc44a47b7d6bd88c230cb0c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:57.575673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df46ce1cbcc44a47b7d6bd88c230cb0c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:57.578300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df46ce1cbcc44a47b7d6bd88c230cb0c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:57.580712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df46ce1cbcc44a47b7d6bd88c230cb0c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:57.723155 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3137/6273] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:56 2022] DELETE /identity/v3/users/df46ce1cbcc44a47b7d6bd88c230cb0c => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:57.870513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:57.872155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.047077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9747-bb73-4157-b515-c47c5b31a253 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:58.110366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:58.111774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.152954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:58.195959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:58.209057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:58.209691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:58.210002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:58.210278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:58.215430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.253945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:58.257300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:58.275510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915645-ca2b-433d-a488-34a529afaa77 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:58.300333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:58.300635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:58.301089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:58.302704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:58.307207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.331831 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3137/6274] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:58.344214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:58.347457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:58.386309 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3138/6275] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:20:58.469539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:58.475807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.541379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe91d-4fc1-4cc1-ada3-6ff704c464ab service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:58.555182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:58.557768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:58.558085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:58.558378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:58.564606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.616397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:58.619372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:58.666912 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3138/6276] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:58.717079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:58.734734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:58.924631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8770e-ff2b-4efa-ac3c-762ae8f72003 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:58.931379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:58.933319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:58.933759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:58.934975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] PATH_INFO: `/v3/projects/c26696ea658340348c4ef1bd81bf60d2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:58.971545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26696ea658340348c4ef1bd81bf60d2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:58.974645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:59.261391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26696ea658340348c4ef1bd81bf60d2', 'request_id': 'req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:59.275750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26696ea658340348c4ef1bd81bf60d2', 'request_id': 'req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:59.293805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26696ea658340348c4ef1bd81bf60d2', 'request_id': 'req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:59.435945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] The token cache is being invalidate because project c26696ea658340348c4ef1bd81bf60d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:20:59.436248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:59.441384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:59.441384 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3139/6277] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:20:58 2022] DELETE /identity/v3/projects/c26696ea658340348c4ef1bd81bf60d2 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:20:59.445310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:59.471916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b7e2-e32e-4758-b8dc-cab6319e8d48 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:59.575631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:59.580501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:59.660901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:59.662348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:59.662637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:59.662914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] PATH_INFO: `/v3/users/696b6bdc2ea64aa693e24e830a896795` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:59.664335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696b6bdc2ea64aa693e24e830a896795)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:59.667984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:59.680877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4fb0d-9ec7-4730-80b2-e200872a78c5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:59.685349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:59.686502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:59.687000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:59.687488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:59.696332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:20:59.710340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:59.711923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:59.733513 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3140/6278] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:59.939721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696b6bdc2ea64aa693e24e830a896795'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:20:59.940693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696b6bdc2ea64aa693e24e830a896795'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:00.037207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696b6bdc2ea64aa693e24e830a896795'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:00.047697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696b6bdc2ea64aa693e24e830a896795'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:00.049295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696b6bdc2ea64aa693e24e830a896795'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:00.074072 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3139/6279] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:20:59 2022] DELETE /identity/v3/users/696b6bdc2ea64aa693e24e830a896795 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:00.385680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:00.387228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:00.486413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12021-7c1f-43fb-a5d8-b5ee7acf02a3 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:00.586226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:00.586226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:00.586226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:00.586226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:00.590486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:00.607383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:00.609398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb2b02-16f0-4312-87b2-c7e0c8cbc3bc service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:00.629605 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3141/6280] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:00.934067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:01.014737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:01.020398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:01.200239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:01.204715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfb2c-18bd-4f09-8f54-a2f8274ccef1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:01.221046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:01.224060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:01.224501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:01.225632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] PATH_INFO: `/v3/projects/74a32fc9524046aba63be664576bb28a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:01.227742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a32fc9524046aba63be664576bb28a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:01.233209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:01.435695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a32fc9524046aba63be664576bb28a', 'request_id': 'req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:01.455059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a32fc9524046aba63be664576bb28a', 'request_id': 'req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:01.467825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a32fc9524046aba63be664576bb28a', 'request_id': 'req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:01.583453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] The token cache is being invalidate because project 74a32fc9524046aba63be664576bb28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:01.584112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:01.586781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b3ddbf2d-61f5-45cc-9379-c8a3461d990b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:01.594141 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3140/6281] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:01 2022] DELETE /identity/v3/projects/74a32fc9524046aba63be664576bb28a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:01.595807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:01.596244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:01.596401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:01.656732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:01.659106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:01.823784 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3142/6282] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:01.835485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:01.835923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:01.836235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:01.884472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:01.891028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:01.906926 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3141/6283] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:01.911551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:01.929541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6628b-9839-40a6-8507-295b55e8c6dc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:01.935881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:01.936811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:01.937306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:01.937908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:01.938898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:01.939434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:01.941964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:01.981232 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3143/6284] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:01.999913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:02.019625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944d65-31f8-41c9-a0cb-4f623bddbd90 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:02.039641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:02.040331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.043943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.044393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:02.045189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:02.050757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:02.150091 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3142/6285] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:01 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:02.155929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:02.170791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91032d4d-8cf3-4663-a966-b22d5caec636 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:02.390828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:02.394031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.395010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.399122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:02.400939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:02.405081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:02.549346 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3144/6286] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:02 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:02.550285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:02.573469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2d35-6a88-4eaa-92fd-c70ebec42083 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:02.577102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:02.581223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:02.581879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.582169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.582447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:02.583958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:02.585946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:02.592285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:02.614517 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3143/6287] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:02.615674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:02.632906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cda2e6-c7c7-4179-a149-6288342c403f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:02.639253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f28ba-4c33-4b08-a669-0d049f08c7d4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:02.647319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:02.648018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:02.648145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.648487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.648646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.648943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] PATH_INFO: `/v3/users/a0c7835afec94929b31fbef68338eac9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:02.649314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.649740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:02.650554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:02.651241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c7835afec94929b31fbef68338eac9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:02.654822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:02.657900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:02.682212 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3144/6288] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:21:02.687219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:02.731103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d074c-68b2-4b48-81fe-124a2cda94c8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:02.755234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f6888-c479-44fe-9a8c-6a5e724e3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:02.761624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6888-c479-44fe-9a8c-6a5e724e3533 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.761624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6888-c479-44fe-9a8c-6a5e724e3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.761624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6888-c479-44fe-9a8c-6a5e724e3533 admin admin] PATH_INFO: `/v3/projects/cbf9f25947fb4827acb0b889e67151ae/users/9e152102d838476aaa5fbc061a18037f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:02.788017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6888-c479-44fe-9a8c-6a5e724e3533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf9f25947fb4827acb0b889e67151ae, user_id=9e152102d838476aaa5fbc061a18037f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:02.792357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6888-c479-44fe-9a8c-6a5e724e3533 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:02.961542 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3145/6289] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:02 2022] PUT /identity/v3/projects/cbf9f25947fb4827acb0b889e67151ae/users/9e152102d838476aaa5fbc061a18037f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:02.968974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:02.969906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:02.971749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:03.066319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c7835afec94929b31fbef68338eac9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:03.096942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:03.106704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:03.177916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c7835afec94929b31fbef68338eac9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:03.196221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c7835afec94929b31fbef68338eac9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:03.198218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c7835afec94929b31fbef68338eac9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:03.198927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3a6bd87e-3cc0-4d90-b84c-65785407296d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c7835afec94929b31fbef68338eac9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:03.298355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3146/6290] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:03.316567 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3145/6291] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:02 2022] DELETE /identity/v3/users/a0c7835afec94929b31fbef68338eac9 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:03.318174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:03.323859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:03.324217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:03.324561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:03.328934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:03.391665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:03.393082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:03.444871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e50b6-fba4-452a-ae04-d28d29ef8b2a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:03.552761 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3146/6292] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:03.559211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:03.563778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:03.683663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:03.685134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:03.685577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:03.686331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:03.701631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:03.703449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:03.711593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225bb4a-a29d-43f6-82b3-d76d6ab5bffe None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:03.718063 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3147/6293] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:03.719341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:03.720367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:03.720860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:03.721442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:03.725259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:03.727060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:03.748702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a91f9-d22b-4cac-8937-5cf1a6bb54fe service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:03.753964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:03.755032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:03.755500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:03.755790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:03.769275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:03.771223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:03.793437 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3148/6294] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:03.941430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:03.945516 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c6aff-e516-4bab-8d1f-4841a12939a5 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:03.982268 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3147/6295] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:04.456657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:04.531085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:05.231402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:05.365215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:05.368209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:05.387665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e462c-ac54-4879-b17f-21108e8b710e service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:05.396701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:05.398676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:05.400006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:05.400485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] PATH_INFO: `/v3/projects/bb76c3a27bc64b0ea32f9875da05877e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:05.402293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb76c3a27bc64b0ea32f9875da05877e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:05.405164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:05.524978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb76c3a27bc64b0ea32f9875da05877e', 'request_id': 'req-3e94c545-564d-4f13-a11b-7ef6912f0f25'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:05.533163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb76c3a27bc64b0ea32f9875da05877e', 'request_id': 'req-3e94c545-564d-4f13-a11b-7ef6912f0f25'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:05.542548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb76c3a27bc64b0ea32f9875da05877e', 'request_id': 'req-3e94c545-564d-4f13-a11b-7ef6912f0f25'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:05.620160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] The token cache is being invalidate because project bb76c3a27bc64b0ea32f9875da05877e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:05.623466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:05.623466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e94c545-564d-4f13-a11b-7ef6912f0f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:05.624762 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3149/6296] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:05 2022] DELETE /identity/v3/projects/bb76c3a27bc64b0ea32f9875da05877e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:05.629677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:05.630648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:05.630932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:05.688985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:05.692333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:05.814062 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3148/6297] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:05.820687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:05.823993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:05.824462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:05.891150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:05.892802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:05.911161 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3150/6298] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:05.912076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:05.925690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3f351-7408-4415-9c5d-30c8c40674bd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:05.944702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:05.945840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:05.946397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:05.946820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:05.947685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:05.948253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:05.950108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:05.979838 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3149/6299] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:05.984582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:06.012283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973baa83-2d6f-49aa-94ee-22119ca0a6ea None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:06.048934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:06.049571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:06.049933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:06.050210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:06.055380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:06.058750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:06.159458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3151/6300] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:05 2022] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:06.163320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:06.184211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9639b9-9432-41d8-a4b1-b028871e9ef9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:06.323763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:06.331415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:06.331415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:06.331415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:06.331415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:06.331415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:06.445009 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3150/6301] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:06 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:06.449717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:06.467867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89522b6d-9100-442b-8a78-fe0e13bcf7ea admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:06.474684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:06.475658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:06.476110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:06.476553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:06.480746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:06.480746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:06.526484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:06.535425 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3152/6302] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:06.540149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29f4d0-0e50-4cce-8b3f-3eb0ea334db0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:06.561692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7561-9e4b-4df6-b6f6-7696d17b32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:06.563939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7561-9e4b-4df6-b6f6-7696d17b32e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:06.565181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7561-9e4b-4df6-b6f6-7696d17b32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:06.565479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7561-9e4b-4df6-b6f6-7696d17b32e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:06.567368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7561-9e4b-4df6-b6f6-7696d17b32e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:06.570222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7561-9e4b-4df6-b6f6-7696d17b32e1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:06.612746 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3151/6303] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:06.616023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:06.623595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:06.650893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da20060-0071-422d-85b9-8b36af22b098 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:06.674852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:06.676911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:06.677374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:06.677829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] PATH_INFO: `/v3/projects/e50f72b5dbad4d2a95a78f8544ca4a63/users/4de6d5d79c604f86b202b790623f5932/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:06.708652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50f72b5dbad4d2a95a78f8544ca4a63, user_id=4de6d5d79c604f86b202b790623f5932, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:06.712091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:06.922282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:06.922918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3153/6304] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:06 2022] PUT /identity/v3/projects/e50f72b5dbad4d2a95a78f8544ca4a63/users/4de6d5d79c604f86b202b790623f5932/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:06.923138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:06.923550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:06.992565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] MFA Rules not processed for user `4de6d5d79c604f86b202b790623f5932`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:06.994113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:07.122033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3152/6305] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:07.126101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:07.224803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:07.259814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c7392-8efc-4b14-8be7-da4a06982d9b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:07.267321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6d03-3778-405b-9502-349adcf2e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:07.268319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6d03-3778-405b-9502-349adcf2e020 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:07.268801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6d03-3778-405b-9502-349adcf2e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:07.269253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6d03-3778-405b-9502-349adcf2e020 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:07.271111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6d03-3778-405b-9502-349adcf2e020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:07.273598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6d03-3778-405b-9502-349adcf2e020 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:07.384072 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3154/6306] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:07 2022] POST /identity/v3/projects => generated 399 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:21:07.387985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:07.417593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd2753-e7f7-4e13-a506-69e99e2fb659 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:07.533505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:07.534181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:07.535376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:07.535927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:07.536738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:07.560671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:07.646753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae4ca-1441-4403-a23c-56516c4a3224 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:07.647378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae4ca-1441-4403-a23c-56516c4a3224 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:07.647471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae4ca-1441-4403-a23c-56516c4a3224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:07.688610 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3153/6307] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:07 2022] POST /identity/v3/users => generated 306 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:07.689680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:07.726425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8ecb-0d69-4a7e-8b36-1f13a1542461 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:07.737069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:07.737723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:07.744082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:07.744423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:07.745133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:07.747953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:07.764042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ec4ae4ca-1441-4403-a23c-56516c4a3224 None None] MFA Rules not processed for user `0244b5ea667d4543827500408b2a7f47`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:07.766764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ec4ae4ca-1441-4403-a23c-56516c4a3224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:07.776287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3154/6308] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:07.778435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:07.798326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907548-7342-4822-8341-1b987d0d0868 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:07.803450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:07.804121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:07.804434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:07.804739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] PATH_INFO: `/v3/projects/fe888ef731384a848637963e4e0bd82f/users/c5e31f0226f942c28f67c90472d3ff79/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:07.843115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe888ef731384a848637963e4e0bd82f, user_id=c5e31f0226f942c28f67c90472d3ff79, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:07.845921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:07.897726 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3155/6309] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:07 2022] PUT /identity/v3/projects/fe888ef731384a848637963e4e0bd82f/users/c5e31f0226f942c28f67c90472d3ff79/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:07.899161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:07.928433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:07.979267 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3155/6310] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:07.989131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:07.989553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:07.990771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:08.030917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] MFA Rules not processed for user `0244b5ea667d4543827500408b2a7f47`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:08.032528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:08.090959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f302ae-2d4c-41d6-ba34-ef82041ad151 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:08.113062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:08.113737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:08.114058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:08.118220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:08.118958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:08.123209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:08.158007 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3156/6311] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:08.159938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:08.174459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:08.187826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5a3d-c75b-49cf-89b3-6e88cac4bc33 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:08.194452 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3156/6312] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:21:08.210322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca6e2-5824-4183-b553-fce7774ac291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:08.211331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca6e2-5824-4183-b553-fce7774ac291 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:08.212583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca6e2-5824-4183-b553-fce7774ac291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:08.213635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca6e2-5824-4183-b553-fce7774ac291 admin admin] PATH_INFO: `/v3/projects/fe888ef731384a848637963e4e0bd82f/users/c5e31f0226f942c28f67c90472d3ff79/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:08.219603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca6e2-5824-4183-b553-fce7774ac291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe888ef731384a848637963e4e0bd82f, user_id=c5e31f0226f942c28f67c90472d3ff79, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:08.230055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca6e2-5824-4183-b553-fce7774ac291 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:08.284572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:08.284572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:08.287331 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3157/6313] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:08 2022] PUT /identity/v3/projects/fe888ef731384a848637963e4e0bd82f/users/c5e31f0226f942c28f67c90472d3ff79/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:08.289713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:08.290224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:08.290648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:08.340201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] MFA Rules not processed for user `c5e31f0226f942c28f67c90472d3ff79`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:08.342441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:08.527126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0ae30-972a-424f-97aa-f72ef5c25a83 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:08.549950 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3158/6314] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:08.561124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:08.564086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:08.678483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:08.679859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:08.680479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:08.680939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:08.723542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc8af9-576e-4e10-a669-7976946ce978 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:08.733432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:08.734652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:08.734940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:08.735219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:08.756742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:08.758246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:08.780509 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3159/6315] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:21:08.807618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:08.815354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:08.869763 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3157/6316] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:09.017287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:09.018833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:09.139976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:09.159284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693441c2-64b1-46e6-ae72-309e6be66d67 service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:09.173501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2dde2-78cd-47ff-b27e-5a275e11ed28 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:09.175641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3be7b-9b75-4834-ae61-5aa3b8f05a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:09.176759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3be7b-9b75-4834-ae61-5aa3b8f05a06 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:09.179400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3be7b-9b75-4834-ae61-5aa3b8f05a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:09.183445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3be7b-9b75-4834-ae61-5aa3b8f05a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:09.194025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:09.195404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:09.202142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:09.203362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:09.203945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:09.206245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:09.258788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:09.258788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114776d-be2b-4bf3-a852-8476b0099779 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:09.292860 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3160/6317] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:09.418469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309593d-6e96-4a06-90a6-e7b151820a90 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:09.422826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309593d-6e96-4a06-90a6-e7b151820a90 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:09.422826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309593d-6e96-4a06-90a6-e7b151820a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:09.489062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3be7b-9b75-4834-ae61-5aa3b8f05a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:09.497877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3be7b-9b75-4834-ae61-5aa3b8f05a06 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:09.528591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7309593d-6e96-4a06-90a6-e7b151820a90 None None] MFA Rules not processed for user `9e152102d838476aaa5fbc061a18037f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:09.536511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7309593d-6e96-4a06-90a6-e7b151820a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:09.538709 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3158/6318] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:21:09.734015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:09.761938 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3161/6319] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:09.771539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:09.771816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:09.772294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:09.823369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] MFA Rules not processed for user `9e152102d838476aaa5fbc061a18037f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:09.827811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:09.861041 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3159/6320] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:09.873397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:09.882261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:09.882261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:09.921268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] MFA Rules not processed for user `9e152102d838476aaa5fbc061a18037f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:09.922649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:09.946398 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3162/6321] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:10.384566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:10.386705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:10.447289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7401b6a-9f05-4173-b235-1ee013ffde5d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:10.464691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336a6f-b770-47dc-8360-075aa006b436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:10.464691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336a6f-b770-47dc-8360-075aa006b436 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:10.465022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336a6f-b770-47dc-8360-075aa006b436 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:10.465173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336a6f-b770-47dc-8360-075aa006b436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:10.488827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d336a6f-b770-47dc-8360-075aa006b436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:10.490358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d336a6f-b770-47dc-8360-075aa006b436 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:10.522324 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3160/6322] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:10.694657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:10.696110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:10.854400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9425-d70d-4cb6-8012-35482362c1e7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:10.865780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:10.866544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:10.866906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:10.867197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] PATH_INFO: `/v3/users/396b3414ea4c481b9e196592dc07f029` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:10.868594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=396b3414ea4c481b9e196592dc07f029)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:10.871230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:11.150193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:11.203902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396b3414ea4c481b9e196592dc07f029'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:11.306602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396b3414ea4c481b9e196592dc07f029'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:11.351299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396b3414ea4c481b9e196592dc07f029'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:11.356295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396b3414ea4c481b9e196592dc07f029'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:11.365208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396b3414ea4c481b9e196592dc07f029'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:11.566352 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3163/6323] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:10 2022] DELETE /identity/v3/users/396b3414ea4c481b9e196592dc07f029 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:11.571104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3a0f1-0616-468a-bf29-4fa2a7fa46ec None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:11.571598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3a0f1-0616-468a-bf29-4fa2a7fa46ec None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:11.571668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3a0f1-0616-468a-bf29-4fa2a7fa46ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:11.630317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c7a3a0f1-0616-468a-bf29-4fa2a7fa46ec None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:11.633691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c7a3a0f1-0616-468a-bf29-4fa2a7fa46ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:11.823588 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3161/6324] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:11.859447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:11.861553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:11.994913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0df2a0-30d2-4ed1-aa69-01f6c9a742ce admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:12.001018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:12.001766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:12.002180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:12.002560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:12.047089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:12.049796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:12.079831 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3164/6325] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:12.412468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9514119-44ee-4168-8ccf-d21e725b9db6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:12.412468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9514119-44ee-4168-8ccf-d21e725b9db6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:12.412468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9514119-44ee-4168-8ccf-d21e725b9db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:12.487989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d9514119-44ee-4168-8ccf-d21e725b9db6 None None] MFA Rules not processed for user `9e152102d838476aaa5fbc061a18037f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:12.491459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d9514119-44ee-4168-8ccf-d21e725b9db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:12.807081 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3162/6326] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:13.389250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:13.390971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:13.434059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d351-c5f7-494d-b379-99cdd30baef8 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:13.448292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:13.449008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:13.449282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:13.449774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] PATH_INFO: `/v3/projects/cf34571ea6104d649614b71931a689de` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:13.451503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf34571ea6104d649614b71931a689de)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:13.456283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:13.628312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf34571ea6104d649614b71931a689de', 'request_id': 'req-6bef2bae-8690-49fd-af70-2c2b1016b11a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:13.639162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf34571ea6104d649614b71931a689de', 'request_id': 'req-6bef2bae-8690-49fd-af70-2c2b1016b11a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:13.650471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf34571ea6104d649614b71931a689de', 'request_id': 'req-6bef2bae-8690-49fd-af70-2c2b1016b11a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:13.789620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] The token cache is being invalidate because project cf34571ea6104d649614b71931a689de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:13.790454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:13.791260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6bef2bae-8690-49fd-af70-2c2b1016b11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:13.802595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:13.802888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:13.803202 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3165/6327] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:13 2022] DELETE /identity/v3/projects/cf34571ea6104d649614b71931a689de => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:13.814029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:13.868847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:13.871932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:14.052493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:14.066857 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3163/6328] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:14.075349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:14.075656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:14.075914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:14.123912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:14.126052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:14.185202 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3166/6329] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:14.188418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:14.214164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07aa7-33f6-4346-9b08-f06f2baca9e0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:14.231981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:14.232880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:14.234157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:14.234550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:14.235817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:14.245723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:14.245723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:14.256449 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3164/6330] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:14.263379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:14.276372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da957886-5310-4f00-9bfc-15e82d2cb468 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:14.320346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:14.320346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:14.320346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:14.320346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:14.320810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:14.330264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:14.547979 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3167/6331] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:14 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:14.553069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:14.591350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a24b1-ec4f-4e52-a266-90e5d55bd667 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:14.822904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:14.822904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:14.822904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:14.822904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:14.825002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:14.830802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:14.951843 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3165/6332] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:14 2022] POST /identity/v3/users => generated 288 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:14.955866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:14.971148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c40cf-83cc-420a-873c-0b3f362efdf4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:14.985089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee9a1b-ba67-4992-afec-a4d7134f0203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:14.985089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee9a1b-ba67-4992-afec-a4d7134f0203 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:14.985089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee9a1b-ba67-4992-afec-a4d7134f0203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:14.985089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee9a1b-ba67-4992-afec-a4d7134f0203 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:14.985417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee9a1b-ba67-4992-afec-a4d7134f0203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:14.985649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee9a1b-ba67-4992-afec-a4d7134f0203 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:14.995572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:15.064233 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3168/6333] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:15.067440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:15.075633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abef3-f05c-44dc-9e7d-0e0c67710c8b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:15.075917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abef3-f05c-44dc-9e7d-0e0c67710c8b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:15.076189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abef3-f05c-44dc-9e7d-0e0c67710c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:15.087631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cb1e4-db50-4371-8888-97f4bc59ef48 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:15.111373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:15.112016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:15.112298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:15.118926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:15.119725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:15.126734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:15.153037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-204abef3-f05c-44dc-9e7d-0e0c67710c8b None None] MFA Rules not processed for user `9e152102d838476aaa5fbc061a18037f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:15.162217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-204abef3-f05c-44dc-9e7d-0e0c67710c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:15.178149 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3166/6334] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:15.188846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:15.214406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799374-f75d-4e47-ab6c-3a4203dce08a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:15.215797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:15.216624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:15.216920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:15.217276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] PATH_INFO: `/v3/projects/8454196a6cda41e79de33d03e388ab02/users/9e8c709c0ab74558876b89226deb2ea6/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:15.295089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3169/6335] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:15.324914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8454196a6cda41e79de33d03e388ab02, user_id=9e8c709c0ab74558876b89226deb2ea6, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:15.336445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:15.489615 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3167/6336] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:15 2022] PUT /identity/v3/projects/8454196a6cda41e79de33d03e388ab02/users/9e8c709c0ab74558876b89226deb2ea6/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:15.505114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:15.507276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:15.507276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:15.604148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] MFA Rules not processed for user `9e8c709c0ab74558876b89226deb2ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:15.608641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:15.837089 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3170/6337] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:15.841638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:15.959679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4cf38-fddc-43b2-995c-51594286be60 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:15.984095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:15.985436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:15.986265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:15.986695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:15.987773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:15.992211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:16.074714 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3168/6338] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:15 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:16.079011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:16.104196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7bd6-97fb-4b33-a446-6a9883b1d105 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:16.278960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:16.280269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:16.281615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:16.282163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:16.283415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:16.287665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:16.402891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3171/6339] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:16 2022] POST /identity/v3/users => generated 295 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:16.405098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:16.424624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a382a-5000-44cf-936e-00c43c09b8a2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:16.434007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:16.435716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:16.436435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:16.436722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:16.437844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:16.439847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:16.475796 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3169/6340] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:16.480086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:16.495576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01d050-d97b-41c7-8183-4e38bbec6c25 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:16.510176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:16.510874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:16.511160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:16.511440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] PATH_INFO: `/v3/projects/8b81e1afd2df4701be762bfe5fe79dd9/users/34d404bcc53c47e883d06a621a52424b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:16.559900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b81e1afd2df4701be762bfe5fe79dd9, user_id=34d404bcc53c47e883d06a621a52424b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:16.564718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:16.670931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:16.678780 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3172/6341] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:16 2022] PUT /identity/v3/projects/8b81e1afd2df4701be762bfe5fe79dd9/users/34d404bcc53c47e883d06a621a52424b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:16.682937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:16.703503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b498-a14a-4376-8a1f-1a8ea05b6f43 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:16.722756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:16.912130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773d87b-7422-4997-b1ce-9dd93ee05d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:16.913206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d87b-7422-4997-b1ce-9dd93ee05d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:16.913511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d87b-7422-4997-b1ce-9dd93ee05d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:16.914596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d87b-7422-4997-b1ce-9dd93ee05d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:16.918332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773d87b-7422-4997-b1ce-9dd93ee05d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:16.945293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773d87b-7422-4997-b1ce-9dd93ee05d51 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:16.999203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:16.999440 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3170/6342] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:17.012526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf2c22-23ec-47ff-b96a-9bb266a9d884 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:17.043000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:17.043946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:17.044587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:17.045017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] PATH_INFO: `/v3/projects/8b81e1afd2df4701be762bfe5fe79dd9/users/34d404bcc53c47e883d06a621a52424b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:17.047766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b81e1afd2df4701be762bfe5fe79dd9, user_id=34d404bcc53c47e883d06a621a52424b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:17.054796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:17.089123 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3173/6343] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:16 2022] PUT /identity/v3/projects/8b81e1afd2df4701be762bfe5fe79dd9/users/34d404bcc53c47e883d06a621a52424b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:17.100999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:17.101288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:17.101798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:17.199039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] MFA Rules not processed for user `34d404bcc53c47e883d06a621a52424b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:17.211426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:17.439951 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3171/6344] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:17.453110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:17.455382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:17.574497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8a123-9e59-452c-b194-d7137fe6b5fb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:17.580548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:17.580548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:17.580776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:17.580938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:17.700890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:17.702398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:17.730600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3174/6345] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:19.670745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:19.672411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:19.753062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:19.754665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:19.831555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717044c7-8696-408c-bb5a-152adaeaff95 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:19.849286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:19.850076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:19.850360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:19.852616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] PATH_INFO: `/v3/users/db9e25f20e754e39b4ac5b3b56a2e0be` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:19.856491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9e25f20e754e39b4ac5b3b56a2e0be)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:19.863023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:20.061262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7847c4-efb1-4c64-ad8a-798dfcb2ec03 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:20.083314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:20.085215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:20.087920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:20.088313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:20.093537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:20.127522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:20.134580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c64d-93f0-4a7a-a9fd-fc1099befd0b service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:20.184754 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3175/6346] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:20.239745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:20.267737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9e25f20e754e39b4ac5b3b56a2e0be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:20.270472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9e25f20e754e39b4ac5b3b56a2e0be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:20.436582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9e25f20e754e39b4ac5b3b56a2e0be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:20.470700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9e25f20e754e39b4ac5b3b56a2e0be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:20.473507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9e25f20e754e39b4ac5b3b56a2e0be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:20.554743 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3172/6347] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:19 2022] DELETE /identity/v3/users/db9e25f20e754e39b4ac5b3b56a2e0be => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:20.563742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:20.564475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:20.565094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:20.620349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:20.622769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:20.689416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:20.842401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3176/6348] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:20.877000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:20.879385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:21.018990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c540a-8235-4d88-bf35-cfdc3f69d63d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:21.027343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:21.028658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:21.029459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:21.030543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:21.063608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:21.065322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:21.116834 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3173/6349] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:23.345558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:23.351294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:23.381510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915530-c0e2-459b-aac3-938c0843e621 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:23.387899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:23.388864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:23.389419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:23.390697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] PATH_INFO: `/v3/projects/1b40d330b05447a68220a015b9ed2d79` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:23.392458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b40d330b05447a68220a015b9ed2d79)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:23.395380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:23.565566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b40d330b05447a68220a015b9ed2d79', 'request_id': 'req-2e737af4-f7d9-4890-a483-ee9ff893009e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:23.576946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b40d330b05447a68220a015b9ed2d79', 'request_id': 'req-2e737af4-f7d9-4890-a483-ee9ff893009e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:23.586838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b40d330b05447a68220a015b9ed2d79', 'request_id': 'req-2e737af4-f7d9-4890-a483-ee9ff893009e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:23.690258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] The token cache is being invalidate because project 1b40d330b05447a68220a015b9ed2d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:23.690557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:23.692265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:23.700678 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3177/6350] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:23 2022] DELETE /identity/v3/projects/1b40d330b05447a68220a015b9ed2d79 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:23.702076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:23.720607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfccf2-e0c2-42d7-b630-ba37082fb392 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:23.840846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:23.843941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:23.851388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:23.852057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:23.852340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:23.855680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] PATH_INFO: `/v3/users/d084162977ba403eb9a8168df8076d22` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:23.857974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d084162977ba403eb9a8168df8076d22)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:23.863303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e737af4-f7d9-4890-a483-ee9ff893009e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:23.868041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:23.869399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:23.870232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:23.870653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:23.871033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] PATH_INFO: `/v3/users/4de6d5d79c604f86b202b790623f5932` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:23.872574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de6d5d79c604f86b202b790623f5932)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:23.875803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:24.160753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd084162977ba403eb9a8168df8076d22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.161946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd084162977ba403eb9a8168df8076d22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.194007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de6d5d79c604f86b202b790623f5932'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.224707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de6d5d79c604f86b202b790623f5932'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.239255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de6d5d79c604f86b202b790623f5932'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.241047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd084162977ba403eb9a8168df8076d22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.243576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de6d5d79c604f86b202b790623f5932'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.246507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:24.251607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de6d5d79c604f86b202b790623f5932'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.256062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd084162977ba403eb9a8168df8076d22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.257993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9ba7457d-a004-4551-b876-40dd38898aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd084162977ba403eb9a8168df8076d22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:24.287529 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3174/6351] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:23 2022] DELETE /identity/v3/users/d084162977ba403eb9a8168df8076d22 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:24.383925 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3178/6352] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:23 2022] DELETE /identity/v3/users/4de6d5d79c604f86b202b790623f5932 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:24.391544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:24.391835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:24.392285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:24.444486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:24.445842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:24.587807 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3175/6353] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:24.611126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:24.614467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:24.654517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:24.750099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36524e4a-f92a-4d9e-96db-a6193beb57cc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:24.754650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17614ff0-b590-4aee-a1d6-36c58ff023a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:24.755249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17614ff0-b590-4aee-a1d6-36c58ff023a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:24.755530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17614ff0-b590-4aee-a1d6-36c58ff023a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:24.755803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17614ff0-b590-4aee-a1d6-36c58ff023a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:24.767413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17614ff0-b590-4aee-a1d6-36c58ff023a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:24.770000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17614ff0-b590-4aee-a1d6-36c58ff023a7 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:24.782876 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3179/6354] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:25.251391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:25.251391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:25.251391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4c95e-9458-45c5-b38c-99b00e399b89 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:25.252438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:25.252438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:25.252438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:25.252438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] PATH_INFO: `/v3/projects/910a48465aab440f974b9c98f29ca17c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:25.267866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910a48465aab440f974b9c98f29ca17c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:25.277414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:25.451750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910a48465aab440f974b9c98f29ca17c', 'request_id': 'req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:25.462581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910a48465aab440f974b9c98f29ca17c', 'request_id': 'req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:25.472784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910a48465aab440f974b9c98f29ca17c', 'request_id': 'req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:25.562808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] The token cache is being invalidate because project 910a48465aab440f974b9c98f29ca17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:25.564065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:25.564065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:25.567083 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3176/6355] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:25 2022] DELETE /identity/v3/projects/910a48465aab440f974b9c98f29ca17c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:25.574017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ed0b8-454d-44d8-adec-e1b05d64202e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:25.574561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ed0b8-454d-44d8-adec-e1b05d64202e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:25.574561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ed0b8-454d-44d8-adec-e1b05d64202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:25.589065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:25.599505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:25.714704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1a8ed0b8-454d-44d8-adec-e1b05d64202e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:25.720103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a8ed0b8-454d-44d8-adec-e1b05d64202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:25.845703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57e08-5fa9-46c8-a1d4-18abe5fc1508 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:25.853385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:25.854526 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3180/6356] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:25.854993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:25.855282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:25.855557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] PATH_INFO: `/v3/users/14058d5524844940ba76b0ec13dab362` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:25.860666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14058d5524844940ba76b0ec13dab362)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:25.861357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:25.861544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:25.862086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:25.869622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:25.895119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:25.897264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:25.912746 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3181/6357] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:25.917085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:25.932685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda09ba-86d4-4d31-a926-c83c3ffbaea0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:25.939367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:25.940148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:25.940534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:25.940818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:25.941890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:25.943231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:25.945141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:25.966817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3182/6358] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:25.969419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:25.990166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18168f-caad-4da7-bbd6-3aef5874f2d7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:25.996822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:25.997446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:25.997733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:25.998651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:25.998894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.001040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.165692 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3183/6359] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:25 2022] POST /identity/v3/projects => generated 359 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:26.167593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:26.181341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14058d5524844940ba76b0ec13dab362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:26.182821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14058d5524844940ba76b0ec13dab362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:26.190433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:26.215947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:26.275022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14058d5524844940ba76b0ec13dab362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:26.286501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14058d5524844940ba76b0ec13dab362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:26.287246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14058d5524844940ba76b0ec13dab362'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:26.325984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b1a5-1835-4513-8de3-796ba5bfff44 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:26.332496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:26.333578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.334415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.334844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.338074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:26.351607 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3177/6360] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:25 2022] DELETE /identity/v3/users/14058d5524844940ba76b0ec13dab362 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:26.360142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:26.364392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:26.432295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:26.480456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.485227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452003d8-4fd9-4e67-b27b-1fe501b9a30a service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.488921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45425e-82fd-428c-a8f6-d441b307e0f7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:26.495423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:26.496059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.496343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.496616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.497263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.499922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.506125 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3184/6361] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:26.512065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.512065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.512065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.580477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:26.604914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:26.611827 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3178/6362] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:26 2022] POST /identity/v3/users => generated 280 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:26.617560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:26.644092 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3185/6363] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:26.652049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5663cfd-15ff-4fb7-9aa2-58ef90a3bc1d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:26.664868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:26.665274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:26.666618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.666618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.666954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.667530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.668022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:26.669224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.691725 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3179/6364] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:26.694940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:26.720273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda5c4-60ea-4f36-b34f-e9b465ece1db admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:26.729149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:26.729793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.730171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.730460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.731169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.739921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.745380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd913e9-74cb-4aa2-8f22-9a19cb9899cd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:26.752956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b959cdc-91c1-4df2-8d7e-2277aaa487fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:26.756605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959cdc-91c1-4df2-8d7e-2277aaa487fe service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.757269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959cdc-91c1-4df2-8d7e-2277aaa487fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.757617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959cdc-91c1-4df2-8d7e-2277aaa487fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.760008 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3180/6365] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:26.765229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:26.780894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b959cdc-91c1-4df2-8d7e-2277aaa487fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.782818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b959cdc-91c1-4df2-8d7e-2277aaa487fe service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.795647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9e6e0-75cf-40cf-b969-c500c516f192 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:26.802924 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3186/6366] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:26.806865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:26.807776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.808252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.808412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] PATH_INFO: `/v3/projects/c7f97e908b334b808ed74e6be6235934/users/2cf148b544884423af0afbfee7c57a58/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:26.829691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f97e908b334b808ed74e6be6235934, user_id=2cf148b544884423af0afbfee7c57a58, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:26.833503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:26.957760 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3181/6367] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:26 2022] PUT /identity/v3/projects/c7f97e908b334b808ed74e6be6235934/users/2cf148b544884423af0afbfee7c57a58/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:26.964569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:26.965710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:26.966312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:27.058709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] MFA Rules not processed for user `2cf148b544884423af0afbfee7c57a58`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:27.060214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:27.163338 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3187/6368] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:27.199408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:27.201892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:27.276330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0170-4848-41a0-a87d-f1997b5cfb9d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:27.285392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:27.285583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:27.285725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:27.286394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:27.286717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:27.286893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:27.301426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:27.308053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:27.327093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3182/6369] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:27.356831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:27.442909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c543fb-7cb6-4618-86c2-df1ecc571c8a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:27.449921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:27.450674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:27.451143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:27.451586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] PATH_INFO: `/v3/projects/e50f72b5dbad4d2a95a78f8544ca4a63` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:27.453508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50f72b5dbad4d2a95a78f8544ca4a63)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:27.455950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:27.498759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9875759-56c7-4354-8f15-e5a7e962b40a service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:27.504043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:27.504716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:27.505135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:27.505555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] PATH_INFO: `/v3/users/2cf148b544884423af0afbfee7c57a58` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:27.507824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf148b544884423af0afbfee7c57a58)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:27.509767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:27.572631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:27.605522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50f72b5dbad4d2a95a78f8544ca4a63', 'request_id': 'req-5d758427-6de0-4f9d-a94c-9f2be6ccf968'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.611750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50f72b5dbad4d2a95a78f8544ca4a63', 'request_id': 'req-5d758427-6de0-4f9d-a94c-9f2be6ccf968'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.620736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50f72b5dbad4d2a95a78f8544ca4a63', 'request_id': 'req-5d758427-6de0-4f9d-a94c-9f2be6ccf968'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.718030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] The token cache is being invalidate because project e50f72b5dbad4d2a95a78f8544ca4a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:27.718351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.719588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.724482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3188/6370] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:27 2022] DELETE /identity/v3/projects/e50f72b5dbad4d2a95a78f8544ca4a63 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:27.724482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:27.726437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:27.731287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf148b544884423af0afbfee7c57a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.732329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf148b544884423af0afbfee7c57a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.800974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d758427-6de0-4f9d-a94c-9f2be6ccf968 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:27.806342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:27.806908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:27.807327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:27.807456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] PATH_INFO: `/v3/projects/2ad2e60f35c14eef8d2f43fe942193db` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:27.808699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad2e60f35c14eef8d2f43fe942193db)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:27.810638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:27.832569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf148b544884423af0afbfee7c57a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.844891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf148b544884423af0afbfee7c57a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.845843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf148b544884423af0afbfee7c57a58'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.874874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3183/6371] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:27 2022] DELETE /identity/v3/users/2cf148b544884423af0afbfee7c57a58 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:27.883796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:27.886510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:27.907059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:27.968960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e527e-eab3-43eb-b54a-73e96ecb2c8a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:27.976631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad2e60f35c14eef8d2f43fe942193db', 'request_id': 'req-6d6553c1-74e2-404b-9ef0-c427db9a786f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.983560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad2e60f35c14eef8d2f43fe942193db', 'request_id': 'req-6d6553c1-74e2-404b-9ef0-c427db9a786f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:27.992002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad2e60f35c14eef8d2f43fe942193db', 'request_id': 'req-6d6553c1-74e2-404b-9ef0-c427db9a786f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.032120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:28.032763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.033061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.033399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] PATH_INFO: `/v3/users/c5e31f0226f942c28f67c90472d3ff79` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.034616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e31f0226f942c28f67c90472d3ff79)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:28.037075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:28.081069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] The token cache is being invalidate because project 2ad2e60f35c14eef8d2f43fe942193db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:28.081289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.082661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6d6553c1-74e2-404b-9ef0-c427db9a786f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.084336 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3189/6372] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:27 2022] DELETE /identity/v3/projects/2ad2e60f35c14eef8d2f43fe942193db => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:28.085571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9cb9-b3a1-433c-a025-b3cbe6e0546a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.085876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9cb9-b3a1-433c-a025-b3cbe6e0546a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.086213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9cb9-b3a1-433c-a025-b3cbe6e0546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.106893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-714d9cb9-b3a1-433c-a025-b3cbe6e0546a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:28.108239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-714d9cb9-b3a1-433c-a025-b3cbe6e0546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:28.116524 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3190/6373] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:28.119933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.119933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.119933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.138972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:28.140116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:28.149221 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3191/6374] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:28.161242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:28.161242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:28.232937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e31f0226f942c28f67c90472d3ff79'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.234737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e31f0226f942c28f67c90472d3ff79'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.235905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:28.244836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1864e2-d316-4e2a-9f2c-85729dd30cc6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:28.253233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245111b-b133-4dde-abaf-018c8dd567fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:28.258843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245111b-b133-4dde-abaf-018c8dd567fc service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.259442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245111b-b133-4dde-abaf-018c8dd567fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.259908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245111b-b133-4dde-abaf-018c8dd567fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.276362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245111b-b133-4dde-abaf-018c8dd567fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:28.277951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245111b-b133-4dde-abaf-018c8dd567fc service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:28.293451 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3192/6375] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:28.295113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.305388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.305388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.320179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:28.321692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:28.327112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e31f0226f942c28f67c90472d3ff79'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.339631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e31f0226f942c28f67c90472d3ff79'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.341314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e31f0226f942c28f67c90472d3ff79'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:28.350443 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3193/6376] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:28.369035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:28.383525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddc901-8595-43c4-ad8b-46b3859528a0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:28.395708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:28.396495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.396840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.397195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.398027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:28.399912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:28.401682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:28.423219 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3184/6377] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:27 2022] DELETE /identity/v3/users/c5e31f0226f942c28f67c90472d3ff79 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:28.451502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:28.451807 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3194/6378] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:28.453243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:28.547266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e03ab-f5ad-470f-8def-50023e872400 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:28.568573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:28.569409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.569805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.570236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.571020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:28.573150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:28.731962 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3185/6379] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:28 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:21:28.736563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:28.757000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eaa49-5a9a-4932-9f25-cfe6fd1f7156 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:28.881163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:28.882043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:28.882395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:28.882682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:28.883424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:28.886343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:29.041038 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3195/6380] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:28 2022] POST /identity/v3/users => generated 286 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:29.045747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:29.062835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952f56b-99c4-422b-8500-4010347db985 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:29.074006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:29.076260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:29.077198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:29.078383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:29.079736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:29.083447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:29.111037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:29.116407 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3186/6381] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:29.132210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdde5b-da38-4fdd-9e25-b030b068b28a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:29.149745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf293d-7cb9-41bb-941b-268e0e9be288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:29.150568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf293d-7cb9-41bb-941b-268e0e9be288 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:29.151241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf293d-7cb9-41bb-941b-268e0e9be288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:29.152242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf293d-7cb9-41bb-941b-268e0e9be288 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:29.153056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf293d-7cb9-41bb-941b-268e0e9be288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:29.163523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf293d-7cb9-41bb-941b-268e0e9be288 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:29.183105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3196/6382] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:21:29.186596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:29.204572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ade3-2c89-4ea3-940a-bd09a4de61ad admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:29.218723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:29.220754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:29.220754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:29.220754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] PATH_INFO: `/v3/projects/0bff07740e26403ebe33b88bbefb104b/users/bf7d46906cab4741af09081a9cf58304/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:29.256133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bff07740e26403ebe33b88bbefb104b, user_id=bf7d46906cab4741af09081a9cf58304, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:29.263239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:29.345231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3187/6383] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:29 2022] PUT /identity/v3/projects/0bff07740e26403ebe33b88bbefb104b/users/bf7d46906cab4741af09081a9cf58304/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:29.358083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:29.358256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:29.358629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:29.436464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] MFA Rules not processed for user `bf7d46906cab4741af09081a9cf58304`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:29.439927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:29.652559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:29.654487 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3197/6384] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:21:29.665072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:29.798484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa11a-ac85-4c43-9f1d-25532c5edd65 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:29.804743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:29.805380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:29.805666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:29.806965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:29.807690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:29.809953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:29.996219 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3188/6385] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:29 2022] POST /identity/v3/projects => generated 373 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:29.997458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.013234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166d1f4-62d8-4b2f-86de-1bc8feac0c28 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:30.112332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.114627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.115167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:30.115887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.116260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.116887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.117616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:30.120147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:30.147046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f4efe-d290-4de2-b8c2-3bc2a4d4261f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:30.157092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:30.160027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.160354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.160708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] PATH_INFO: `/v3/projects/c7f97e908b334b808ed74e6be6235934` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.162183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f97e908b334b808ed74e6be6235934)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:30.164564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:30.197529 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3198/6386] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:29 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:30.198527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.205973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.230116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfba06-2adf-4e39-ab52-669187b04405 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:30.233175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:30.234416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.234416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.235178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] PATH_INFO: `/v3/projects/fe888ef731384a848637963e4e0bd82f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.236573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe888ef731384a848637963e4e0bd82f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:30.241678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:30.246759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:30.308150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f97e908b334b808ed74e6be6235934', 'request_id': 'req-1dbe14a0-635d-491f-9d55-0fc99448fe42'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.314661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f97e908b334b808ed74e6be6235934', 'request_id': 'req-1dbe14a0-635d-491f-9d55-0fc99448fe42'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.322854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f97e908b334b808ed74e6be6235934', 'request_id': 'req-1dbe14a0-635d-491f-9d55-0fc99448fe42'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.361000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe888ef731384a848637963e4e0bd82f', 'request_id': 'req-ee68f44c-de67-4222-bd60-bbef42fd4a2e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.367704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe888ef731384a848637963e4e0bd82f', 'request_id': 'req-ee68f44c-de67-4222-bd60-bbef42fd4a2e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.375981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe888ef731384a848637963e4e0bd82f', 'request_id': 'req-ee68f44c-de67-4222-bd60-bbef42fd4a2e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.452652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] The token cache is being invalidate because project c7f97e908b334b808ed74e6be6235934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:30.453466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.453622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.457916 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3189/6387] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:30 2022] DELETE /identity/v3/projects/c7f97e908b334b808ed74e6be6235934 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:30.457916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.459536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.539842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] The token cache is being invalidate because project fe888ef731384a848637963e4e0bd82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:30.539842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.551205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe14a0-635d-491f-9d55-0fc99448fe42 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:30.552207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ee68f44c-de67-4222-bd60-bbef42fd4a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:30.557477 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3199/6388] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:30 2022] DELETE /identity/v3/projects/fe888ef731384a848637963e4e0bd82f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:30.560346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.560998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.562387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.596345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:30.597654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.650294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eefe0-ceec-4643-b405-d4bedea1e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:30.650954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eefe0-ceec-4643-b405-d4bedea1e355 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.651241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eefe0-ceec-4643-b405-d4bedea1e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.651522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eefe0-ceec-4643-b405-d4bedea1e355 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.652365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eefe0-ceec-4643-b405-d4bedea1e355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:30.654338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eefe0-ceec-4643-b405-d4bedea1e355 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:30.674046 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3190/6389] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:30.674046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd41ba-72f7-43bd-ae11-fbd458fa25ea None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.674046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd41ba-72f7-43bd-ae11-fbd458fa25ea None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.674046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd41ba-72f7-43bd-ae11-fbd458fa25ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.696690 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3200/6390] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:30.703051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-90cd41ba-72f7-43bd-ae11-fbd458fa25ea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:30.703051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-90cd41ba-72f7-43bd-ae11-fbd458fa25ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.704244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.705945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.721915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3191/6391] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:30.721915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc612-1b53-4655-9afb-750ecbc20156 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.721915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc612-1b53-4655-9afb-750ecbc20156 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.721915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc612-1b53-4655-9afb-750ecbc20156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.730269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450f00-89bd-4a2b-b10c-db956d1f1146 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:30.738480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:30.739705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.740202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.740769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] PATH_INFO: `/v3/projects/2ca6ba8d3cb747cbbd953a0ff1da3ed5/users/f0b63aed7fd243eda66f9d1d51e458d1/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.754697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d29fc612-1b53-4655-9afb-750ecbc20156 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:30.760029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d29fc612-1b53-4655-9afb-750ecbc20156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.786753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6ba8d3cb747cbbd953a0ff1da3ed5, user_id=f0b63aed7fd243eda66f9d1d51e458d1, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:30.795228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:30.807781 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3192/6392] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:30.814412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.814412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.814412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.855369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:30.859695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:30.875516 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3193/6393] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:30.885134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.895313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadd68a-d982-45b9-95be-24cb8d00b119 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:30.901153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:30.902281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:30.902994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:30.903628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:30.905534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:30.906056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:30.919393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:30.938613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3194/6394] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:30.938613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.948014 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3201/6395] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:30 2022] PUT /identity/v3/projects/2ca6ba8d3cb747cbbd953a0ff1da3ed5/users/f0b63aed7fd243eda66f9d1d51e458d1/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:30.949183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:30.950758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35f83-0fd3-4adb-9904-8e436c8c29e5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.063435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed9c6d-71eb-4a65-b727-ea8c4b516fe8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.069737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.070492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.070872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.071245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.072127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.078823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.108328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.113316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.113316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.113316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.113316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:31.113316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.113316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.128059 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3195/6396] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:31.134219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.148985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4af2f-101a-489b-88a2-cbd4c01539ad admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.156783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.158308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.158759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.159206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.161026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.165726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.345937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3202/6397] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:30 2022] POST /identity/v3/projects => generated 383 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:31.347453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.475693 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3196/6398] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:31.476612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.489671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65e26-be6f-47b2-a030-88090098921e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.492486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a904-fbed-4dd8-9977-396f0ce811e2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.498272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.499052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.499335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.499611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.500255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.502676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.508174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.509161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.509773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.510223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.512022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.516216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.629739 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3197/6399] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:31 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:31.631281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.645227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbbb6-ae89-460d-a73f-cf71101dac41 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.650927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.657082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.657082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.657082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] PATH_INFO: `/v3/projects/2ca6ba8d3cb747cbbd953a0ff1da3ed5/users/f0b63aed7fd243eda66f9d1d51e458d1/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.657082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6ba8d3cb747cbbd953a0ff1da3ed5, user_id=f0b63aed7fd243eda66f9d1d51e458d1, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.658797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.666801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3203/6400] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:31 2022] POST /identity/v3/projects => generated 371 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:31.671779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.678348 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3198/6401] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:31 2022] PUT /identity/v3/projects/2ca6ba8d3cb747cbbd953a0ff1da3ed5/users/f0b63aed7fd243eda66f9d1d51e458d1/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:31.679670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.803365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7785f-3994-43a0-a34d-2ec93724ae7a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.817352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803bb1d-7e04-4868-9981-577fe50038ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.818020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803bb1d-7e04-4868-9981-577fe50038ce admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.818314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803bb1d-7e04-4868-9981-577fe50038ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.818584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803bb1d-7e04-4868-9981-577fe50038ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.823637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeefe5d-409e-47d6-8944-aabbba22f957 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.824342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803bb1d-7e04-4868-9981-577fe50038ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.826105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803bb1d-7e04-4868-9981-577fe50038ce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.829634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.831206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.832986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.833358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.834961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.842080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.859639 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3204/6402] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:31.859639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.862085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.862504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.904892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] MFA Rules not processed for user `f0b63aed7fd243eda66f9d1d51e458d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:31.906615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:31.917146 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3199/6403] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:31 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:31.918140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.931974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076d92-c998-4698-9276-40d8800ec1e8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.938614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.939242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.939523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:31.939828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:31.940594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:31.944669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:31.960058 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3200/6404] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:31.961011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:31.991279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af5ca-dcc9-475d-9dc1-3602914059d0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:31.998163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:31.998947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:31.999401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.000030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.000861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.003953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.017714 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3201/6405] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:32.020554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.022775 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3205/6406] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:32.024120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.026148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:32.034072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8e4a5-0ab4-4cd2-a88a-94890fa5809a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.041424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4ab58-851f-475f-b60d-d509c7e31f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.042191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4ab58-851f-475f-b60d-d509c7e31f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.042518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4ab58-851f-475f-b60d-d509c7e31f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.042798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4ab58-851f-475f-b60d-d509c7e31f20 admin admin] PATH_INFO: `/v3/projects/d968046faf704b118371235d14323540/users/1849624f92574256bdaea862c1dc2bd0/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.063005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4ab58-851f-475f-b60d-d509c7e31f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d968046faf704b118371235d14323540, user_id=1849624f92574256bdaea862c1dc2bd0, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.076679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4ab58-851f-475f-b60d-d509c7e31f20 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.106914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f738c4a-5da1-4b4d-9d32-b63568d6e218 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.111103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.112005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.112257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.112867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.132384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.134131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.148084 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3206/6407] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:32.149120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.166372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804a9e-93a9-4177-b05d-7007eb609844 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.180883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.181806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.182323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.183416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.184677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.186891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.199320 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3202/6408] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:32 2022] PUT /identity/v3/projects/d968046faf704b118371235d14323540/users/1849624f92574256bdaea862c1dc2bd0/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:32.206616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.207376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.207376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.217305 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3207/6409] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:32.224654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.243542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e347-131a-4622-8be9-48323df30e0a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.265034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:32.276376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] MFA Rules not processed for user `1849624f92574256bdaea862c1dc2bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:32.278991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:32.383498 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3203/6410] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:32.385270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.386115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.386562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.386853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] PATH_INFO: `/v3/projects/bbd7dfae57fe4a82b45131484a759935/users/229b72c8d4d9465dbca107d30502d94a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.388493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.395375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:32.410133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dca3b-506d-4169-b26a-65f876f99164 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.419494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd7dfae57fe4a82b45131484a759935, user_id=229b72c8d4d9465dbca107d30502d94a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.423166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801973b-368b-44b5-af95-2a07ff03483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.423807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801973b-368b-44b5-af95-2a07ff03483b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.424095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801973b-368b-44b5-af95-2a07ff03483b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.424557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801973b-368b-44b5-af95-2a07ff03483b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.425711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801973b-368b-44b5-af95-2a07ff03483b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.425920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.427824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801973b-368b-44b5-af95-2a07ff03483b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.535148 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3208/6411] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:32 2022] PUT /identity/v3/projects/bbd7dfae57fe4a82b45131484a759935/users/229b72c8d4d9465dbca107d30502d94a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:32.536734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.539497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:32.558257 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3204/6412] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:32 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:21:32.558257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.558257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.558257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.606303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] MFA Rules not processed for user `229b72c8d4d9465dbca107d30502d94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:32.607631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:32.693599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3097f8-0d56-44a4-94bb-9a54dafdb1c5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.748879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3205/6413] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:32.755695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:32.791703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.792374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.792688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.792972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.799353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:32.959557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4cf10-8ca3-4c25-a144-4c4da63b0683 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:32.964601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:32.965253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:32.965544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:32.966181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:32.966548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.966846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:32.968460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.968783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:32.992810 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3209/6414] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:32.994261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.009658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944edce-4848-4f8f-95f6-6f08bf2ce993 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:33.013875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:33.014576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.014936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.015591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.036700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:33.039664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:33.054369 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3210/6415] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:33.072004 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3206/6416] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:32 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:33.077018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.092053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091b229-6c71-4f9b-a628-cacf50305ef2 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:33.095394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.104837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:33.105451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.105728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.106026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.109764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110da8d-95a2-47a2-a48b-0b04f56e42d0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:33.110920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:33.113811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:33.120660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:33.120808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.121000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.121459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] PATH_INFO: `/v3/users/229b72c8d4d9465dbca107d30502d94a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.123109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229b72c8d4d9465dbca107d30502d94a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:33.130343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:33.139524 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3211/6417] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:33.158025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.189193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce04e-d659-4c81-9421-eef4b6bd9f86 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:33.218084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:33.219303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.219303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.219708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.220969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:33.223571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:33.280639 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3212/6418] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:33.287678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.311849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031c906-985d-423b-bbaa-6e95c4dd31b7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:33.335282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57815f-f2b8-4330-8092-6fbc820aaa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:33.341313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57815f-f2b8-4330-8092-6fbc820aaa6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.342232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57815f-f2b8-4330-8092-6fbc820aaa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.343338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57815f-f2b8-4330-8092-6fbc820aaa6a admin admin] PATH_INFO: `/v3/projects/7c4fc9def2b540d989782f5926991d27/users/cedd8d27bc254ca28e552d8f57b25150/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.407068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229b72c8d4d9465dbca107d30502d94a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:33.410810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229b72c8d4d9465dbca107d30502d94a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:33.412459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57815f-f2b8-4330-8092-6fbc820aaa6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4fc9def2b540d989782f5926991d27, user_id=cedd8d27bc254ca28e552d8f57b25150, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:33.421722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57815f-f2b8-4330-8092-6fbc820aaa6a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:33.559805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229b72c8d4d9465dbca107d30502d94a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:33.573654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229b72c8d4d9465dbca107d30502d94a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:33.575217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-afc2047e-8197-44aa-954f-aa2b1f19bda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229b72c8d4d9465dbca107d30502d94a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:33.594470 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3213/6419] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:33 2022] PUT /identity/v3/projects/7c4fc9def2b540d989782f5926991d27/users/cedd8d27bc254ca28e552d8f57b25150/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:33.600595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.601212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.606837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.662831 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3207/6420] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:33 2022] DELETE /identity/v3/users/229b72c8d4d9465dbca107d30502d94a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:33.664722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.664722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.665092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.712440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] MFA Rules not processed for user `cedd8d27bc254ca28e552d8f57b25150`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:33.714104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:33.740324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:33.746824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:33.875094 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3214/6421] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:21:33.876125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.877668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:33.900869 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3208/6422] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:33.920996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:33.920996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:33.983707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105161d6-cf95-43fc-94fc-75d07a1b1a9e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:33.994356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:33.994991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:33.995285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:33.995556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:33.996200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.002837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.024311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653995-4ecf-4275-a7ed-2d0f77b5d3b7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:34.029905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:34.031101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.031851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.032288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.060385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.061963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.074304 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3209/6423] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:34.118653 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3215/6424] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:33 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:34.119771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:34.141749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c6c1-9b0b-431a-8590-70cbcece1309 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:34.233783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:34.235060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.235060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.235296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.235781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.238315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.322939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:34.330255 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3210/6425] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:34 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:21:34.351119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba14d9-81f5-4e18-91f9-2d730f855d40 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:34.356794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:34.358417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.358743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.359095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.359774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.361641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.383059 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3216/6426] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:34.384667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:34.405841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b039bc6-6583-4a55-b865-5f6bbf6381b1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:34.422657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:34.423348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.423636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.423921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] PATH_INFO: `/v3/projects/2b04e7594df3414b8009d57cc1b5aa33/users/f0d8243fbbcc4d559001d319143de448/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.440634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b04e7594df3414b8009d57cc1b5aa33, user_id=f0d8243fbbcc4d559001d319143de448, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.443500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.531194 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3211/6427] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:34 2022] PUT /identity/v3/projects/2b04e7594df3414b8009d57cc1b5aa33/users/f0d8243fbbcc4d559001d319143de448/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:21:34.535502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:34.577426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e610f80-bc24-4f62-b71c-1da896e2fe6c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:34.590434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:34.701663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:34.718295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4c533-be00-4a23-a468-481c9a040cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:34.719907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4c533-be00-4a23-a468-481c9a040cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.720725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4c533-be00-4a23-a468-481c9a040cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.736355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4c533-be00-4a23-a468-481c9a040cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.739859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4c533-be00-4a23-a468-481c9a040cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.742266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4c533-be00-4a23-a468-481c9a040cc2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.765264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3217/6428] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:34.770567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:34.793295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162801-d9d1-4ad3-b6d6-ae4ddd213cbc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:34.808310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:34.809051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.809331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.809597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] PATH_INFO: `/v3/projects/2b04e7594df3414b8009d57cc1b5aa33/users/f0d8243fbbcc4d559001d319143de448/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.812019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b04e7594df3414b8009d57cc1b5aa33, user_id=f0d8243fbbcc4d559001d319143de448, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:34.814908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:34.830256 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3212/6429] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:34 2022] PUT /identity/v3/projects/2b04e7594df3414b8009d57cc1b5aa33/users/f0d8243fbbcc4d559001d319143de448/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:34.846084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:34.846372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:34.847040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:34.895512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] MFA Rules not processed for user `f0d8243fbbcc4d559001d319143de448`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:34.896947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:34.991923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3218/6430] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:35.160634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:35.162965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:35.242898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f14c3b-c8c8-459a-8399-71be382bd92a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:35.248408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:35.249244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:35.249572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:35.249845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] PATH_INFO: `/v3/projects/bbd7dfae57fe4a82b45131484a759935` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:35.251185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd7dfae57fe4a82b45131484a759935)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:35.253040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:35.305435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:35.305435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:35.424314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd7dfae57fe4a82b45131484a759935', 'request_id': 'req-277f0167-c3a7-4137-b14f-a86d70b38f0c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:35.428492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ff6df-1cf1-4174-9028-964e81896471 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:35.448393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd7dfae57fe4a82b45131484a759935', 'request_id': 'req-277f0167-c3a7-4137-b14f-a86d70b38f0c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:35.456620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd7dfae57fe4a82b45131484a759935', 'request_id': 'req-277f0167-c3a7-4137-b14f-a86d70b38f0c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:35.562542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:35.563189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:35.563483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:35.563763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:35.566278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:35.598801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] The token cache is being invalidate because project bbd7dfae57fe4a82b45131484a759935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:35.601803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:35.601803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-277f0167-c3a7-4137-b14f-a86d70b38f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:35.605964 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3213/6431] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:35 2022] DELETE /identity/v3/projects/bbd7dfae57fe4a82b45131484a759935 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:35.607479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f26-96d3-4196-aed0-cf2db7eb2d5b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:35.608179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f26-96d3-4196-aed0-cf2db7eb2d5b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:35.608179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f26-96d3-4196-aed0-cf2db7eb2d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:35.632499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b3718f26-96d3-4196-aed0-cf2db7eb2d5b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:35.634390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b3718f26-96d3-4196-aed0-cf2db7eb2d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:35.731355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3214/6432] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:35.732855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:35.733150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:35.733737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:35.745032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:35.749196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:35.772582 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3219/6433] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:21:35.792683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:35.792683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:35.837915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:35.839445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:35.846584 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3215/6434] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:35.855016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37712c28-c475-48c6-9319-15a847d069fb service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:35.860630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:35.861270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:35.861617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:35.861920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:35.863424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:35.863950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:35.865866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:35.892532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:35.902845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3220/6435] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:21:35.915332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9e5e-7837-403c-b8d7-8f3ff4590594 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:35.929148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:35.929894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:35.930457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:35.932017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:35.932703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:35.939589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:36.082741 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3216/6436] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:35 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:36.084613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:36.100469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16244d7b-15f9-45d6-bb7f-53577abb1e19 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:36.202048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:36.202048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:36.203735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:36.203898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:36.213932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:36.224022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:36.269799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:36.327891 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3221/6437] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:36 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:36.332577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:36.360165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f27f7-b2ba-41ea-87fe-c7efe98fa3fa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:36.368875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:36.369582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:36.369914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:36.371333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:36.372051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:36.375540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:36.389745 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3217/6438] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:36.391432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:36.403467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4f26-5a00-4185-88d0-38ab113f8a53 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:36.408963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a14314-8747-4242-844e-0837e4e2eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:36.409710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14314-8747-4242-844e-0837e4e2eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:36.410119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14314-8747-4242-844e-0837e4e2eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:36.410469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14314-8747-4242-844e-0837e4e2eb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:36.411199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14314-8747-4242-844e-0837e4e2eb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:36.412884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14314-8747-4242-844e-0837e4e2eb8e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:36.424843 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3222/6439] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:36.429576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:36.441497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70590fa7-114d-4233-a4d7-b3036b453cfa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:36.447283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:36.448062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:36.448468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:36.449083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] PATH_INFO: `/v3/projects/a4b5048172f945548a03b8dc5deeccff/users/c8630555ac4a44a3a4983856693a605c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:36.468020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b5048172f945548a03b8dc5deeccff, user_id=c8630555ac4a44a3a4983856693a605c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:36.471573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:36.627286 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3218/6440] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:36 2022] PUT /identity/v3/projects/a4b5048172f945548a03b8dc5deeccff/users/c8630555ac4a44a3a4983856693a605c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:36.638331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:36.638624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:36.639336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:36.698447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] MFA Rules not processed for user `c8630555ac4a44a3a4983856693a605c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:36.700798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:36.849088 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3223/6441] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:36.862928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:36.865977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:36.947321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:36.964479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca011b4-e38e-4c16-817e-2333789126a4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:36.968724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:36.970569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:36.970996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:36.971456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:36.985600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:36.987104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:37.001731 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3219/6442] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:37.013358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:38.481248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:38.572700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:39.728671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:39.730231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:39.753343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3add29-d27d-4d89-95e4-c44487c54f7b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:39.773148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:39.778650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:39.779202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:39.779765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:39.785127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:39.956305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:39.958683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:39.990881 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3224/6443] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:40.961097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:40.995408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:42.584077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:42.592161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:42.610364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7b841-7875-477a-bb1c-311e5ded5efd service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:42.619894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:42.620931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:42.621407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:42.622003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:42.624003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:42.725219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:42.727143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:42.788737 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3220/6444] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:45.332197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:47.248990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:47.252344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:47.383548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca372-99fc-49db-80d1-f728d1696cb0 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:47.388857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:47.389631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:47.390202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:47.390573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] PATH_INFO: `/v3/users/0244b5ea667d4543827500408b2a7f47` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:47.391849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0244b5ea667d4543827500408b2a7f47)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:47.395252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:47.682046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0244b5ea667d4543827500408b2a7f47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:47.699421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0244b5ea667d4543827500408b2a7f47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:47.709603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0244b5ea667d4543827500408b2a7f47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:47.710654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0244b5ea667d4543827500408b2a7f47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:47.711450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8f1ba8d6-af47-4d55-afeb-9e4fb393ee0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0244b5ea667d4543827500408b2a7f47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:47.875390 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3225/6445] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:47 2022] DELETE /identity/v3/users/0244b5ea667d4543827500408b2a7f47 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:48.223679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:48.240644 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57705ada-5e54-47e1-ade9-302237b59a36 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:48.337579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:48.369824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:48.370805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:48.371444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:48.371859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] PATH_INFO: `/v3/projects/4dce5b0fe7b344798afba0361d13f457` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:48.373708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dce5b0fe7b344798afba0361d13f457)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:48.376789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:48.562146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dce5b0fe7b344798afba0361d13f457', 'request_id': 'req-3facdd88-1b3b-44d0-8e70-ef22e247da7f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:48.576769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dce5b0fe7b344798afba0361d13f457', 'request_id': 'req-3facdd88-1b3b-44d0-8e70-ef22e247da7f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:48.586850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dce5b0fe7b344798afba0361d13f457', 'request_id': 'req-3facdd88-1b3b-44d0-8e70-ef22e247da7f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:48.871377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] The token cache is being invalidate because project 4dce5b0fe7b344798afba0361d13f457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:48.871377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:48.872137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3facdd88-1b3b-44d0-8e70-ef22e247da7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:48.878755 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3221/6446] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:48 2022] DELETE /identity/v3/projects/4dce5b0fe7b344798afba0361d13f457 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:48.880807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:48.881250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:48.881390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:48.905496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:48.907482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:49.008132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:49.033324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.033639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.034513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.045585 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3226/6447] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:49.078669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:49.085089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:49.089885 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3222/6448] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:49.094361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:49.110829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf71f4-c458-4c22-b666-79528303c294 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:49.115996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:49.116646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.116822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.117089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.117976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:21:49.118505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:49.120327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:49.134827 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3227/6449] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:21:49.139282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:49.153541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce2234-7312-42be-9de8-4bf27d4e7f5c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:49.159656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:49.160281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.160557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.160876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.161535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:49.163704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:49.312560 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3223/6450] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:21:49 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:49.317332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:49.342244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44fdd-0353-4fd0-b446-4e0449afa38e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:49.486476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:49.487654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.488511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.488947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.489868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:49.493605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:49.676934 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3228/6451] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:21:49 2022] POST /identity/v3/users => generated 295 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:21:49.678758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:49.719126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d22f0-28e9-4242-aff3-e0f826c2b578 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:49.741560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:49.749093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.749093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.749093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.749093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:49.749093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:49.795195 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3224/6452] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:21:49.801072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:49.812200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5162f-8f2a-4c79-b44d-3631bf251aa2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:49.828685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff3b42-2ccd-4941-a734-633765671ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:49.831610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3b42-2ccd-4941-a734-633765671ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.840727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3b42-2ccd-4941-a734-633765671ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.840727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3b42-2ccd-4941-a734-633765671ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.840727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff3b42-2ccd-4941-a734-633765671ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:49.840727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff3b42-2ccd-4941-a734-633765671ea2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:49.901070 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3229/6453] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:21:49.904953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:49.924594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb89f7-e93d-4d7a-a542-9a140a069c4f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:49.936379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:49.937048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:49.937325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:49.937565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] PATH_INFO: `/v3/projects/cd0d0379a2ef431c98328e490b1febcd/users/cb0cd81939cf4620b52a7aa4b9882c8d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:49.968670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0d0379a2ef431c98328e490b1febcd, user_id=cb0cd81939cf4620b52a7aa4b9882c8d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:49.973041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:50.083332 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3225/6454] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:21:49 2022] PUT /identity/v3/projects/cd0d0379a2ef431c98328e490b1febcd/users/cb0cd81939cf4620b52a7aa4b9882c8d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:50.088250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:50.088544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:50.088824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:50.122838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:50.124276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:50.241393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3230/6455] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:50.255237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:50.257088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:50.373893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:50.410604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a2f85-3da3-4eea-ad16-d4cf3f1e9c92 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:50.426719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42874931-ce71-458a-bff7-7e0cc7869b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:50.430515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42874931-ce71-458a-bff7-7e0cc7869b6c service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:50.430515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42874931-ce71-458a-bff7-7e0cc7869b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:50.430515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42874931-ce71-458a-bff7-7e0cc7869b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:50.447566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42874931-ce71-458a-bff7-7e0cc7869b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:50.449554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42874931-ce71-458a-bff7-7e0cc7869b6c service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:50.481444 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3226/6456] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:55.544208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:55.545967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:55.586092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc64cd-010e-433e-b86d-58f636ec5d2e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:55.622728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:55.623559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:55.624072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:55.624555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] PATH_INFO: `/v3/users/1849624f92574256bdaea862c1dc2bd0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:55.630929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1849624f92574256bdaea862c1dc2bd0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:55.633404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:56.108730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1849624f92574256bdaea862c1dc2bd0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:56.133919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:56.136212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1849624f92574256bdaea862c1dc2bd0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:56.152109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1849624f92574256bdaea862c1dc2bd0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:56.152885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1849624f92574256bdaea862c1dc2bd0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:56.153513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1849624f92574256bdaea862c1dc2bd0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:56.295534 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3231/6457] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:55 2022] DELETE /identity/v3/users/1849624f92574256bdaea862c1dc2bd0 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:56.301502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:56.302295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:56.302295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:56.350762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:21:56.352124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:56.411661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:56.601944 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3227/6458] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:21:56.618528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:56.620738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:56.777133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c6ce-e993-4f2f-831b-404fec4ba8e5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:56.798827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:56.799689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:56.800425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:56.800711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:56.839920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:56.841500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:56.901994 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3232/6459] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:58.149512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:58.151054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:58.170480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85403-469c-4ca9-a7ee-eb4139667c11 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:58.195061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:58.195061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:58.195061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:58.195061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] PATH_INFO: `/v3/projects/d968046faf704b118371235d14323540` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:58.195354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d968046faf704b118371235d14323540)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:58.195354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:58.597500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd968046faf704b118371235d14323540', 'request_id': 'req-d0269804-42ba-4afb-9b44-34845803cee1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:58.610051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd968046faf704b118371235d14323540', 'request_id': 'req-d0269804-42ba-4afb-9b44-34845803cee1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:58.623219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd968046faf704b118371235d14323540', 'request_id': 'req-d0269804-42ba-4afb-9b44-34845803cee1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:58.764465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] The token cache is being invalidate because project d968046faf704b118371235d14323540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:21:58.765147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:58.767022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:58.770959 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3228/6460] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:21:58 2022] DELETE /identity/v3/projects/d968046faf704b118371235d14323540 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:21:58.775756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:58.799163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1a9b2-055a-44b7-acce-af8bc7c54a37 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:58.988176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:58.989088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:58.989539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:58.990268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] PATH_INFO: `/v3/users/cedd8d27bc254ca28e552d8f57b25150` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:58.991894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedd8d27bc254ca28e552d8f57b25150)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:58.994151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:59.330025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedd8d27bc254ca28e552d8f57b25150'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:59.365777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedd8d27bc254ca28e552d8f57b25150'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:59.391419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedd8d27bc254ca28e552d8f57b25150'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:59.392603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedd8d27bc254ca28e552d8f57b25150'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:59.393706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedd8d27bc254ca28e552d8f57b25150'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:21:59.535048 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3233/6461] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:21:58 2022] DELETE /identity/v3/users/cedd8d27bc254ca28e552d8f57b25150 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:00.200835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:00.665933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:00.665933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:00.713282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269804-42ba-4afb-9b44-34845803cee1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:00.994159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:00.995024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:00.995352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:00.995633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] PATH_INFO: `/v3/projects/7c4fc9def2b540d989782f5926991d27` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.003409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4fc9def2b540d989782f5926991d27)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.005392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.244812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:01.252576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4fc9def2b540d989782f5926991d27', 'request_id': 'req-1c93812f-4825-4cef-bd18-735d28261059'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.267689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4fc9def2b540d989782f5926991d27', 'request_id': 'req-1c93812f-4825-4cef-bd18-735d28261059'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.279368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4fc9def2b540d989782f5926991d27', 'request_id': 'req-1c93812f-4825-4cef-bd18-735d28261059'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.438729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] The token cache is being invalidate because project 7c4fc9def2b540d989782f5926991d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:01.439032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.454128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.460410 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3229/6462] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:00 2022] DELETE /identity/v3/projects/7c4fc9def2b540d989782f5926991d27 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:01.463331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.465185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:01.483947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b9d9-5d46-4404-8126-f47c1ad4a2f5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.656912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.658843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.660621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.660621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] PATH_INFO: `/v3/users/f0d8243fbbcc4d559001d319143de448` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.662231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d8243fbbcc4d559001d319143de448)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.664237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:02.099167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d8243fbbcc4d559001d319143de448'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:02.121727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d8243fbbcc4d559001d319143de448'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:02.146405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d8243fbbcc4d559001d319143de448'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:02.147688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d8243fbbcc4d559001d319143de448'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:02.148737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cba432cc-4fa4-47f1-9257-4ac6d6e251a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d8243fbbcc4d559001d319143de448'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:02.304449 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3234/6463] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:01 2022] DELETE /identity/v3/users/f0d8243fbbcc4d559001d319143de448 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:03.231984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:03.232544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:03.266640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93812f-4825-4cef-bd18-735d28261059 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:03.465142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:03.466877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:03.467173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:03.467511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] PATH_INFO: `/v3/projects/2b04e7594df3414b8009d57cc1b5aa33` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:03.468966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b04e7594df3414b8009d57cc1b5aa33)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:03.476566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:03.734643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8c27-06d2-48a2-a3e5-73ab41ab7bb5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:03.735554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8c27-06d2-48a2-a3e5-73ab41ab7bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:03.737262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8c27-06d2-48a2-a3e5-73ab41ab7bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:03.778632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b04e7594df3414b8009d57cc1b5aa33', 'request_id': 'req-2a44f524-f39c-479d-aabb-60a4d64ad74b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:03.797496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b04e7594df3414b8009d57cc1b5aa33', 'request_id': 'req-2a44f524-f39c-479d-aabb-60a4d64ad74b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:03.816311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b04e7594df3414b8009d57cc1b5aa33', 'request_id': 'req-2a44f524-f39c-479d-aabb-60a4d64ad74b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:03.819121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7e7e8c27-06d2-48a2-a3e5-73ab41ab7bb5 None None] MFA Rules not processed for user `cb0cd81939cf4620b52a7aa4b9882c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:03.820783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e7e8c27-06d2-48a2-a3e5-73ab41ab7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:03.961448 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3235/6464] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:03.963828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:03.964201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:03.964475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.007788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] MFA Rules not processed for user `cb0cd81939cf4620b52a7aa4b9882c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:04.009237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:04.029916 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3236/6465] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:04.050023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] The token cache is being invalidate because project 2b04e7594df3414b8009d57cc1b5aa33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:04.050023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:04.050023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a44f524-f39c-479d-aabb-60a4d64ad74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:04.051810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:04.054815 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3230/6466] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:03 2022] DELETE /identity/v3/projects/2b04e7594df3414b8009d57cc1b5aa33 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:04.060778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba173db-c04e-4861-9fc7-b29136736882 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:04.061076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba173db-c04e-4861-9fc7-b29136736882 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:04.061370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba173db-c04e-4861-9fc7-b29136736882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.065671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:04.142245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dba173db-c04e-4861-9fc7-b29136736882 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:04.144437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dba173db-c04e-4861-9fc7-b29136736882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:04.296170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9521-1008-43b3-a210-14671cf928ee None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:04.303634 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3231/6467] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:04.306672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:04.307156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:04.307575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.310045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:04.311004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:04.311343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:04.312696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.319404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:04.340489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:04.342603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:04.361330 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3232/6468] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:04.364930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:04.366014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:04.373808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:04.389978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36861de4-bcf5-4028-8838-00c72fcd1b97 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:04.413614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:04.414289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:04.414569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:04.414840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.415591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:04.415899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:04.417838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:04.423019 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3237/6469] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:04.423479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:04.463699 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3233/6470] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:22:04.468027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:04.485772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6510-ebbc-4f48-95ab-0e024a4337e4 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:04.503072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:04.504282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:04.504282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:04.504472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.505273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:04.507361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:04.772919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3238/6471] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:04 2022] POST /identity/v3/projects => generated 373 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:04.777200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:04.791856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2e77-a3fd-4fc8-9bfa-5b60d636fa0a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:04.883898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:04.887443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:04.887443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:04.887443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:04.887443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:04.890160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:05.049172 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3234/6472] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:04 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:05.053964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:05.088304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bfcee-a498-4cf0-929d-02e4532e38ab admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:05.146770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:05.148321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:05.148321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:05.148321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:05.148742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:05.166667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:05.236097 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3239/6473] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:05.239823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:05.253735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c3fd9-a021-499a-85b1-cc8ca7cf911c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:05.276603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551fad-0489-4d75-8671-5786422f9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:05.277550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551fad-0489-4d75-8671-5786422f9e98 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:05.292315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551fad-0489-4d75-8671-5786422f9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:05.292315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551fad-0489-4d75-8671-5786422f9e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:05.292315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551fad-0489-4d75-8671-5786422f9e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:05.292315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551fad-0489-4d75-8671-5786422f9e98 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:05.309492 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3235/6474] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:05.313983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:05.327155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:05.328621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e12a7-cd1a-4c15-86d7-3be6436b5e35 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:05.364075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:05.364777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:05.365064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:05.365365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] PATH_INFO: `/v3/projects/c3eca6aadaa848a498c9226d1c83be2b/users/2d34479d45c54ecd9901bb8fd9077fa4/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:05.440555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3eca6aadaa848a498c9226d1c83be2b, user_id=2d34479d45c54ecd9901bb8fd9077fa4, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:05.443298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:05.527178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3240/6475] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:05 2022] PUT /identity/v3/projects/c3eca6aadaa848a498c9226d1c83be2b/users/2d34479d45c54ecd9901bb8fd9077fa4/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:05.536446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc8780-84b4-42ce-9e35-e0e9566ff40c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:05.536799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc8780-84b4-42ce-9e35-e0e9566ff40c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:05.537107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc8780-84b4-42ce-9e35-e0e9566ff40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:05.574263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cdcc8780-84b4-42ce-9e35-e0e9566ff40c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:05.575498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cdcc8780-84b4-42ce-9e35-e0e9566ff40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:05.828336 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3236/6476] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:05.839533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:05.841329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:05.999005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3395e8-120c-49f7-ba9d-10dd14493e76 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:06.003355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7bf4-f150-409e-86df-2cecdee55b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:06.004340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7bf4-f150-409e-86df-2cecdee55b7c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:06.004836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7bf4-f150-409e-86df-2cecdee55b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:06.005480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7bf4-f150-409e-86df-2cecdee55b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:06.017737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce7bf4-f150-409e-86df-2cecdee55b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:06.019636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce7bf4-f150-409e-86df-2cecdee55b7c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:06.034172 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3241/6477] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:06.554761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:06.555742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:06.556096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:06.647488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] MFA Rules not processed for user `cb0cd81939cf4620b52a7aa4b9882c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:06.657190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:06.956741 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3237/6478] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:09.144058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:09.144058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:09.144058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:09.381551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] MFA Rules not processed for user `2d34479d45c54ecd9901bb8fd9077fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:09.387944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:09.422320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:09.759327 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3242/6479] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 620 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:10.000875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:10.012988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:10.086615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:10.223271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111913-a488-4dd4-8bd6-d2f1ef67c0f4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:10.237744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0338dd6-f3f3-47fe-97de-346235be8dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:10.238717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0338dd6-f3f3-47fe-97de-346235be8dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:10.239004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0338dd6-f3f3-47fe-97de-346235be8dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:10.239286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0338dd6-f3f3-47fe-97de-346235be8dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:10.260306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0338dd6-f3f3-47fe-97de-346235be8dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:10.264036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0338dd6-f3f3-47fe-97de-346235be8dc6 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:10.291341 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3238/6480] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:12.331105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:12.334660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:12.370346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb25f-2f50-46be-95b3-ba888e0b6c43 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:12.383490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:12.384170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:12.384461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:12.384738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] PATH_INFO: `/v3/users/c8630555ac4a44a3a4983856693a605c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:12.389178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8630555ac4a44a3a4983856693a605c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:12.394274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:12.764388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8630555ac4a44a3a4983856693a605c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:12.827739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8630555ac4a44a3a4983856693a605c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:12.874034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8630555ac4a44a3a4983856693a605c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:12.875621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8630555ac4a44a3a4983856693a605c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:12.877685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8630555ac4a44a3a4983856693a605c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:13.028455 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3243/6481] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:12 2022] DELETE /identity/v3/users/c8630555ac4a44a3a4983856693a605c => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:13.033317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:13.034483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:13.035218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:13.081345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:13.084845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:13.261753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3239/6482] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:13.323645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:13.326523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:13.665443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b67f-aa35-4038-97dc-031b36dafc76 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:13.681269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:13.682240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:13.686103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:13.687829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:13.734403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:13.742707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:13.792289 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3244/6483] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:15.500350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:15.502555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:15.532547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa142e-d861-40a8-978d-375c7b448007 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:15.554809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:15.558403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:15.558817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:15.559114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] PATH_INFO: `/v3/users/9e8c709c0ab74558876b89226deb2ea6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:15.566930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8c709c0ab74558876b89226deb2ea6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:15.571463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:15.813648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:15.826499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:15.883456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0498a49-2b2c-48ed-b840-a62c9f8abecb service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:15.902611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:15.904031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:15.904520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:15.905020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] PATH_INFO: `/v3/projects/a4b5048172f945548a03b8dc5deeccff` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:15.913957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b5048172f945548a03b8dc5deeccff)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:15.917840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:15.918001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8c709c0ab74558876b89226deb2ea6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:15.920032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8c709c0ab74558876b89226deb2ea6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:15.972409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8c709c0ab74558876b89226deb2ea6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:15.987041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8c709c0ab74558876b89226deb2ea6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:15.988137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5b5f63b-315c-4706-80a8-34bc2fa77791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8c709c0ab74558876b89226deb2ea6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:16.009012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:16.035634 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3240/6484] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:15 2022] DELETE /identity/v3/users/9e8c709c0ab74558876b89226deb2ea6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:16.040096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d79f1-6928-4a8d-ac82-f30e87b7b7de None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.040943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d79f1-6928-4a8d-ac82-f30e87b7b7de None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.042593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d79f1-6928-4a8d-ac82-f30e87b7b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.107252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-df9d79f1-6928-4a8d-ac82-f30e87b7b7de None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:16.109837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df9d79f1-6928-4a8d-ac82-f30e87b7b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.146062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:16.166159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b5048172f945548a03b8dc5deeccff', 'request_id': 'req-4f2243d2-066d-4303-9daa-07703075627f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:16.196873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b5048172f945548a03b8dc5deeccff', 'request_id': 'req-4f2243d2-066d-4303-9daa-07703075627f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:16.230522 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3241/6485] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:16.230522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.230522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.230522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.232264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b5048172f945548a03b8dc5deeccff', 'request_id': 'req-4f2243d2-066d-4303-9daa-07703075627f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:16.255896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] MFA Rules not processed for user `2d34479d45c54ecd9901bb8fd9077fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:16.258853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.355041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] The token cache is being invalidate because project a4b5048172f945548a03b8dc5deeccff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:16.355472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:16.356911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f2243d2-066d-4303-9daa-07703075627f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:16.358085 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3245/6486] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:15 2022] DELETE /identity/v3/projects/a4b5048172f945548a03b8dc5deeccff => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:16.364957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0990b5-9c7c-41e2-9496-166d80c23fd3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.365498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0990b5-9c7c-41e2-9496-166d80c23fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.365998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0990b5-9c7c-41e2-9496-166d80c23fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.427090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ca0990b5-9c7c-41e2-9496-166d80c23fd3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:16.429292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca0990b5-9c7c-41e2-9496-166d80c23fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.461443 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3242/6487] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:16.461443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:16.463168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.561512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29eca-2521-40c0-9b6b-8b4b94a65a72 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:16.568019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:16.569298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.570054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.570813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.574143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.609041 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3246/6488] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:16.611332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.611625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.612683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.662706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:16.664132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.691450 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3247/6489] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:16.692712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:16.718895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecdce8-7278-430a-abc4-16d41e973009 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:16.738739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:16.739378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.739665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.739947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.740648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:16.740951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:16.742652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:16.751755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:16.753307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:16.770413 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3248/6490] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:22:16.774888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:16.786682 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3243/6491] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:16.791018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7bf8-d358-44a4-af5f-1b642eff1f5b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:16.807303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:16.808702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.810500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.812078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.812806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:16.818845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:16.958409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3249/6492] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:16 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:16.967712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:17.007982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7f42d-3f77-4daa-8a0c-381cfd9891e0 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:17.202542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:17.205256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:17.205256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:17.205256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:17.205256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:17.208016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:17.377702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:17.378436 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3244/6493] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:16 2022] POST /identity/v3/users => generated 290 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:17.410561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595621-4b9c-4dc7-9f0c-fac922efeec5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:17.431754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:17.433639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:17.434292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:17.435050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:17.438912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:17.442007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:17.463102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3250/6494] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:17.468356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:17.492755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8a08-99f4-404e-b62b-8c4b6d3091f1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:17.514389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0cb2f-e1f4-44e2-ad0b-f223f8a68751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:17.515388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0cb2f-e1f4-44e2-ad0b-f223f8a68751 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:17.515710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0cb2f-e1f4-44e2-ad0b-f223f8a68751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:17.516186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0cb2f-e1f4-44e2-ad0b-f223f8a68751 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:17.517411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0cb2f-e1f4-44e2-ad0b-f223f8a68751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:17.520652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0cb2f-e1f4-44e2-ad0b-f223f8a68751 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:17.559656 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3245/6495] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:17.564532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:17.597915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d5da-d68e-49e8-b18c-2ed13cadc441 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:17.601026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:17.609885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:17.613957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:17.614464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:17.614965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] PATH_INFO: `/v3/projects/c59ca2d811f647d2a10fc4e1e2e96ef6/users/6df9d4296b8047d3acc3f9d3199db774/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:17.656220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59ca2d811f647d2a10fc4e1e2e96ef6, user_id=6df9d4296b8047d3acc3f9d3199db774, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:17.672806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:17.819243 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3251/6496] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:17 2022] PUT /identity/v3/projects/c59ca2d811f647d2a10fc4e1e2e96ef6/users/6df9d4296b8047d3acc3f9d3199db774/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:17.824605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:17.824890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:17.825260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:17.888927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:17.890988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:17.982155 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3246/6497] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:17.995770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:18.047622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:18.096761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58248-4da7-4913-ae55-49259a62dd3c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:18.109930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:18.112127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:18.112520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:18.112857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:18.135383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:18.142814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:18.154446 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3252/6498] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:19.236846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:19.242859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:19.266668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c36a-a090-47df-a3aa-c1c8caa49a20 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:19.280809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:19.281214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:19.282104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:19.282791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] PATH_INFO: `/v3/projects/8454196a6cda41e79de33d03e388ab02` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:19.285461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8454196a6cda41e79de33d03e388ab02)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:19.290602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:19.458986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8454196a6cda41e79de33d03e388ab02', 'request_id': 'req-73f01264-b65c-4ce6-b1c3-0a29db054932'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:19.470869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8454196a6cda41e79de33d03e388ab02', 'request_id': 'req-73f01264-b65c-4ce6-b1c3-0a29db054932'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:19.479392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8454196a6cda41e79de33d03e388ab02', 'request_id': 'req-73f01264-b65c-4ce6-b1c3-0a29db054932'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:19.578131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] The token cache is being invalidate because project 8454196a6cda41e79de33d03e388ab02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:19.578434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:19.579185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-73f01264-b65c-4ce6-b1c3-0a29db054932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:19.583678 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3247/6499] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:19 2022] DELETE /identity/v3/projects/8454196a6cda41e79de33d03e388ab02 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:19.585544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:19.609690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a427-74ae-47f3-b307-61891d0db734 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:19.817126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:19.817794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:19.818127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:19.818403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] PATH_INFO: `/v3/users/34d404bcc53c47e883d06a621a52424b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:19.819725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d404bcc53c47e883d06a621a52424b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:19.825468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:20.149310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d404bcc53c47e883d06a621a52424b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:20.184844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d404bcc53c47e883d06a621a52424b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:20.216260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d404bcc53c47e883d06a621a52424b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:20.230404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d404bcc53c47e883d06a621a52424b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:20.231367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d404bcc53c47e883d06a621a52424b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:20.324715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3253/6500] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:19 2022] DELETE /identity/v3/users/34d404bcc53c47e883d06a621a52424b => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:22.247736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:22.248637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:22.248844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:22.278979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:22.281830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:22.361491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] MFA Rules not processed for user `6df9d4296b8047d3acc3f9d3199db774`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:22.364229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:22.383140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:22.403877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:22.406130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641dee5-a991-4812-9e50-3dd00f874707 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:22.425347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:22.426278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:22.426427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:22.426607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] PATH_INFO: `/v3/projects/8b81e1afd2df4701be762bfe5fe79dd9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:22.429318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b81e1afd2df4701be762bfe5fe79dd9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:22.431354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:22.513544 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3248/6501] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:22.522490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:22.524061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:22.539947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e2be9-89e8-4df6-8077-f3b73083b94a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:22.545031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:22.545691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:22.546019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:22.546715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:22.546929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:22.549454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:22.570825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b81e1afd2df4701be762bfe5fe79dd9', 'request_id': 'req-baaadcb0-0f57-4d3b-8538-58c248495df5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:22.577151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b81e1afd2df4701be762bfe5fe79dd9', 'request_id': 'req-baaadcb0-0f57-4d3b-8538-58c248495df5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:22.583651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b81e1afd2df4701be762bfe5fe79dd9', 'request_id': 'req-baaadcb0-0f57-4d3b-8538-58c248495df5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:22.653827 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3249/6502] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:22 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:22.659205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:22.693418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] The token cache is being invalidate because project 8b81e1afd2df4701be762bfe5fe79dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:22.693907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:22.695729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-baaadcb0-0f57-4d3b-8538-58c248495df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:22.701150 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3254/6503] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:22 2022] DELETE /identity/v3/projects/8b81e1afd2df4701be762bfe5fe79dd9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:22.708869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80d63-e143-4f00-bfa2-5ff69e4e4600 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:22.709204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80d63-e143-4f00-bfa2-5ff69e4e4600 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:22.709576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80d63-e143-4f00-bfa2-5ff69e4e4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:22.772274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8ae80d63-e143-4f00-bfa2-5ff69e4e4600 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:22.776218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ae80d63-e143-4f00-bfa2-5ff69e4e4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:22.901288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39c309-2436-4827-a063-01bf793ac58e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:22.918174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:22.920119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:22.920408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:22.922634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:22.923565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:22.931377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:22.977783 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3255/6504] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:22.979625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:22.980024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:22.980467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.010703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:23.012335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:23.027994 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3256/6505] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:23.042023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.070431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33866e-7693-43c8-ac67-bcb4af45d79b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.070735 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3250/6506] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:22 2022] POST /identity/v3/users => generated 296 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:22:23.073358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.075246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:23.078172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.079355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.079746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.080127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.080908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:23.081525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.085730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.117381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb4764-c651-4ebb-90b3-db98ca29f865 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.117756 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3257/6507] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:22:23.121028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.137523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781bb00-57d6-46c9-b2e8-e3516e94a430 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.137729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.138959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.139465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.140090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.141332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.144107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.144282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.144731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.145027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.145308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.145990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.148099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.179192 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3251/6508] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:22:23.180793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.207675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd54db-d072-4932-8542-a61c3523ec21 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.214271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.215144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.215611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.215962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] PATH_INFO: `/v3/projects/0c6bd0bc9b8346ec85266b5e2953ea22/users/2571ca3b91e640ccb92bfac62d454b8b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.250121 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3258/6509] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:23 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:23.258517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.268413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6bd0bc9b8346ec85266b5e2953ea22, user_id=2571ca3b91e640ccb92bfac62d454b8b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.271749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.392295 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3252/6510] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:23 2022] PUT /identity/v3/projects/0c6bd0bc9b8346ec85266b5e2953ea22/users/2571ca3b91e640ccb92bfac62d454b8b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:23.396624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.397391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0cbd-2509-421f-a948-19ae566598ca admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.495451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.496984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.496984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.497303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.498028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.500470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.510609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fd62c-da70-4466-8543-6088e6ea5752 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.529591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.530571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.530892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.531220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.531897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.535305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.561326 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3253/6511] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:22:23.567878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.589617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34ff8-810f-4b8f-8239-b9a913877013 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.597640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.598447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.598447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.598755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] PATH_INFO: `/v3/projects/0c6bd0bc9b8346ec85266b5e2953ea22/users/2571ca3b91e640ccb92bfac62d454b8b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.601118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6bd0bc9b8346ec85266b5e2953ea22, user_id=2571ca3b91e640ccb92bfac62d454b8b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.604319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.622324 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3259/6512] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:23 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:22:23.633469 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3254/6513] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:23 2022] PUT /identity/v3/projects/0c6bd0bc9b8346ec85266b5e2953ea22/users/2571ca3b91e640ccb92bfac62d454b8b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:23.635502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.762231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b8165-9160-4e44-9a5c-785c497e4b42 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.781906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.783722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.783722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.806216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.807271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.809350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.827418 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3255/6514] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:23.828935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.841553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346c85-e4c4-4127-b77e-6d92b7e5b063 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.849147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654cb08-b99e-4eac-872f-b594ed5d51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.850206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654cb08-b99e-4eac-872f-b594ed5d51c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.850698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654cb08-b99e-4eac-872f-b594ed5d51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.851249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654cb08-b99e-4eac-872f-b594ed5d51c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.853196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654cb08-b99e-4eac-872f-b594ed5d51c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.855651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654cb08-b99e-4eac-872f-b594ed5d51c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:23.871708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3260/6515] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:23.876098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:23.888334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a53e0-1622-49c7-a981-eb85a0f70192 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:23.896591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:23.897608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:23.898083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:23.899652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] PATH_INFO: `/v3/projects/429fe52951fe4fada8a9bb6ec920a94b/users/c775efb1c1654f3e9c0f4f2e4dd28e4b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:23.927927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=429fe52951fe4fada8a9bb6ec920a94b, user_id=c775efb1c1654f3e9c0f4f2e4dd28e4b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:23.931723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:24.051498 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3256/6516] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:23 2022] PUT /identity/v3/projects/429fe52951fe4fada8a9bb6ec920a94b/users/c775efb1c1654f3e9c0f4f2e4dd28e4b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:24.063066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:24.063462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:24.063830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:24.102908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] MFA Rules not processed for user `c775efb1c1654f3e9c0f4f2e4dd28e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:24.104670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:24.264808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:24.265245 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3261/6517] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:24.346376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c2d1-5ae2-424a-b0bf-30e354db6d2c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:24.359981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:24.360757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:24.361090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:24.361401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:24.362092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:24.364014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:24.485245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3257/6518] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:24 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:24.490316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:24.508271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f8204-f837-4753-ae45-a13b27ee1066 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:24.692985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:24.693650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:24.694149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:24.694446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:24.695151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:24.697198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:24.852837 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3262/6519] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:24 2022] POST /identity/v3/users => generated 300 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:22:24.856624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:24.874787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b82f84-4dc8-40a8-85e0-f5981ac4ed4a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:24.899578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:24.900464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:24.901161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:24.901617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:24.902505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:24.906064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:24.940788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3258/6520] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:24.946978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:24.974510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a11e6-c6ad-4b5a-9cfc-b91d4b8aa4d6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:24.988413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:24.991397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:24.992476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:24.992932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:24.994549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] PATH_INFO: `/v3/projects/844e63becc7f421697237be77f30ad25/users/922bda096b8940c7afa537e3b57b2e9f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:25.020176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=844e63becc7f421697237be77f30ad25, user_id=922bda096b8940c7afa537e3b57b2e9f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:25.027886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:25.104165 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3263/6521] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:24 2022] PUT /identity/v3/projects/844e63becc7f421697237be77f30ad25/users/922bda096b8940c7afa537e3b57b2e9f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:25.108385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:25.110166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:25.131233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42928-7165-4a53-82a6-b9b9d31c8f5c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:25.229174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b3e36-c82f-47a2-83fe-b10a3354fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:25.230393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3e36-c82f-47a2-83fe-b10a3354fb62 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:25.230852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3e36-c82f-47a2-83fe-b10a3354fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:25.231428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3e36-c82f-47a2-83fe-b10a3354fb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:25.232278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3e36-c82f-47a2-83fe-b10a3354fb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:25.234481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3e36-c82f-47a2-83fe-b10a3354fb62 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:25.247261 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3259/6522] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:25.252134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:25.266319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54c2c1-6b0a-487c-b97c-b7cb5b0b72fb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:25.285003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:25.285763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:25.286095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:25.286374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] PATH_INFO: `/v3/projects/844e63becc7f421697237be77f30ad25/users/922bda096b8940c7afa537e3b57b2e9f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:25.288629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=844e63becc7f421697237be77f30ad25, user_id=922bda096b8940c7afa537e3b57b2e9f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:25.293070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:25.310283 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3264/6523] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:25 2022] PUT /identity/v3/projects/844e63becc7f421697237be77f30ad25/users/922bda096b8940c7afa537e3b57b2e9f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:25.324452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:25.324990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:25.326155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:25.379538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] MFA Rules not processed for user `922bda096b8940c7afa537e3b57b2e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:25.381690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:25.545197 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3260/6524] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:25.546856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:25.550944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:25.685668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718650-a8e1-4287-9306-62359b6cca7b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:25.691095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845d9b-2bc4-4a18-bf4f-414e0ef9456b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:25.691882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845d9b-2bc4-4a18-bf4f-414e0ef9456b service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:25.692441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845d9b-2bc4-4a18-bf4f-414e0ef9456b service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:25.692725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845d9b-2bc4-4a18-bf4f-414e0ef9456b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:25.715110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845d9b-2bc4-4a18-bf4f-414e0ef9456b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:25.716762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845d9b-2bc4-4a18-bf4f-414e0ef9456b service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:25.752997 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3265/6525] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:22:26.090334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:26.262429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d2428-cc5b-45aa-b360-2332bda90a3d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:26.274617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:26.275569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:26.276055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:26.276538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] PATH_INFO: `/v3/users/c775efb1c1654f3e9c0f4f2e4dd28e4b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:26.277983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c775efb1c1654f3e9c0f4f2e4dd28e4b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:26.280409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:26.337727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d56b-9d96-4465-8934-34a45c77d5b0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:26.338531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d56b-9d96-4465-8934-34a45c77d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:26.339563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d56b-9d96-4465-8934-34a45c77d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:26.386939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:26.415207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3828d56b-9d96-4465-8934-34a45c77d5b0 None None] MFA Rules not processed for user `2571ca3b91e640ccb92bfac62d454b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:26.416611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3828d56b-9d96-4465-8934-34a45c77d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:26.555062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c775efb1c1654f3e9c0f4f2e4dd28e4b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:26.556455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c775efb1c1654f3e9c0f4f2e4dd28e4b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:26.600415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3266/6526] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:26.602276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:26.602569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:26.602845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:26.640272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] MFA Rules not processed for user `6df9d4296b8047d3acc3f9d3199db774`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:26.641574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:26.646412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c775efb1c1654f3e9c0f4f2e4dd28e4b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:26.675414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c775efb1c1654f3e9c0f4f2e4dd28e4b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:26.676304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e2879441-d4ce-468e-86d8-9c6c606eae79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c775efb1c1654f3e9c0f4f2e4dd28e4b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:26.712289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:26.738246 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3261/6527] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:26 2022] DELETE /identity/v3/users/c775efb1c1654f3e9c0f4f2e4dd28e4b => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:26.747554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:26.748187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:26.752329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:26.785711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3267/6528] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:26.811559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:26.813131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:26.976011 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3262/6529] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:26.995680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:26.999945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:27.069532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:27.069532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:27.149578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dfa89-83c2-4c3d-9fc7-f2c049e0763b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:27.214458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd6ecf-b6b3-4669-9ff5-16ed4c433085 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:27.236678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:27.253726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:27.255182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:27.255735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:27.256120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:27.258050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:27.259367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:27.260537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:27.273450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:27.276307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:27.281601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:27.298940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3268/6530] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:27.423162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:27.425187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:27.442077 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3263/6531] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:27.852398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:28.269071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:28.780374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:28.781132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:28.832310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6bd8-e5ca-4e79-98b9-6d4d13f189bd service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:28.845878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:28.848948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:28.849237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:28.862515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] PATH_INFO: `/v3/projects/429fe52951fe4fada8a9bb6ec920a94b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:28.867810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=429fe52951fe4fada8a9bb6ec920a94b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:28.869782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:29.075357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429fe52951fe4fada8a9bb6ec920a94b', 'request_id': 'req-4d78af06-5a7e-4cd0-8ca1-efb761609da8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.089793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429fe52951fe4fada8a9bb6ec920a94b', 'request_id': 'req-4d78af06-5a7e-4cd0-8ca1-efb761609da8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.103527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429fe52951fe4fada8a9bb6ec920a94b', 'request_id': 'req-4d78af06-5a7e-4cd0-8ca1-efb761609da8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.247328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] The token cache is being invalidate because project 429fe52951fe4fada8a9bb6ec920a94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:29.248152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.249178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.253728 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3269/6532] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:28 2022] DELETE /identity/v3/projects/429fe52951fe4fada8a9bb6ec920a94b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:29.257517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:29.298699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e1646-103b-4055-953d-8f302b9adb5b service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:29.482652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:29.483812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:29.484250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:29.484701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] PATH_INFO: `/v3/users/922bda096b8940c7afa537e3b57b2e9f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:29.487177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922bda096b8940c7afa537e3b57b2e9f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:29.491467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:29.533114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:29.762616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922bda096b8940c7afa537e3b57b2e9f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.763324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922bda096b8940c7afa537e3b57b2e9f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.891212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922bda096b8940c7afa537e3b57b2e9f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.900207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922bda096b8940c7afa537e3b57b2e9f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.901324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b731e46a-01e9-4d42-99b2-d14c0803cef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922bda096b8940c7afa537e3b57b2e9f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:29.928149 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3264/6533] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:29 2022] DELETE /identity/v3/users/922bda096b8940c7afa537e3b57b2e9f => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:30.608641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:30.608641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:30.626144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78af06-5a7e-4cd0-8ca1-efb761609da8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:30.688534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:30.790511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:30.791564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:30.791999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:30.792574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] PATH_INFO: `/v3/projects/844e63becc7f421697237be77f30ad25` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:30.794487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=844e63becc7f421697237be77f30ad25)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:30.796636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:30.968847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844e63becc7f421697237be77f30ad25', 'request_id': 'req-46dfef6b-3aff-4467-bac0-c71437478b5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:30.976812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844e63becc7f421697237be77f30ad25', 'request_id': 'req-46dfef6b-3aff-4467-bac0-c71437478b5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:30.985030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844e63becc7f421697237be77f30ad25', 'request_id': 'req-46dfef6b-3aff-4467-bac0-c71437478b5f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:31.116115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] The token cache is being invalidate because project 844e63becc7f421697237be77f30ad25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:31.116985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:31.121476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-46dfef6b-3aff-4467-bac0-c71437478b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:31.126545 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3270/6534] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:30 2022] DELETE /identity/v3/projects/844e63becc7f421697237be77f30ad25 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:31.128782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.129480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.129480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.157173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:31.159543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:31.270539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3265/6535] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:31.279299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.279585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.280027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.306610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:31.307970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:31.318800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3271/6536] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:31.322966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:31.334798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5459c52-c37a-455a-a472-e7d8f498d45c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:31.343478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:31.344997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.345624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.346149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.347287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:31.347889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:31.350376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:31.375692 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3266/6537] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:22:31.378631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:31.400949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9ce8-c216-4f41-8df2-2a790f15a04b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:31.414899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:31.416012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.417661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.418875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.419803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:31.426742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:31.580290 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3272/6538] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:31 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:22:31.581048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:31.591932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d41f4-cfc9-4cff-9cc2-43ad0004a79c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:31.660059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:31.660584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.660868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.661144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.661797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:31.663780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:31.836554 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3267/6539] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:31 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:22:31.841683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:31.854560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3644-3615-4167-963d-9ae781a09e19 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:31.861728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:31.862620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.863090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.863547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.864418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:31.866349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:31.893210 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3273/6540] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:31.897284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:31.909194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c327f91-90af-4241-8788-5847f9cd0e89 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:31.916523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d99d-dbe8-4663-8b42-0af78409c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:31.917674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d99d-dbe8-4663-8b42-0af78409c8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.917674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d99d-dbe8-4663-8b42-0af78409c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.917674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d99d-dbe8-4663-8b42-0af78409c8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.918315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d99d-dbe8-4663-8b42-0af78409c8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:31.920213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d99d-dbe8-4663-8b42-0af78409c8d3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:31.933017 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3268/6541] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:31.937063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:31.948664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6af8d3-02b9-4d95-bcd6-08335d01297b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:31.958337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:31.964489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:31.964489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:31.964489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] PATH_INFO: `/v3/projects/1b842b58c7ef41d8aaa09d3ed6a5695b/users/121161c28046480cba923cebb98dbadb/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:31.999550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b842b58c7ef41d8aaa09d3ed6a5695b, user_id=121161c28046480cba923cebb98dbadb, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:32.003605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:32.122745 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3274/6542] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:31 2022] PUT /identity/v3/projects/1b842b58c7ef41d8aaa09d3ed6a5695b/users/121161c28046480cba923cebb98dbadb/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:32.133771 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:32.134898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:32.135557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:32.204996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] MFA Rules not processed for user `121161c28046480cba923cebb98dbadb`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:32.208010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:32.363217 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3269/6543] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:32.367692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:32.502632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa914c-17af-4d24-8b29-6c5afb56d6e2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:32.510440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:32.511266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:32.512327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:32.512761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:32.513774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:32.517533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:32.630720 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3275/6544] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:32 2022] POST /identity/v3/projects => generated 389 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:32.631312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:32.652198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768d3a7-2ab7-4d91-a0ba-8c0a0d88dd47 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:32.814646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:32.833761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:32.834592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:32.834982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:32.835364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:32.836324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:32.840540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:32.994776 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3270/6545] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:32 2022] POST /identity/v3/users => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:32.995861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:33.012175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7081fbc-ceee-41a3-afb5-7ef56aeb18db admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:33.023943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:33.024552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:33.024826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:33.025380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:33.026219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:33.027998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:33.097760 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3276/6546] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:33.104524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:33.141215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81976a5-2efc-4967-9854-871d7fea4d99 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:33.156393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:33.158432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:33.159406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:33.160142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] PATH_INFO: `/v3/projects/8b80ceed37f849c2b7a9afddcfdf5891/users/3633bf4aa7124e5ba1620c344edc24d7/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:33.202274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b80ceed37f849c2b7a9afddcfdf5891, user_id=3633bf4aa7124e5ba1620c344edc24d7, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:33.208611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:33.332220 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3271/6547] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:33 2022] PUT /identity/v3/projects/8b80ceed37f849c2b7a9afddcfdf5891/users/3633bf4aa7124e5ba1620c344edc24d7/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:33.337032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:33.366846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac26af-ed3f-4a6a-8161-5b4d5053b27f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:33.490558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045c347-e8ea-4e76-8dcb-77e9c794be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:33.491267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045c347-e8ea-4e76-8dcb-77e9c794be16 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:33.491541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045c347-e8ea-4e76-8dcb-77e9c794be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:33.491815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045c347-e8ea-4e76-8dcb-77e9c794be16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:33.492478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045c347-e8ea-4e76-8dcb-77e9c794be16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:33.494415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045c347-e8ea-4e76-8dcb-77e9c794be16 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:33.509611 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3277/6548] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:33.513892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:33.532156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483a7b-bb09-4814-bc8f-3bbf7275e172 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:33.537601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:33.538629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:33.539086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:33.539375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] PATH_INFO: `/v3/projects/8b80ceed37f849c2b7a9afddcfdf5891/users/3633bf4aa7124e5ba1620c344edc24d7/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:33.541617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b80ceed37f849c2b7a9afddcfdf5891, user_id=3633bf4aa7124e5ba1620c344edc24d7, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:33.544463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:33.588817 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3272/6549] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:33 2022] PUT /identity/v3/projects/8b80ceed37f849c2b7a9afddcfdf5891/users/3633bf4aa7124e5ba1620c344edc24d7/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:33.606579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:33.607101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:33.607918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:33.718096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] MFA Rules not processed for user `3633bf4aa7124e5ba1620c344edc24d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:33.718567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:33.722736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:33.916341 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3278/6550] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:33.952908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:33.956051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:34.196047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259e02-d7a6-4627-835b-98bd99069ef4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:34.204858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca040-664e-47c3-bd36-77f95916641e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:34.206331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca040-664e-47c3-bd36-77f95916641e service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:34.207043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca040-664e-47c3-bd36-77f95916641e service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:34.207742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca040-664e-47c3-bd36-77f95916641e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:34.227845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca040-664e-47c3-bd36-77f95916641e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:34.231524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca040-664e-47c3-bd36-77f95916641e service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:34.258971 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3273/6551] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:22:34.759711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:34.980867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2347a-9434-44b5-bda6-96bc4f4c677f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:34.995052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:34.996111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:34.996610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:34.997388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] PATH_INFO: `/v3/users/121161c28046480cba923cebb98dbadb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:34.999121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121161c28046480cba923cebb98dbadb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:35.001592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:35.265540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:35.290195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121161c28046480cba923cebb98dbadb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:35.309971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121161c28046480cba923cebb98dbadb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:35.321385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121161c28046480cba923cebb98dbadb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:35.322571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121161c28046480cba923cebb98dbadb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:35.323486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121161c28046480cba923cebb98dbadb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:35.458429 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3279/6552] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:34 2022] DELETE /identity/v3/users/121161c28046480cba923cebb98dbadb => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:35.464661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:35.465115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:35.465617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:35.510055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:35.513643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:35.754376 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3274/6553] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:35.800404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:35.803266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:35.960290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:36.072597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2e9a-c315-47ca-8aa6-82e466413420 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:36.090620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:36.091559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:36.091972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:36.092474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:36.117939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:36.118781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:36.144358 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3280/6554] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:37.358297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:37.361611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:37.379651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20eab-0db6-472d-9053-5000754dc88d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:37.388275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:37.388959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:37.389520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:37.389808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] PATH_INFO: `/v3/projects/1b842b58c7ef41d8aaa09d3ed6a5695b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:37.392832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b842b58c7ef41d8aaa09d3ed6a5695b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:37.403652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:37.622540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b842b58c7ef41d8aaa09d3ed6a5695b', 'request_id': 'req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:37.642991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b842b58c7ef41d8aaa09d3ed6a5695b', 'request_id': 'req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:37.644683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:37.654033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b842b58c7ef41d8aaa09d3ed6a5695b', 'request_id': 'req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:37.823902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] The token cache is being invalidate because project 1b842b58c7ef41d8aaa09d3ed6a5695b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:37.825750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:37.828542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:37.833893 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3275/6555] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:37 2022] DELETE /identity/v3/projects/1b842b58c7ef41d8aaa09d3ed6a5695b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:37.836438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:37.853411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fc025-96bc-4f1e-87bb-c1c320d22a03 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:38.025482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:38.025482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:38.025482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:38.026079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] PATH_INFO: `/v3/users/3633bf4aa7124e5ba1620c344edc24d7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:38.029967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3633bf4aa7124e5ba1620c344edc24d7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:38.033003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:38.039792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:38.254857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3633bf4aa7124e5ba1620c344edc24d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:38.269188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3633bf4aa7124e5ba1620c344edc24d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:38.277150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3633bf4aa7124e5ba1620c344edc24d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:38.277998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3633bf4aa7124e5ba1620c344edc24d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:38.279025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3633bf4aa7124e5ba1620c344edc24d7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:38.379996 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3281/6556] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:37 2022] DELETE /identity/v3/users/3633bf4aa7124e5ba1620c344edc24d7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:38.671095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:38.676891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:38.800298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d313d-8694-4c44-a338-1f4a8e7d8f84 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:38.896110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:38.896801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:38.897150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:38.897501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:38.899410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:38.924456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:38.926656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fa22b-31ac-4d36-8936-a4ac1ccd70e3 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:38.942082 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3276/6557] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:39.261383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:39.263094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:39.429512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73725f-5dfb-4b93-9368-03d779f9482f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:39.439202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:39.439963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:39.440347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:39.441438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] PATH_INFO: `/v3/projects/8b80ceed37f849c2b7a9afddcfdf5891` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:39.443098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b80ceed37f849c2b7a9afddcfdf5891)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:39.445291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:39.622680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b80ceed37f849c2b7a9afddcfdf5891', 'request_id': 'req-ebc803b4-55ac-4b46-8065-59b27c5db180'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:39.629268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b80ceed37f849c2b7a9afddcfdf5891', 'request_id': 'req-ebc803b4-55ac-4b46-8065-59b27c5db180'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:39.636514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b80ceed37f849c2b7a9afddcfdf5891', 'request_id': 'req-ebc803b4-55ac-4b46-8065-59b27c5db180'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:39.765272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] The token cache is being invalidate because project 8b80ceed37f849c2b7a9afddcfdf5891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:39.765666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:39.771382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebc803b4-55ac-4b46-8065-59b27c5db180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:39.773649 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3282/6558] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:39 2022] DELETE /identity/v3/projects/8b80ceed37f849c2b7a9afddcfdf5891 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:39.780097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:39.780997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:39.781484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:39.807976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:39.809927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:39.963454 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3277/6559] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:39.982723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:39.983130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:39.983682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.015371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:40.017675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:40.029840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3283/6560] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:40.034723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:40.048709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8265-6ea5-4eb1-922c-a65d5bc69d96 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:40.055926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:40.061917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.061917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.061917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.061917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:40.061917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:40.061917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:40.085633 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3278/6561] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:22:40.090036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:40.099943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a270bf-1605-49aa-9bb1-18dd9b285ec5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:40.112997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:40.112997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.112997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.112997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.113465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:40.114967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:40.137920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:40.322256 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3284/6562] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:40 2022] POST /identity/v3/projects => generated 409 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:40.326097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:40.345165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0baae7-03cc-4826-bdb3-9900cf6130e3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:40.354445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:40.455395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:40.456438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.456938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.457425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.459367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:40.461613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:40.670362 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3279/6563] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:40 2022] POST /identity/v3/users => generated 305 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:22:40.674158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:40.686521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d077ab-d799-422a-85f2-744abc814593 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:40.692615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:40.693536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.693830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.694280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.694935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:40.696827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:40.710279 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3285/6564] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:40.717650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:40.729442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2dba-18d6-410a-9da7-115b83916173 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:40.735572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe14ba-f164-40f1-8440-03e251228454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:40.736201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe14ba-f164-40f1-8440-03e251228454 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.739900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe14ba-f164-40f1-8440-03e251228454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.739900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe14ba-f164-40f1-8440-03e251228454 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.739900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe14ba-f164-40f1-8440-03e251228454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:40.739900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe14ba-f164-40f1-8440-03e251228454 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:40.760073 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3280/6565] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:40.764622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:40.776293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a71e9c-a606-4c09-8138-049482e6a2fb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:40.783480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d211a-162b-4450-b529-032db541088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:40.784157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d211a-162b-4450-b529-032db541088e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.785802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d211a-162b-4450-b529-032db541088e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.785802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d211a-162b-4450-b529-032db541088e admin admin] PATH_INFO: `/v3/projects/8dafe2ce662b49e88090f86c190f40be/users/9c02bf6678624f03bba9ec4c5380c832/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.803017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d211a-162b-4450-b529-032db541088e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dafe2ce662b49e88090f86c190f40be, user_id=9c02bf6678624f03bba9ec4c5380c832, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:40.805843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d211a-162b-4450-b529-032db541088e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:40.912111 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3286/6566] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:40 2022] PUT /identity/v3/projects/8dafe2ce662b49e88090f86c190f40be/users/9c02bf6678624f03bba9ec4c5380c832/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:40.922030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:40.922571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:40.922661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:40.954302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] MFA Rules not processed for user `9c02bf6678624f03bba9ec4c5380c832`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:40.955548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:41.027125 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3281/6567] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:41.031965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d211a-162b-4450-b529-032db541088e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:41.098346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d211a-162b-4450-b529-032db541088e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:41.103172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:41.103786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:41.109551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:41.109551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:41.109551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:41.109551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:41.335562 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3287/6568] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:41 2022] POST /identity/v3/projects => generated 409 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:41.339315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:41.370977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63c12-6499-46f4-a031-1ad1274018e4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:41.467516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:41.467516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:41.468124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:41.468638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:41.469739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:41.472326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:41.565461 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3282/6569] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:41 2022] POST /identity/v3/users => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:41.569773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:41.584504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15bbb3-06e3-4039-a03f-a90a7f5232a6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:41.589659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:41.590608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:41.594623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:41.594623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:41.594623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:41.594623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:41.605179 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3288/6570] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:41.610447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:41.627285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d30986-751c-436b-b70b-aad287a41b96 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:41.632068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:41.632890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:41.633176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:41.633453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] PATH_INFO: `/v3/projects/bb0524f0ef42459da854499861be38b9/users/28ef2cb78bd9482b968e20c2a3794321/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:41.649001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0524f0ef42459da854499861be38b9, user_id=28ef2cb78bd9482b968e20c2a3794321, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:41.651670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:41.793208 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3283/6571] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:41 2022] PUT /identity/v3/projects/bb0524f0ef42459da854499861be38b9/users/28ef2cb78bd9482b968e20c2a3794321/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:41.798145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:41.840296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d63547-f289-4d21-bd1a-58ddf7b8eed6 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:41.948074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a97e8-6279-42db-8403-7154bd33611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:41.948694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a97e8-6279-42db-8403-7154bd33611d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:41.949145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a97e8-6279-42db-8403-7154bd33611d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:41.949433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a97e8-6279-42db-8403-7154bd33611d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:41.950115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a97e8-6279-42db-8403-7154bd33611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:41.952103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a97e8-6279-42db-8403-7154bd33611d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:41.967608 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3289/6572] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:41.972423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:41.985714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229cad-afd6-4b4e-8753-da2133bb98fb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:41.991422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:41.992923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:41.993841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:41.994296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] PATH_INFO: `/v3/projects/bb0524f0ef42459da854499861be38b9/users/28ef2cb78bd9482b968e20c2a3794321/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:41.998237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0524f0ef42459da854499861be38b9, user_id=28ef2cb78bd9482b968e20c2a3794321, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:42.002778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:42.015703 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3284/6573] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:41 2022] PUT /identity/v3/projects/bb0524f0ef42459da854499861be38b9/users/28ef2cb78bd9482b968e20c2a3794321/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:42.028068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:42.028682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:42.028998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:42.066109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] MFA Rules not processed for user `28ef2cb78bd9482b968e20c2a3794321`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:42.066109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:42.145591 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3290/6574] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:42.163441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:42.165880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:42.232729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3d02-8960-4dd1-9749-eb55aa0a2eac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:42.236551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:42.237163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:42.237445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:42.237717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:42.247915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:42.249277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:42.259964 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3285/6575] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:22:42.675744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:42.677804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:42.695174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92abca1-50f0-4663-b6d5-95140752b76c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:42.704321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:42.704956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:42.705519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:42.705519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:42.778808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:42.780192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:42.789510 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3291/6576] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:44.056391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:44.280569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:44.845995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:44.847446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:44.942619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903410e9-716a-40b1-9586-822539dd5047 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:44.947433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:44.948093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:44.948411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:44.948724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] PATH_INFO: `/v3/users/9e152102d838476aaa5fbc061a18037f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:44.950117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e152102d838476aaa5fbc061a18037f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:44.952508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:45.207498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e152102d838476aaa5fbc061a18037f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:45.208639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e152102d838476aaa5fbc061a18037f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:45.292576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e152102d838476aaa5fbc061a18037f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:45.303049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e152102d838476aaa5fbc061a18037f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:45.304217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d44e6fb1-ed08-4adc-9cc9-330c8c1b59b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e152102d838476aaa5fbc061a18037f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:45.331731 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3286/6577] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:44 2022] DELETE /identity/v3/users/9e152102d838476aaa5fbc061a18037f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:45.872678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:45.902224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951174-c3f7-4736-bad1-3981edbb3624 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:46.060847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:46.061541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:46.061825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:46.062119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] PATH_INFO: `/v3/projects/cbf9f25947fb4827acb0b889e67151ae` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:46.063607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf9f25947fb4827acb0b889e67151ae)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:46.065556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:46.234571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf9f25947fb4827acb0b889e67151ae', 'request_id': 'req-e0f6afe1-57d2-4d44-816c-d2c130ee833e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:46.247951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf9f25947fb4827acb0b889e67151ae', 'request_id': 'req-e0f6afe1-57d2-4d44-816c-d2c130ee833e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:46.262738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf9f25947fb4827acb0b889e67151ae', 'request_id': 'req-e0f6afe1-57d2-4d44-816c-d2c130ee833e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:46.354887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] The token cache is being invalidate because project cbf9f25947fb4827acb0b889e67151ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:46.355272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:46.357891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e0f6afe1-57d2-4d44-816c-d2c130ee833e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:46.363036 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3292/6578] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:45 2022] DELETE /identity/v3/projects/cbf9f25947fb4827acb0b889e67151ae => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:46.364587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:46.365035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:46.365133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:46.402776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:46.405020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:46.485527 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3287/6579] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:46.493803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:46.494288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:46.494407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:46.528897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:46.530818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:46.634156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d000b72-0b2f-443b-bf62-86a81ae73940 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:46.640166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:46.642323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:46.642613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:46.642884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:46.646576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:46.691058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:46.711083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:46.712431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:46.733816 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3293/6580] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:46.744245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:46.751516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:46.753129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:46.754762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f21c3-4c3a-4a3f-af9c-2a3580451ff2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:46.760729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:46.761582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:46.762183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:46.762464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:46.763124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:46.764595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:46.767896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:46.783789 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3294/6581] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:22:46.792196 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3288/6582] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:46.792339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:46.801930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1656-8063-4c1a-bba5-c289924921e5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:46.807965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:46.808588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:46.808872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:46.809145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:46.810416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:46.818706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:46.978907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:47.013986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3295/6583] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:46 2022] POST /identity/v3/projects => generated 391 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:47.027677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:47.068559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9f75-4004-4ec4-9da5-350f6c693a97 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:47.196135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:47.196769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:47.197052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:47.197324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:47.198159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:47.202335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:47.338818 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3289/6584] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:47 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:47.346103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:47.366517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be1d9-a81d-4653-9c9a-d3900d418c7a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:47.373032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:47.374622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:47.375248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:47.376558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:47.379267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:47.384362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:47.401560 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3296/6585] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:22:47.417275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:47.440199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11813d-57d0-440b-b941-dd0ff550f2b3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:47.446263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540eb6c-d7cd-4662-9b27-da11c61554e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:47.447902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540eb6c-d7cd-4662-9b27-da11c61554e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:47.448417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540eb6c-d7cd-4662-9b27-da11c61554e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:47.450408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540eb6c-d7cd-4662-9b27-da11c61554e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:47.451905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540eb6c-d7cd-4662-9b27-da11c61554e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:47.454574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540eb6c-d7cd-4662-9b27-da11c61554e6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:47.486530 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3290/6586] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:47.490781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:47.507304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4fe0d-c227-4dcd-abdb-2416c770d85e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:47.514534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:47.520695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:47.520695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:47.520695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] PATH_INFO: `/v3/projects/8d98373384a14ebca34d3d0f3b7352a9/users/d14b9f031f1b44c7822b8354a466111a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:47.553130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d98373384a14ebca34d3d0f3b7352a9, user_id=d14b9f031f1b44c7822b8354a466111a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:47.572762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:47.719775 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3297/6587] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:47 2022] PUT /identity/v3/projects/8d98373384a14ebca34d3d0f3b7352a9/users/d14b9f031f1b44c7822b8354a466111a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:47.723323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:47.724133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:47.724491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:47.751519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:47.753229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:47.845369 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3291/6588] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:22:47.855613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:47.857677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:47.979202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f586f1a-1aff-48bb-93b5-ce2e0e22aef4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:47.984661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2fea6-3d4b-4b17-92d7-4f9d13678ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:47.985946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2fea6-3d4b-4b17-92d7-4f9d13678ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:47.986235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2fea6-3d4b-4b17-92d7-4f9d13678ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:47.986511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2fea6-3d4b-4b17-92d7-4f9d13678ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:48.002709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2fea6-3d4b-4b17-92d7-4f9d13678ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:48.006009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:48.007251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2fea6-3d4b-4b17-92d7-4f9d13678ca4 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:48.026039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a129e1-c537-4141-8bcc-045fe232aa70 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:48.034491 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3298/6589] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:48.037084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:48.037982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:48.038434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:48.038876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:48.044809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:48.196314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:48.198273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a8cda-c179-42e0-80c9-cdc49ef6dc56 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:48.215765 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3292/6590] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:22:48.384921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:48.385196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:48.385476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:48.435078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] MFA Rules not processed for user `2d34479d45c54ecd9901bb8fd9077fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:48.436322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:48.515615 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3299/6591] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:50.211889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:58.942049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:59.966878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4bca-bac3-4cad-a40d-3e4256d20cd6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:59.968038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4bca-bac3-4cad-a40d-3e4256d20cd6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:59.968700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4bca-bac3-4cad-a40d-3e4256d20cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:00.033467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5f9e4bca-bac3-4cad-a40d-3e4256d20cd6 None None] MFA Rules not processed for user `f34ef02913674b04b2822574c2c478f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:00.049735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5f9e4bca-bac3-4cad-a40d-3e4256d20cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:00.124823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:00.177932 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3293/6592] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:22:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:02.499525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:02.501146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:02.534450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751c46-d1da-4be5-978b-d168b46187d5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:02.553824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:02.554662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:02.555047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:02.555423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] PATH_INFO: `/v3/users/9c02bf6678624f03bba9ec4c5380c832` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:02.556725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c02bf6678624f03bba9ec4c5380c832)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:02.560793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:02.918289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c02bf6678624f03bba9ec4c5380c832'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:02.979184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c02bf6678624f03bba9ec4c5380c832'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:03.025120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c02bf6678624f03bba9ec4c5380c832'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:03.026650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c02bf6678624f03bba9ec4c5380c832'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:03.030734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c02bf6678624f03bba9ec4c5380c832'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:03.159345 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3300/6593] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:02 2022] DELETE /identity/v3/users/9c02bf6678624f03bba9ec4c5380c832 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:03.163604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:03.164393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:03.164393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:03.226613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:03.232132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:03.410241 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3294/6594] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:03.460304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:03.462617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:03.685446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4163a10-c961-403e-a3d3-250b6c53ee55 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:03.685446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:03.685446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:03.685446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:03.686421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:03.695530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:03.698518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:03.722261 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3301/6595] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:04.887761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:04.889712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:04.939415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf65bf5-eec0-406c-90e0-c5656189f283 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:04.948783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:04.949597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:04.950050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:04.950653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] PATH_INFO: `/v3/projects/8dafe2ce662b49e88090f86c190f40be` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:04.954859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dafe2ce662b49e88090f86c190f40be)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:04.958804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:05.120826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dafe2ce662b49e88090f86c190f40be', 'request_id': 'req-0ab7360a-e0c6-4b6b-9318-e7a387142e95'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.135100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dafe2ce662b49e88090f86c190f40be', 'request_id': 'req-0ab7360a-e0c6-4b6b-9318-e7a387142e95'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.150510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dafe2ce662b49e88090f86c190f40be', 'request_id': 'req-0ab7360a-e0c6-4b6b-9318-e7a387142e95'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.236289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] The token cache is being invalidate because project 8dafe2ce662b49e88090f86c190f40be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:05.236793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.238894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab7360a-e0c6-4b6b-9318-e7a387142e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.242639 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3295/6596] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:04 2022] DELETE /identity/v3/projects/8dafe2ce662b49e88090f86c190f40be => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:05.246432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:05.262535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3123-98f2-4d9e-90ff-8480c4a147ee service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:05.436757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:05.439345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:05.449534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:05.449534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] PATH_INFO: `/v3/users/28ef2cb78bd9482b968e20c2a3794321` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:05.449534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ef2cb78bd9482b968e20c2a3794321)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:05.451669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:05.483035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:05.751795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ef2cb78bd9482b968e20c2a3794321'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.778149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ef2cb78bd9482b968e20c2a3794321'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.786838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ef2cb78bd9482b968e20c2a3794321'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.787774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ef2cb78bd9482b968e20c2a3794321'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.793228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dae7b4f3-cbb3-491f-bddb-d1968925f421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ef2cb78bd9482b968e20c2a3794321'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:05.911786 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3302/6597] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:05 2022] DELETE /identity/v3/users/28ef2cb78bd9482b968e20c2a3794321 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:06.459740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:06.460245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:06.460378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:06.532917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] MFA Rules not processed for user `d14b9f031f1b44c7822b8354a466111a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:06.535853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:06.780160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:06.805374 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3296/6598] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:06.816291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:06.816945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:06.816945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:06.851704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] MFA Rules not processed for user `d14b9f031f1b44c7822b8354a466111a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:06.853107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:06.874775 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3303/6599] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:06.889295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:06.891434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:07.037661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864966-fd71-48f2-aad0-38db85cb2ada None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:07.045942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103077c-1fc6-41a5-b14c-deeb2ee99877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:07.046562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103077c-1fc6-41a5-b14c-deeb2ee99877 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:07.047473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103077c-1fc6-41a5-b14c-deeb2ee99877 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:07.047765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103077c-1fc6-41a5-b14c-deeb2ee99877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:07.057880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103077c-1fc6-41a5-b14c-deeb2ee99877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:07.059633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103077c-1fc6-41a5-b14c-deeb2ee99877 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:07.070859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:07.075134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:07.119505 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3297/6600] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:07.388807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f730e-a97f-4903-9b69-978cd395fba9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:07.396635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:07.397646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:07.398353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:07.399195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] PATH_INFO: `/v3/projects/bb0524f0ef42459da854499861be38b9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:07.400706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0524f0ef42459da854499861be38b9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:07.403166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:07.566010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0524f0ef42459da854499861be38b9', 'request_id': 'req-b9a16ac5-d511-4c47-869a-36a1696b2cfc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:07.575179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0524f0ef42459da854499861be38b9', 'request_id': 'req-b9a16ac5-d511-4c47-869a-36a1696b2cfc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:07.610524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0524f0ef42459da854499861be38b9', 'request_id': 'req-b9a16ac5-d511-4c47-869a-36a1696b2cfc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:07.692178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] The token cache is being invalidate because project bb0524f0ef42459da854499861be38b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:07.692586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:07.696456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b9a16ac5-d511-4c47-869a-36a1696b2cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:07.696456 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3304/6601] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:07 2022] DELETE /identity/v3/projects/bb0524f0ef42459da854499861be38b9 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:07.700786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:07.701343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:07.701575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:07.740897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:07.743173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:07.860199 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3298/6602] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:07.872112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:07.872580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:07.872661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:07.919435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:07.921519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:07.935701 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3305/6603] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:07.940736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:07.956849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898742c-951a-4f5f-b7e4-b512c0d34496 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:07.964763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:07.965935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:07.967018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:07.967305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:07.968004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:23:07.992050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:07.992050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:07.992050 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3299/6604] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:23:07.995627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:08.011667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1de1a2-03ed-40c3-b0da-f5dee8df161a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:08.019647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:08.020297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:08.020600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:08.022830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:08.022830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:08.023813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:08.177986 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3306/6605] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:07 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:08.182319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:08.206439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2e8d3-54cc-40b1-af69-ee88a9a128c3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:08.375707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:08.375707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:08.375707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:08.376225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:08.376581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:08.378639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:08.421618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:08.565699 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3300/6606] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:08 2022] POST /identity/v3/users => generated 284 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:08.566349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:08.582097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237862-609e-4961-8cf6-9b961437d960 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:08.601177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:08.601810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:08.607399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:08.607697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:08.611985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:08.615025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:08.659306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:08.664325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3307/6607] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:08.678800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753319ef-3db1-4fc9-a398-845ac85e0a3a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:08.706643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557febf-edd6-440a-a271-62c45cad189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:08.707978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557febf-edd6-440a-a271-62c45cad189c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:08.710980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557febf-edd6-440a-a271-62c45cad189c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:08.711488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557febf-edd6-440a-a271-62c45cad189c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:08.712361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557febf-edd6-440a-a271-62c45cad189c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:08.717923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557febf-edd6-440a-a271-62c45cad189c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:08.762011 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3301/6608] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:23:08.763054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:08.794411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a88e2-6887-43ce-8f62-23d6f5dcd390 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:08.817816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:08.819659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:08.819943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:08.823271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] PATH_INFO: `/v3/projects/4d220a4181b74647951f6cfe906bde95/users/8e2ef01de2d041ab9f56cb16e4e5cd68/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:08.866338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d220a4181b74647951f6cfe906bde95, user_id=8e2ef01de2d041ab9f56cb16e4e5cd68, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:08.871357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:09.099712 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3308/6609] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:08 2022] PUT /identity/v3/projects/4d220a4181b74647951f6cfe906bde95/users/8e2ef01de2d041ab9f56cb16e4e5cd68/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:09.111318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:09.111604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:09.112193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:09.213929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] MFA Rules not processed for user `8e2ef01de2d041ab9f56cb16e4e5cd68`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:09.217035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:09.518527 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3302/6610] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:09.523455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:09.686965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e24f2-6ae3-4c53-bb36-3d6abb667ffc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:09.702645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:09.703303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:09.703588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:09.703870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:09.704527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:09.708832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:09.876734 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3309/6611] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:09 2022] POST /identity/v3/projects => generated 367 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:09.878041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:09.894821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31efed-5895-4972-85cc-bb755f248291 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:10.017812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:10.114979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:10.132384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:10.132658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:10.142418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:10.142418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:10.145166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:10.377371 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3303/6612] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:09 2022] POST /identity/v3/users => generated 290 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:10.377775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:10.386414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d71d-26b7-4e0c-882a-9985ad054e06 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:10.401918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:10.402648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:10.406757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:10.406757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:10.406757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:10.407578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:10.464099 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3310/6613] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:10.466665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:10.483280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6262b3c-2420-4cfc-a197-0f90f04a3607 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:10.502460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:10.505153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:10.507321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:10.507804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] PATH_INFO: `/v3/projects/203515d6bcf0433f86dfa87f280e9b9a/users/7d09b3b74e5e47ecb2886a83fbbbfc01/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:10.580391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=203515d6bcf0433f86dfa87f280e9b9a, user_id=7d09b3b74e5e47ecb2886a83fbbbfc01, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:10.596044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:10.796613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3304/6614] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:10 2022] PUT /identity/v3/projects/203515d6bcf0433f86dfa87f280e9b9a/users/7d09b3b74e5e47ecb2886a83fbbbfc01/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:10.801415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:10.821538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112a6e-3a58-4b54-98ef-65a65ed13a84 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:10.964611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccfa35-dd00-446e-b5ea-2c0bccbf0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:10.969643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfa35-dd00-446e-b5ea-2c0bccbf0968 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:10.969978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfa35-dd00-446e-b5ea-2c0bccbf0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:10.970263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfa35-dd00-446e-b5ea-2c0bccbf0968 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:10.972462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccfa35-dd00-446e-b5ea-2c0bccbf0968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:10.981574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccfa35-dd00-446e-b5ea-2c0bccbf0968 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:11.056553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3311/6615] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:11.060965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:11.093328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89bff1-4c16-4a7f-9a62-a9097298d12f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:11.115632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:11.116430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:11.116713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:11.117256 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] PATH_INFO: `/v3/projects/203515d6bcf0433f86dfa87f280e9b9a/users/7d09b3b74e5e47ecb2886a83fbbbfc01/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:11.126494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203515d6bcf0433f86dfa87f280e9b9a, user_id=7d09b3b74e5e47ecb2886a83fbbbfc01, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:11.135940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:11.166314 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3305/6616] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:11 2022] PUT /identity/v3/projects/203515d6bcf0433f86dfa87f280e9b9a/users/7d09b3b74e5e47ecb2886a83fbbbfc01/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:11.168585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:11.168966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:11.169347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:11.211210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] MFA Rules not processed for user `7d09b3b74e5e47ecb2886a83fbbbfc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:11.212586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:11.401636 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3312/6617] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:11.628443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:11.630177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:11.723879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557a5d3-aaf8-4a96-870f-322ce24d4281 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:11.729888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:11.730856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:11.731462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:11.731935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:11.748480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:11.750010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:11.772894 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3306/6618] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:12.183713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:12.196275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87515d8-350c-4275-8429-7419c9d0e2c9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:12.201196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:12.201965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:12.202252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:12.202524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:12.285770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:12.289371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:12.298174 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3313/6619] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:12.560828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:12.685768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:23.787808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:23.790906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:23.954954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324f81-5ded-4ebc-ba00-09b922e0de6a service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:23.965458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:23.966458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:23.967324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:23.967784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] PATH_INFO: `/v3/users/6df9d4296b8047d3acc3f9d3199db774` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:23.969584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df9d4296b8047d3acc3f9d3199db774)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:23.972236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:24.278248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df9d4296b8047d3acc3f9d3199db774'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:24.278977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df9d4296b8047d3acc3f9d3199db774'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:24.418360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df9d4296b8047d3acc3f9d3199db774'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:24.429995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df9d4296b8047d3acc3f9d3199db774'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:24.430688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df9d4296b8047d3acc3f9d3199db774'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:24.462876 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3307/6620] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:23 2022] DELETE /identity/v3/users/6df9d4296b8047d3acc3f9d3199db774 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:24.847928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:24.887419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f624c1-0c9f-47e9-a0f6-2bd920dcb83b service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:25.034529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:25.035355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:25.035475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:25.035724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] PATH_INFO: `/v3/projects/c59ca2d811f647d2a10fc4e1e2e96ef6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:25.037113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59ca2d811f647d2a10fc4e1e2e96ef6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:25.039274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:25.227258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59ca2d811f647d2a10fc4e1e2e96ef6', 'request_id': 'req-f991e313-c2de-4d37-9608-455365521fe5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.228570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:25.242846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59ca2d811f647d2a10fc4e1e2e96ef6', 'request_id': 'req-f991e313-c2de-4d37-9608-455365521fe5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.252848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:25.254349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:25.265479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59ca2d811f647d2a10fc4e1e2e96ef6', 'request_id': 'req-f991e313-c2de-4d37-9608-455365521fe5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.288100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5dc4-3d61-4c78-947e-680565d6e0f9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:25.353404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] The token cache is being invalidate because project c59ca2d811f647d2a10fc4e1e2e96ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:25.353707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.354596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.356558 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3314/6621] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:24 2022] DELETE /identity/v3/projects/c59ca2d811f647d2a10fc4e1e2e96ef6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:25.360465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:25.362651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:25.402229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:25.425379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:25.426068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:25.426353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:25.426633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] PATH_INFO: `/v3/users/8e2ef01de2d041ab9f56cb16e4e5cd68` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:25.428685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2ef01de2d041ab9f56cb16e4e5cd68)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:25.436811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:25.535505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991e313-c2de-4d37-9608-455365521fe5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:25.564520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:25.566276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:25.566276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:25.569901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] PATH_INFO: `/v3/users/2571ca3b91e640ccb92bfac62d454b8b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:25.573533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2571ca3b91e640ccb92bfac62d454b8b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:25.576106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:25.758273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2ef01de2d041ab9f56cb16e4e5cd68'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.759038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2ef01de2d041ab9f56cb16e4e5cd68'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.939852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2ef01de2d041ab9f56cb16e4e5cd68'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.950124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2ef01de2d041ab9f56cb16e4e5cd68'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.950873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-94c76c1b-f3c1-4776-8eb9-3826c2c6e8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2ef01de2d041ab9f56cb16e4e5cd68'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.978302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2571ca3b91e640ccb92bfac62d454b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:25.993642 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3308/6622] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:25 2022] DELETE /identity/v3/users/8e2ef01de2d041ab9f56cb16e4e5cd68 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:25.995335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d45e-49bd-4426-8d1d-7f90ad038c14 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:25.995580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d45e-49bd-4426-8d1d-7f90ad038c14 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:25.995866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d45e-49bd-4426-8d1d-7f90ad038c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:26.001778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2571ca3b91e640ccb92bfac62d454b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:26.013948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2571ca3b91e640ccb92bfac62d454b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:26.014943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2571ca3b91e640ccb92bfac62d454b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:26.016192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2571ca3b91e640ccb92bfac62d454b8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:26.026115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e92d45e-49bd-4426-8d1d-7f90ad038c14 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:26.027932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e92d45e-49bd-4426-8d1d-7f90ad038c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:26.090551 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3315/6623] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:25 2022] DELETE /identity/v3/users/2571ca3b91e640ccb92bfac62d454b8b => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:26.176135 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3309/6624] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:23:26.197729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:26.199520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:26.432001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5c8dc-7307-478a-8cc4-ea0046799830 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:26.437879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:26.438531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:26.438861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:26.439138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:26.584548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:26.585434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:26.586041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:26.622008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:26.623464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:26.636005 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3316/6625] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:26.659615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:26.660975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:26.732817 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3310/6626] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:23:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:26.948761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:26.950278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:26.972175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:26.973809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:27.012613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83688-fb3d-40a9-a86a-ba4aced69e65 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:27.028802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:27.035546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:27.035546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:27.035546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] PATH_INFO: `/v3/projects/0c6bd0bc9b8346ec85266b5e2953ea22` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:27.035546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6bd0bc9b8346ec85266b5e2953ea22)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:27.040557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:27.099595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecff0-b7be-4e8e-9b4d-687b7f745f4e service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:27.107406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:27.108412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:27.109506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:27.109986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:27.120636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:27.137309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:27.137309 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3317/6627] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:23:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:23:27.235455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6bd0bc9b8346ec85266b5e2953ea22', 'request_id': 'req-711e801a-5470-48b3-9c41-55018b6c9a31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:27.251856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6bd0bc9b8346ec85266b5e2953ea22', 'request_id': 'req-711e801a-5470-48b3-9c41-55018b6c9a31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:27.260614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6bd0bc9b8346ec85266b5e2953ea22', 'request_id': 'req-711e801a-5470-48b3-9c41-55018b6c9a31'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:27.383076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] The token cache is being invalidate because project 0c6bd0bc9b8346ec85266b5e2953ea22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:27.383635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:27.385776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:27.388194 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3311/6628] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:26 2022] DELETE /identity/v3/projects/0c6bd0bc9b8346ec85266b5e2953ea22 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:27.409633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:27.938475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:27.940822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:27.978701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9e1a-d399-4ac0-ad97-1763a2ca1679 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:28.110247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:28.110247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:28.110247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:28.110247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] PATH_INFO: `/v3/projects/4d220a4181b74647951f6cfe906bde95` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:28.112372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d220a4181b74647951f6cfe906bde95)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:28.112372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:28.382316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d220a4181b74647951f6cfe906bde95', 'request_id': 'req-8ee65b19-686b-4b8f-add8-df64457ee324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:28.404309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d220a4181b74647951f6cfe906bde95', 'request_id': 'req-8ee65b19-686b-4b8f-add8-df64457ee324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:28.427566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d220a4181b74647951f6cfe906bde95', 'request_id': 'req-8ee65b19-686b-4b8f-add8-df64457ee324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:28.592400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] The token cache is being invalidate because project 4d220a4181b74647951f6cfe906bde95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:28.593326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:28.595237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:28.601765 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3318/6629] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:27 2022] DELETE /identity/v3/projects/4d220a4181b74647951f6cfe906bde95 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:28.606005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:28.607506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:28.640424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e801a-5470-48b3-9c41-55018b6c9a31 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:28.714308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:28.715023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:28.715743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:28.716491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] PATH_INFO: `/v3/users/7d09b3b74e5e47ecb2886a83fbbbfc01` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:28.718064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d09b3b74e5e47ecb2886a83fbbbfc01)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:28.720917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:29.017461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d09b3b74e5e47ecb2886a83fbbbfc01'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:29.019099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d09b3b74e5e47ecb2886a83fbbbfc01'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:29.140311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d09b3b74e5e47ecb2886a83fbbbfc01'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:29.155112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d09b3b74e5e47ecb2886a83fbbbfc01'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:29.157527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d09b3b74e5e47ecb2886a83fbbbfc01'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:29.273669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:29.290773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3312/6630] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:28 2022] DELETE /identity/v3/users/7d09b3b74e5e47ecb2886a83fbbbfc01 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:31.087902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:31.090174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:31.117956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65b19-686b-4b8f-add8-df64457ee324 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:31.236012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:31.248114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:31.250220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:31.251083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:31.251980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] PATH_INFO: `/v3/users/bf7d46906cab4741af09081a9cf58304` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:31.275581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7d46906cab4741af09081a9cf58304)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:31.279187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:31.413412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:31.415089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:31.557133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12471f75-93c8-4ac6-aebd-d5adb3eb54f2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:31.561572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:31.562394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:31.563007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:31.564806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:31.567701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:31.585807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:31.590172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcac3-5da0-4827-8700-ece84a9a7c89 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:31.606526 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3313/6631] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:31.654909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7d46906cab4741af09081a9cf58304'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:31.698834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7d46906cab4741af09081a9cf58304'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:31.711922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7d46906cab4741af09081a9cf58304'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:31.714294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7d46906cab4741af09081a9cf58304'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:31.714294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7d46906cab4741af09081a9cf58304'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:31.851487 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3319/6632] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:31 2022] DELETE /identity/v3/users/bf7d46906cab4741af09081a9cf58304 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:31.862911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:31.862911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:31.862911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:31.924098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:31.938626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:32.040282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:32.042426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:32.104877 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3314/6633] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:32.112713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:32.114520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:32.203312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1847a9-0c52-4229-9516-0bbb43347feb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:32.242225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:32.242909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:32.246849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:32.253010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] PATH_INFO: `/v3/projects/203515d6bcf0433f86dfa87f280e9b9a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:32.255388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203515d6bcf0433f86dfa87f280e9b9a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:32.264246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:32.275869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:32.299124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c731d-201e-4f10-8ab6-a8091a8481af None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:32.314930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a7ccc-ac3f-4c3e-9ae7-4e41268c98e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:32.318780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a7ccc-ac3f-4c3e-9ae7-4e41268c98e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:32.319099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a7ccc-ac3f-4c3e-9ae7-4e41268c98e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:32.319378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a7ccc-ac3f-4c3e-9ae7-4e41268c98e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:32.347614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a7ccc-ac3f-4c3e-9ae7-4e41268c98e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:32.353464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a7ccc-ac3f-4c3e-9ae7-4e41268c98e9 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:32.401066 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3315/6634] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:23:32.496637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203515d6bcf0433f86dfa87f280e9b9a', 'request_id': 'req-97f0a251-52c0-41b0-a437-3f7516ff5061'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:32.510290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203515d6bcf0433f86dfa87f280e9b9a', 'request_id': 'req-97f0a251-52c0-41b0-a437-3f7516ff5061'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:32.523535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203515d6bcf0433f86dfa87f280e9b9a', 'request_id': 'req-97f0a251-52c0-41b0-a437-3f7516ff5061'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:32.554029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:32.629249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] The token cache is being invalidate because project 203515d6bcf0433f86dfa87f280e9b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:32.630083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:32.631709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-97f0a251-52c0-41b0-a437-3f7516ff5061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:32.635708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3320/6635] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:32 2022] DELETE /identity/v3/projects/203515d6bcf0433f86dfa87f280e9b9a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:32.641626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:32.643730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:32.643730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:32.718791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:32.724503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:32.908637 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3316/6636] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:32.913020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:32.915366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:32.919046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:32.956097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:32.958363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:32.984203 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3321/6637] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:32.988438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.005371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a15a72-d33d-487f-be3f-264b55acd587 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.010873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.011496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.011969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.012524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.013454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:23:33.014002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.015759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.032238 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3317/6638] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:23:33.057218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.068081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd998d5-e95e-4512-b042-5580e931d9b6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.074620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.075242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.075522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.075795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.076441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.078532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.145574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.148032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:33.167728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d39d3-7ba3-4414-a4c2-eb775c5d952f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.177082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.177782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.178052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.178337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] PATH_INFO: `/v3/projects/0bff07740e26403ebe33b88bbefb104b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.179681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bff07740e26403ebe33b88bbefb104b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.181890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.224291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3322/6639] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:33 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:33.225754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.324915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306797a9-cf2f-468f-b863-9615a4b6b65f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.333369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.334235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.334847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.334847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.335686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.338059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.539924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bff07740e26403ebe33b88bbefb104b', 'request_id': 'req-63afe873-1f6c-4a84-9619-785afe77127f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:33.546297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bff07740e26403ebe33b88bbefb104b', 'request_id': 'req-63afe873-1f6c-4a84-9619-785afe77127f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:33.554197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bff07740e26403ebe33b88bbefb104b', 'request_id': 'req-63afe873-1f6c-4a84-9619-785afe77127f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:33.603881 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3323/6640] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:33 2022] POST /identity/v3/users => generated 292 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:23:33.605079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.634565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2aa0a-07d1-44b3-a63a-615f26fb2cff admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.688440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] The token cache is being invalidate because project 0bff07740e26403ebe33b88bbefb104b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:33.689106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:33.689775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:33.691643 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3318/6641] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:33 2022] DELETE /identity/v3/projects/0bff07740e26403ebe33b88bbefb104b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:33.695667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.697133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:33.699012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.699634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.699911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.700179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.701372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.702788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.712766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afe873-1f6c-4a84-9619-785afe77127f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.718586 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3324/6642] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:23:33.722234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.723147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.723147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.723571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] PATH_INFO: `/v3/users/f0b63aed7fd243eda66f9d1d51e458d1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.724802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b63aed7fd243eda66f9d1d51e458d1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.725194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.727008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.727557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:33.761011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57eb7-abce-45cd-a507-9e3b758783ca admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.775321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.776226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.776669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.778633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.779533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.782090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:33.813046 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3325/6643] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:33.815530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:33.840674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a8e8a-6bc6-44b0-bd59-676ecf184a79 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:33.847544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced7ec8-f8e4-4859-b7a9-e1d9317822c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:33.848368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7ec8-f8e4-4859-b7a9-e1d9317822c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:33.848663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7ec8-f8e4-4859-b7a9-e1d9317822c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:33.848942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7ec8-f8e4-4859-b7a9-e1d9317822c7 admin admin] PATH_INFO: `/v3/projects/d1b7f315e8884d1f90cc4e90ab46fb82/users/21027234e54d4c20acc530c3a349bb92/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:33.867992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced7ec8-f8e4-4859-b7a9-e1d9317822c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b7f315e8884d1f90cc4e90ab46fb82, user_id=21027234e54d4c20acc530c3a349bb92, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:33.871103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced7ec8-f8e4-4859-b7a9-e1d9317822c7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:34.020423 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3326/6644] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:33 2022] PUT /identity/v3/projects/d1b7f315e8884d1f90cc4e90ab46fb82/users/21027234e54d4c20acc530c3a349bb92/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:34.048479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:34.048944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:34.049436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:34.090111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b63aed7fd243eda66f9d1d51e458d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:34.091060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b63aed7fd243eda66f9d1d51e458d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:34.174288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] MFA Rules not processed for user `21027234e54d4c20acc530c3a349bb92`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:34.176585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:34.193159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b63aed7fd243eda66f9d1d51e458d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:34.238146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b63aed7fd243eda66f9d1d51e458d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:34.241976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b63aed7fd243eda66f9d1d51e458d1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:34.316463 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3327/6645] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:34.325343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:34.332131 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3319/6646] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:33 2022] DELETE /identity/v3/users/f0b63aed7fd243eda66f9d1d51e458d1 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:34.336103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:34.478569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67778652-a263-4a7a-88f7-dfb3f9b6e857 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:34.692962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:34.693590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:34.693886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:34.694165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:34.694801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:34.696710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:34.822920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3328/6647] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:34 2022] POST /identity/v3/projects => generated 383 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:34.827621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:34.842753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca5ec-d76d-445b-8d0b-05bcf7201fa7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:34.942100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:34.943200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:34.943715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:34.944432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:34.945345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:34.948867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:34.971555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:35.083038 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3320/6648] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:34 2022] POST /identity/v3/users => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:35.088739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:35.102611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a399301-4da9-4ec8-8940-f6ef1bf23b01 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:35.108687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:35.110084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.110371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.110649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.111414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:35.113182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:35.128111 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3329/6649] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:35.132827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:35.156378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0013-4ab8-485e-bdea-67b1f4d35206 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:35.169129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:35.170028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.171198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.173966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] PATH_INFO: `/v3/projects/d152bd3e92cd4c27bce4ae21d4efc145/users/fa6861f42dcf40cc915011d086f16131/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.190654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:35.203190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:35.205382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:35.219637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d152bd3e92cd4c27bce4ae21d4efc145, user_id=fa6861f42dcf40cc915011d086f16131, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:35.222807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:35.241064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e44ce-25cd-4876-94fd-f930d892cbdb admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:35.259490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:35.260148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.260430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.260701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] PATH_INFO: `/v3/projects/2ca6ba8d3cb747cbbd953a0ff1da3ed5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.261907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca6ba8d3cb747cbbd953a0ff1da3ed5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:35.264592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:35.304557 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3321/6650] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:35 2022] PUT /identity/v3/projects/d152bd3e92cd4c27bce4ae21d4efc145/users/fa6861f42dcf40cc915011d086f16131/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:35.305719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:35.427774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca6ba8d3cb747cbbd953a0ff1da3ed5', 'request_id': 'req-71c2b717-8c39-4f4b-92d3-d18355041893'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:35.439819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e235-ae53-488e-804a-2ca2680e628c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:35.446625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca6ba8d3cb747cbbd953a0ff1da3ed5', 'request_id': 'req-71c2b717-8c39-4f4b-92d3-d18355041893'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:35.455287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca6ba8d3cb747cbbd953a0ff1da3ed5', 'request_id': 'req-71c2b717-8c39-4f4b-92d3-d18355041893'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:35.535671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:35.536486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.536774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.537087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.537789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:35.539859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:35.568923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] The token cache is being invalidate because project 2ca6ba8d3cb747cbbd953a0ff1da3ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:35.569269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:35.569966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71c2b717-8c39-4f4b-92d3-d18355041893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:35.570561 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3322/6651] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:35.574618 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3330/6652] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:35 2022] DELETE /identity/v3/projects/2ca6ba8d3cb747cbbd953a0ff1da3ed5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:35.574725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:35.580242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2e7a2-e189-4723-9354-f050c15fea3a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.587501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2e7a2-e189-4723-9354-f050c15fea3a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.587501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2e7a2-e189-4723-9354-f050c15fea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.588028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:35.600807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195b91-065c-4b54-9f6e-edc8480cf0e0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:35.609059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0cf1-4a77-43c1-9447-42defb9dc12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:35.610241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0cf1-4a77-43c1-9447-42defb9dc12f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.611042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0cf1-4a77-43c1-9447-42defb9dc12f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.611687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0cf1-4a77-43c1-9447-42defb9dc12f admin admin] PATH_INFO: `/v3/projects/d152bd3e92cd4c27bce4ae21d4efc145/users/fa6861f42dcf40cc915011d086f16131/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.615885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0cf1-4a77-43c1-9447-42defb9dc12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d152bd3e92cd4c27bce4ae21d4efc145, user_id=fa6861f42dcf40cc915011d086f16131, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:35.622319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0cf1-4a77-43c1-9447-42defb9dc12f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:35.627481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-97e2e7a2-e189-4723-9354-f050c15fea3a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:35.628431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-97e2e7a2-e189-4723-9354-f050c15fea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:35.637424 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3323/6653] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:35 2022] PUT /identity/v3/projects/d152bd3e92cd4c27bce4ae21d4efc145/users/fa6861f42dcf40cc915011d086f16131/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:35.648216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.648593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.649123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.718365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:35.721639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] MFA Rules not processed for user `fa6861f42dcf40cc915011d086f16131`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:35.725393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:35.802090 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3331/6654] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:35.809783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.810253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.810456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.878238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:35.879253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:35.900333 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3332/6655] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:23:35.904979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:35.927459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3d966-a371-4f03-81b3-5f70aaa8bb95 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:35.938233 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3324/6656] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:23:35.947095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:35.947921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:35.948197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:35.948469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:35.949371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:23:35.949681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:35.951583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:35.989383 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3333/6657] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:23:35.991030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.005227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981750c-1d1b-48f1-8c50-fb9e2860e3d3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:36.010700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:36.011382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.011671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.012219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.013373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:36.015814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:36.102615 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3325/6658] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:35 2022] POST /identity/v3/projects => generated 357 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:36.106772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.125977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab01560-d2a7-4d0f-be46-6ddebf5a969e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:36.204868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:36.205503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.205785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.206110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.207275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:36.209468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:36.295784 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3334/6659] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:36 2022] POST /identity/v3/users => generated 279 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:36.300470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.315200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683f09-f6e1-4b9b-bba1-9f8ca3cc666a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:36.326282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:36.327444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.328980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.329404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.330720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:36.333426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:36.364396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.367496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:36.379330 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3326/6660] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:36.385961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.400087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406fff-63a8-496c-b045-70edc386c760 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:36.407366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:36.411805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.411805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.411805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.411805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:36.411805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:36.438445 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3327/6661] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:36.442843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.464924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbbaab-37eb-4884-b668-9b8de37a1878 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:36.475397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b15f4-9379-418d-9347-74e0d2d8166c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:36.477145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:36.479117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.479328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.479610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] PATH_INFO: `/v3/projects/2e37c39686bc414fbed83af71809cc32/users/13278f571d144bfbab6da42ec980f525/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.485431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf8b00-7b97-4ecc-b43d-22dabf5f4010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:36.486518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8b00-7b97-4ecc-b43d-22dabf5f4010 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.489004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8b00-7b97-4ecc-b43d-22dabf5f4010 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.489296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8b00-7b97-4ecc-b43d-22dabf5f4010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.520916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e37c39686bc414fbed83af71809cc32, user_id=13278f571d144bfbab6da42ec980f525, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:36.530992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:36.595564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf8b00-7b97-4ecc-b43d-22dabf5f4010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:36.597234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf8b00-7b97-4ecc-b43d-22dabf5f4010 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:36.611823 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3335/6662] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:36.667172 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3328/6663] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:36 2022] PUT /identity/v3/projects/2e37c39686bc414fbed83af71809cc32/users/13278f571d144bfbab6da42ec980f525/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:36.678066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:36.678397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:36.678682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:36.736878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] MFA Rules not processed for user `13278f571d144bfbab6da42ec980f525`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:36.736878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:36.891721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:36.911158 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3336/6664] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:36.914115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:37.063575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e604b5-ea3b-4070-9d8d-0dd95eb26143 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:37.072012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:37.072933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:37.073227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:37.073508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:37.074912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:37.080899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:37.096671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5a2aa-be90-43b1-9698-cc527db8dd18 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:37.108187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:37.109506 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:37.109786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:37.112457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:37.115762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:37.220345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:37.221974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:37.234256 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3337/6665] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:36 2022] POST /identity/v3/projects => generated 357 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:37.235207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:37.242884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3329/6666] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:23:37.288432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:37.541763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40425197-0ee7-4054-af74-a0419c6308dc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:37.561148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:37.573160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:37.573160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:37.573160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:37.573160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:37.578144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:37.761585 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3338/6667] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:37 2022] POST /identity/v3/users => generated 285 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:37.768995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:37.795183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:37.825422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905dbbd-225e-4622-85e7-f88438664672 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:37.873600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:37.875420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:37.875948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:37.876408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:37.883816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:37.883816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:37.932524 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3330/6668] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:37.936395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:37.951737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99d64a-6655-46f9-896e-2392405fccf2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:37.963787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:37.964534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:37.964903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:37.965730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] PATH_INFO: `/v3/projects/c1e72a676f1742709c7f47b23bf0ffea/users/1a00f45dc6774dbc958583cd9c030a63/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:38.034344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e72a676f1742709c7f47b23bf0ffea, user_id=1a00f45dc6774dbc958583cd9c030a63, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:38.044712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:38.138474 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3339/6669] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:37 2022] PUT /identity/v3/projects/c1e72a676f1742709c7f47b23bf0ffea/users/1a00f45dc6774dbc958583cd9c030a63/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:38.143453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:38.163264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41d64-f444-417a-a690-ccde3105f618 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:38.289152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:38.290665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:38.292318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:38.293338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:38.294999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:38.297262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:38.298266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:38.299464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:38.308604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a012f-d8c8-444b-aefa-b6b81287bc1e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:38.334508 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3331/6670] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:38.334735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:38.335327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:38.335604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:38.335878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] PATH_INFO: `/v3/users/21027234e54d4c20acc530c3a349bb92` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:38.338409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21027234e54d4c20acc530c3a349bb92)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:38.339531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:38.341055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:38.383625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f921fc-39ee-4d47-8d29-a7531076f6da admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:38.400705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8752c-0c57-4ff8-9bcc-d5646ff640f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:38.405244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8752c-0c57-4ff8-9bcc-d5646ff640f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:38.405774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8752c-0c57-4ff8-9bcc-d5646ff640f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:38.410169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8752c-0c57-4ff8-9bcc-d5646ff640f9 admin admin] PATH_INFO: `/v3/projects/c1e72a676f1742709c7f47b23bf0ffea/users/1a00f45dc6774dbc958583cd9c030a63/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:38.414684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8752c-0c57-4ff8-9bcc-d5646ff640f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e72a676f1742709c7f47b23bf0ffea, user_id=1a00f45dc6774dbc958583cd9c030a63, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:38.419236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8752c-0c57-4ff8-9bcc-d5646ff640f9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:38.461918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3332/6671] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:38 2022] PUT /identity/v3/projects/c1e72a676f1742709c7f47b23bf0ffea/users/1a00f45dc6774dbc958583cd9c030a63/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:38.573963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:38.574328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:38.574802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:38.633020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] MFA Rules not processed for user `1a00f45dc6774dbc958583cd9c030a63`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:38.634634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:38.699490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21027234e54d4c20acc530c3a349bb92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:38.730097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21027234e54d4c20acc530c3a349bb92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:38.742282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21027234e54d4c20acc530c3a349bb92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:38.743059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21027234e54d4c20acc530c3a349bb92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:38.743833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d7344140-9fec-4a31-919e-33e056895cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21027234e54d4c20acc530c3a349bb92'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:38.755192 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3333/6672] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:38.833681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:38.904965 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3340/6673] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:38 2022] DELETE /identity/v3/users/21027234e54d4c20acc530c3a349bb92 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:38.907157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:38.907447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:38.907722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:38.937029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:38.940991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:38.950191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc3d30-3bf2-4e8f-bd37-89ae702fa68a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:38.983116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:39.035241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:39.036830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:39.037299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:39.038364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:39.041361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:39.070814 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3341/6674] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:39.079699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:39.081598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:39.209077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e97c-f117-40ef-ada1-e08e0f1beff9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:39.214605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:39.215473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:39.215767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:39.216033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:39.219462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:39.228864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:39.229070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:39.230927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:39.245080 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3342/6675] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:23:39.259201 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3334/6676] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:23:39.600003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:39.623349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:39.625207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:39.682927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656884-e9ae-4739-915a-fa8dc8817239 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:39.692670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:39.693310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:39.697486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:39.697486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:39.698599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:39.819818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:39.821667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:39.839145 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3343/6677] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:39.866161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:40.225362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:40.226956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:40.244167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189c1ca-04cc-4d21-b788-335db8e4d645 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:40.248963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:40.250432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:40.250630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:40.250978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] PATH_INFO: `/v3/projects/d1b7f315e8884d1f90cc4e90ab46fb82` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:40.252260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b7f315e8884d1f90cc4e90ab46fb82)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:40.254345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:40.484250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b7f315e8884d1f90cc4e90ab46fb82', 'request_id': 'req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:40.492397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b7f315e8884d1f90cc4e90ab46fb82', 'request_id': 'req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:40.504672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b7f315e8884d1f90cc4e90ab46fb82', 'request_id': 'req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:40.643707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] The token cache is being invalidate because project d1b7f315e8884d1f90cc4e90ab46fb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:40.644061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:40.644847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:40.646738 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3335/6678] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:40 2022] DELETE /identity/v3/projects/d1b7f315e8884d1f90cc4e90ab46fb82 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:40.651747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:40.668039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f34466-493a-4166-b0f6-9bb8cef2b2ca service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:40.848388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:40.850220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:40.853988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:40.853988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] PATH_INFO: `/v3/users/fa6861f42dcf40cc915011d086f16131` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:40.853988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6861f42dcf40cc915011d086f16131)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:40.855247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:41.201662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6861f42dcf40cc915011d086f16131'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:41.244161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6861f42dcf40cc915011d086f16131'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:41.264450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6861f42dcf40cc915011d086f16131'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:41.271658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6861f42dcf40cc915011d086f16131'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:41.271658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772cc921-df96-49b5-97ff-0d0035fa578a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6861f42dcf40cc915011d086f16131'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:41.408126 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3344/6679] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:23:40 2022] DELETE /identity/v3/users/fa6861f42dcf40cc915011d086f16131 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:41.926709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:42.447868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:42.449419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:42.488996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca3d0-3893-4802-9ab3-2dc5a6104f0b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:42.601748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:42.608815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:42.609693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:42.610313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:42.610849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] PATH_INFO: `/v3/projects/d152bd3e92cd4c27bce4ae21d4efc145` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:42.612633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d152bd3e92cd4c27bce4ae21d4efc145)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:42.615144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:42.789115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd152bd3e92cd4c27bce4ae21d4efc145', 'request_id': 'req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:42.801211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd152bd3e92cd4c27bce4ae21d4efc145', 'request_id': 'req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:42.820384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd152bd3e92cd4c27bce4ae21d4efc145', 'request_id': 'req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:42.902997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] The token cache is being invalidate because project d152bd3e92cd4c27bce4ae21d4efc145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:23:42.902997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:42.902997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1f9c081-6284-4f54-a1d2-bb3d74d69bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:23:42.904112 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3336/6680] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:23:42 2022] DELETE /identity/v3/projects/d152bd3e92cd4c27bce4ae21d4efc145 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:23:42.910264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:42.910978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:42.911263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:42.953013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:42.955435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:43.044778 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3345/6681] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:43.054003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.054302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.054611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.079702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:43.081788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:43.099943 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3337/6682] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:43.104374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:43.116810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83cede-3568-4cf3-99fa-1aa0098487fe None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:43.125473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:43.126635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.127101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.127567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.128731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:23:43.131616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:43.133821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:43.150303 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3346/6683] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:23:43.156174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:43.169616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc13a-58af-4741-bbe2-1fd948ef8bb5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:43.196803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:43.197669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.198139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.198694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.200090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:43.203310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:43.340392 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3338/6684] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:43 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:43.350305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:43.365136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f73a-aa0f-44b9-9760-f84f7705366e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:43.507050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:43.509195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.513163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.513503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.515117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:43.519160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:43.671727 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3347/6685] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:43 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:43.675971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:43.690377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab31c7-0712-45ba-9274-16736a6fa89f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:43.705265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:43.705932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.706217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.706703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.707840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:43.710830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:43.751274 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3339/6686] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:43.753399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:43.769737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca53ba-c2aa-40bf-b985-d781c298f586 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:43.778594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c019ab4-3007-44c1-b5c2-f26928ad1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:43.779945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c019ab4-3007-44c1-b5c2-f26928ad1a94 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.781158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c019ab4-3007-44c1-b5c2-f26928ad1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.781543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c019ab4-3007-44c1-b5c2-f26928ad1a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.782524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c019ab4-3007-44c1-b5c2-f26928ad1a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:43.784936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c019ab4-3007-44c1-b5c2-f26928ad1a94 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:43.802370 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3348/6687] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:43.806756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:43.819665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84ba8-3a32-436e-b38e-e90f8c5367a3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:43.832147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:43.832803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:43.833406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:43.833875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] PATH_INFO: `/v3/projects/63e5adc71e1d4a24bc35d650fb5650fa/users/f9cc29ea1c8646cb9f5275ecf8f97ab2/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:43.871809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e5adc71e1d4a24bc35d650fb5650fa, user_id=f9cc29ea1c8646cb9f5275ecf8f97ab2, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:43.874872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:44.062795 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3340/6688] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:43 2022] PUT /identity/v3/projects/63e5adc71e1d4a24bc35d650fb5650fa/users/f9cc29ea1c8646cb9f5275ecf8f97ab2/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:44.063054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a845-12b7-415c-8665-a1fcd28b8882 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:44.063054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a845-12b7-415c-8665-a1fcd28b8882 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:44.063054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a845-12b7-415c-8665-a1fcd28b8882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:44.100543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3255a845-12b7-415c-8665-a1fcd28b8882 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:44.102715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3255a845-12b7-415c-8665-a1fcd28b8882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:44.189541 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3349/6689] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:44.199903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:44.210295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:44.318874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf16cb-e26c-45ac-a0a4-e3d7c8bcdfb8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:44.324772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73edf8-c310-40ce-90f9-ca4513275340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:44.325440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73edf8-c310-40ce-90f9-ca4513275340 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:44.325728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73edf8-c310-40ce-90f9-ca4513275340 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:44.326174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73edf8-c310-40ce-90f9-ca4513275340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:44.354806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73edf8-c310-40ce-90f9-ca4513275340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:44.356375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73edf8-c310-40ce-90f9-ca4513275340 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:44.378414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:44.381350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:44.381869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:44.399903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3341/6690] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:44.413190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] MFA Rules not processed for user `cb0cd81939cf4620b52a7aa4b9882c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:44.414764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:44.461403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:44.517907 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3350/6691] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:46.524529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:46.606105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:46.610402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:46.612398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:46.678510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] MFA Rules not processed for user `f9cc29ea1c8646cb9f5275ecf8f97ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:46.680280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:46.700944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:46.785291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:46.785561 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3342/6692] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:46.809779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d2f84-a0fa-4a07-a30a-2fd85639cdf5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:46.819632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:46.821775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:46.826177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:46.826541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:46.827272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:46.829379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:47.018910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:47.020613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3351/6693] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:23:46 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:47.038009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816ae2-c2a1-4e90-8c8b-b04fb6adf443 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:47.167547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:47.168174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:47.168460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:47.168744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:47.169398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:47.171434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:47.264183 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3343/6694] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:23:47 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:23:47.266149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:47.306296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38c25-c66a-4cb1-aff3-c055e7bbdc79 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:47.316343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:47.317066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:47.317374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:47.317657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:47.318402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:47.320097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:47.333658 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3352/6695] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:47.344444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:47.362128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485229-24cb-4b42-8c17-790786bacc5a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:47.370900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:47.371731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:47.372686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:47.372686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] PATH_INFO: `/v3/projects/9f7b2e0d70914967b0d8caf43937310e/users/aa19e07e50d14eee8a3b32597d2c6bf7/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:47.411150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7b2e0d70914967b0d8caf43937310e, user_id=aa19e07e50d14eee8a3b32597d2c6bf7, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:47.420817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:47.520418 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3344/6696] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:47 2022] PUT /identity/v3/projects/9f7b2e0d70914967b0d8caf43937310e/users/aa19e07e50d14eee8a3b32597d2c6bf7/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:47.524743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:47.547475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea487-e35d-4deb-ae5b-bdf4f8d4676d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:47.682165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c756-03de-4699-8209-1becd54b02fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:47.682789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c756-03de-4699-8209-1becd54b02fe admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:47.683068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c756-03de-4699-8209-1becd54b02fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:47.683343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c756-03de-4699-8209-1becd54b02fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:47.683997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3c756-03de-4699-8209-1becd54b02fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:47.685621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3c756-03de-4699-8209-1becd54b02fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:47.705497 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3353/6697] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:23:47.706271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:47.730886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9806-e69e-446f-b5b5-738491795eea admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:47.744343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a4c6-8550-4bd7-a6a4-26a250e58483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:47.745034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a4c6-8550-4bd7-a6a4-26a250e58483 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:47.745318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a4c6-8550-4bd7-a6a4-26a250e58483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:47.745597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a4c6-8550-4bd7-a6a4-26a250e58483 admin admin] PATH_INFO: `/v3/projects/9f7b2e0d70914967b0d8caf43937310e/users/aa19e07e50d14eee8a3b32597d2c6bf7/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:47.748836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a4c6-8550-4bd7-a6a4-26a250e58483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7b2e0d70914967b0d8caf43937310e, user_id=aa19e07e50d14eee8a3b32597d2c6bf7, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:47.759802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a4c6-8550-4bd7-a6a4-26a250e58483 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:47.781758 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3345/6698] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:23:47 2022] PUT /identity/v3/projects/9f7b2e0d70914967b0d8caf43937310e/users/aa19e07e50d14eee8a3b32597d2c6bf7/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:23:48.288531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:52.279328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:52.281583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:52.282425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:52.367297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] MFA Rules not processed for user `aa19e07e50d14eee8a3b32597d2c6bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:52.370402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:52.540706 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3354/6699] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:52.665040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:52.666148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:52.666674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:52.689316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] MFA Rules not processed for user `f9cc29ea1c8646cb9f5275ecf8f97ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:23:52.692777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:52.772386 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3346/6700] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:23:52.780922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:52.785212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:52.971874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:52.985286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6280-3f7a-4869-99bd-1a0214978eaa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:53.007815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0a831-146c-4cb4-9528-45b773512fd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:53.008453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0a831-146c-4cb4-9528-45b773512fd7 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:53.008739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0a831-146c-4cb4-9528-45b773512fd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:53.009019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0a831-146c-4cb4-9528-45b773512fd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:53.042840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0a831-146c-4cb4-9528-45b773512fd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:53.044481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0a831-146c-4cb4-9528-45b773512fd7 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:53.064824 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3355/6701] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:58.325165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:58.344993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:58.421782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2840b26-4e5f-4278-8642-a87b4401e9fd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:58.440372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:58.441093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:58.442889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:58.443168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:58.445347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:58.459412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:58.461533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:58.477525 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3347/6702] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:02.386326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:02.387650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:02.388292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:02.421354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:02.423068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:02.579959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:02.582172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:02.584923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3356/6703] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:24:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:02.799304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363df7b4-86eb-4078-a8e1-e1c34e337f65 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:02.813581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:02.814618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:02.815100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:02.815567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:02.830784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:02.845334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:02.849814 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3348/6704] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:24:03.538624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:03.542209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:03.635847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588a36-038c-4aea-8e61-d1f956e3cbaf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:03.641566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:03.642339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:03.642721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:03.643008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] PATH_INFO: `/v3/users/d14b9f031f1b44c7822b8354a466111a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:03.644385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14b9f031f1b44c7822b8354a466111a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:03.646388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:04.122542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14b9f031f1b44c7822b8354a466111a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:04.163380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14b9f031f1b44c7822b8354a466111a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:04.183693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14b9f031f1b44c7822b8354a466111a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:04.184832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14b9f031f1b44c7822b8354a466111a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:04.187693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14b9f031f1b44c7822b8354a466111a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:04.368326 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3357/6705] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:03 2022] DELETE /identity/v3/users/d14b9f031f1b44c7822b8354a466111a => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:24:04.419700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:04.442131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073aa3-3daf-4c09-84d1-985ad794df46 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:04.550856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:04.551811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:04.552095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:04.552539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:04.554797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:04.633870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:04.699904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:04.706945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564c0e7-979e-44e3-8ce0-072eccc62188 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:04.735968 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3349/6706] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:05.112331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:05.113826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:05.151056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:05.249228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19d1c-6b4b-4ad5-a18a-d02e23108152 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:05.254509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:05.255303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:05.255647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:05.256009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] PATH_INFO: `/v3/projects/8d98373384a14ebca34d3d0f3b7352a9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:05.257550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d98373384a14ebca34d3d0f3b7352a9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:05.259654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:05.456022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d98373384a14ebca34d3d0f3b7352a9', 'request_id': 'req-d092ccad-edfa-43d6-becc-1b53ff76e85f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:05.465917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d98373384a14ebca34d3d0f3b7352a9', 'request_id': 'req-d092ccad-edfa-43d6-becc-1b53ff76e85f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:05.499943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d98373384a14ebca34d3d0f3b7352a9', 'request_id': 'req-d092ccad-edfa-43d6-becc-1b53ff76e85f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:05.617729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] The token cache is being invalidate because project 8d98373384a14ebca34d3d0f3b7352a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:24:05.618072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:05.619279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d092ccad-edfa-43d6-becc-1b53ff76e85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:05.622269 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3358/6707] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:24:05 2022] DELETE /identity/v3/projects/8d98373384a14ebca34d3d0f3b7352a9 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:05.627863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:05.628398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:05.628398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:05.651436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:05.653410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:05.758903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3350/6708] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:24:05.768114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:05.768411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:05.768674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:05.798365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:05.799717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:05.809427 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3359/6709] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:05.814526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:05.826701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7a707-52dd-47f8-9478-7fbb880081dc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:05.832971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:05.834284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:05.834784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:05.835519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:05.836643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:24:05.838234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:05.840592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:05.870598 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3351/6710] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:24:05.876560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:05.888755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67663f76-cd9f-4c21-8612-79bfe9f72291 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:05.896696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:05.898332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:05.898835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:05.899360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:05.900426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:05.903171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:06.064759 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3360/6711] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:05 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:06.071131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:06.088584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecce474-e3d5-4bdb-9b17-f9a13a2b00ce admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:06.197111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:06.198115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:06.199125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:06.199125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:06.200135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:06.203837 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:06.319579 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3352/6712] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:06 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:24:06.325625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:06.364032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cf186-7f59-4697-9ebd-16338ee4e6db admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:06.373923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:06.375226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:06.375733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:06.376189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:06.377091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:06.379509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:06.393907 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3361/6713] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:24:06.398634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:06.418567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6e24-fe52-4cac-a82c-24a8698cee11 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:06.429046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014cffd-19b1-4b61-9e3b-6528fe6a88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:06.429686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014cffd-19b1-4b61-9e3b-6528fe6a88e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:06.430182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014cffd-19b1-4b61-9e3b-6528fe6a88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:06.430559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014cffd-19b1-4b61-9e3b-6528fe6a88e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:06.433529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014cffd-19b1-4b61-9e3b-6528fe6a88e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:06.433529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014cffd-19b1-4b61-9e3b-6528fe6a88e4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:06.449131 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3353/6714] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:24:06.456244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:06.477715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cefde1-971d-40ef-bce2-c07d1da9c6d2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:06.485013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:06.485774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:06.486244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:06.488216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] PATH_INFO: `/v3/projects/72a87c4db6d74cc1a996162e5ad35418/users/eab435220eb1424985b28ec0642ef70e/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:06.508942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a87c4db6d74cc1a996162e5ad35418, user_id=eab435220eb1424985b28ec0642ef70e, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:06.512108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:06.656822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3362/6715] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:06 2022] PUT /identity/v3/projects/72a87c4db6d74cc1a996162e5ad35418/users/eab435220eb1424985b28ec0642ef70e/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:06.662247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:06.663170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:06.663673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:06.691392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:06.693091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:06.841298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:06.864664 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3354/6716] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:06.878986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:06.882006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:06.974014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02b4b5-1e7b-4055-a858-848d0bf67812 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:06.981838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:06.982787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:06.983176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:06.983559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:06.996097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:07.000766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:07.027322 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3363/6717] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:24:07.685552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:10.095044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:10.095044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:10.140458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28c5c1-de8d-46de-ba8d-17e415e2dd15 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:10.157885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:10.158561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:10.158852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:10.159136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] PATH_INFO: `/v3/users/2d34479d45c54ecd9901bb8fd9077fa4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:10.160467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d34479d45c54ecd9901bb8fd9077fa4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:10.165237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:10.540572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d34479d45c54ecd9901bb8fd9077fa4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:10.541808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d34479d45c54ecd9901bb8fd9077fa4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:10.676285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d34479d45c54ecd9901bb8fd9077fa4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:10.700732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d34479d45c54ecd9901bb8fd9077fa4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:10.702579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-81ba2d50-d5e7-454a-864d-13092c68e210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d34479d45c54ecd9901bb8fd9077fa4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:10.745965 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3355/6718] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:10 2022] DELETE /identity/v3/users/2d34479d45c54ecd9901bb8fd9077fa4 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:11.211461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:11.222902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44aa8-850b-4510-9836-efccc9ea48cd service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:11.299651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:11.303881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:11.303881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:11.303881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] PATH_INFO: `/v3/projects/c3eca6aadaa848a498c9226d1c83be2b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:11.303881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3eca6aadaa848a498c9226d1c83be2b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:11.304588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:11.449648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3eca6aadaa848a498c9226d1c83be2b', 'request_id': 'req-a45bc983-134a-441a-9894-150d9a32971e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:11.467565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3eca6aadaa848a498c9226d1c83be2b', 'request_id': 'req-a45bc983-134a-441a-9894-150d9a32971e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:11.486772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3eca6aadaa848a498c9226d1c83be2b', 'request_id': 'req-a45bc983-134a-441a-9894-150d9a32971e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:11.603629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] The token cache is being invalidate because project c3eca6aadaa848a498c9226d1c83be2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:24:11.605362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:11.611081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a45bc983-134a-441a-9894-150d9a32971e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:11.623175 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3364/6719] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:24:11 2022] DELETE /identity/v3/projects/c3eca6aadaa848a498c9226d1c83be2b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:11.625083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:11.625591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:11.625683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:11.665350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:11.668823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:11.820355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3356/6720] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:11.832589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:11.832942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:11.833182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:11.889631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:11.891094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:11.900528 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3365/6721] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:11.905111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:11.916521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0859d1-4abe-4280-98ae-bca43d8b7ef7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:11.924264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:11.925212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:11.925656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:11.926122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:11.927093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:24:11.927564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:11.929718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:11.954865 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3357/6722] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:24:11.960887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:11.988248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a8140-236b-452e-8f35-2c8500b42108 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:12.014369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:12.015887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.016344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.016625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.018827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:12.021598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:12.202134 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3366/6723] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:11 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:12.206490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:12.219140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70e66d-a2e7-4783-bd1b-77e78159992e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:12.272165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:12.282069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:12.282699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.282980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.283258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.284083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:12.286125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:12.405752 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3358/6724] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:12 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:24:12.406162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:12.430525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb54b4-4ea2-44a7-a30f-4294dca1bbba admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:12.437160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:12.437769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.438207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.438349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.439179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:12.441042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:12.454000 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3367/6725] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:12.458385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:12.473045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c93b-6857-4668-acbf-16015bbce0eb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:12.477028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65262007-fc27-4342-b152-dbb267bfd31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:12.477764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262007-fc27-4342-b152-dbb267bfd31a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.478149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262007-fc27-4342-b152-dbb267bfd31a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.478500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262007-fc27-4342-b152-dbb267bfd31a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.479228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65262007-fc27-4342-b152-dbb267bfd31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:12.480984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65262007-fc27-4342-b152-dbb267bfd31a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:12.502749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:12.504537 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3359/6726] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:24:12.516620 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244d0f-bc76-494b-8ebb-afe595147ea8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:12.521688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:12.522504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.522853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.523200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] PATH_INFO: `/v3/projects/693ced18e2794bd5abe2110d87ba128f/users/46645ce79a674b29bc7b0805f553726f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.541582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=693ced18e2794bd5abe2110d87ba128f, user_id=46645ce79a674b29bc7b0805f553726f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:12.544526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:12.635631 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3368/6727] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:12 2022] PUT /identity/v3/projects/693ced18e2794bd5abe2110d87ba128f/users/46645ce79a674b29bc7b0805f553726f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:12.647910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844395-c601-4ebc-959e-926582633d64 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.649191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844395-c601-4ebc-959e-926582633d64 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.649711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844395-c601-4ebc-959e-926582633d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.694171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b9844395-c601-4ebc-959e-926582633d64 None None] MFA Rules not processed for user `46645ce79a674b29bc7b0805f553726f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:12.696114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b9844395-c601-4ebc-959e-926582633d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:12.785167 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3360/6728] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:12.790239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:12.833520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:12.921990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c685c-d72e-4bfc-87e8-fe359cf41dcf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:12.930409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:12.931349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:12.931712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:12.932305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:12.933096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:12.935529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:13.137485 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3369/6729] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:12 2022] POST /identity/v3/projects => generated 375 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:13.139740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9844395-c601-4ebc-959e-926582633d64 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:13.163636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9844395-c601-4ebc-959e-926582633d64 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:13.370656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:13.371782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:13.372529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:13.373077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:13.374248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:13.382449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:13.535607 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3361/6730] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:13 2022] POST /identity/v3/users => generated 294 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:13.539571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:13.556347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33173-cc3f-452b-b838-6c9cc8162e8e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:13.568741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:13.569298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:13.569579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:13.569881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:13.570546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:13.572257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:13.599401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3370/6731] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:24:13.603057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:13.615691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b33b-ba2c-4f32-a0ec-3b07a1f3c42e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:13.622363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:13.624856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:13.625396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:13.625963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] PATH_INFO: `/v3/projects/157fb9442d1d44748f04d2183046fd3c/users/52d9d892f5cb4bc0b12ed0eead1123fa/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:13.653975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157fb9442d1d44748f04d2183046fd3c, user_id=52d9d892f5cb4bc0b12ed0eead1123fa, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:13.659669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:13.735890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3362/6732] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:13 2022] PUT /identity/v3/projects/157fb9442d1d44748f04d2183046fd3c/users/52d9d892f5cb4bc0b12ed0eead1123fa/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:13.740629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:13.753435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2999c-844c-45ae-8103-7000adc1b6b3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:13.835254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ea1b-9398-460c-9e4a-b001b35d5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:13.835878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ea1b-9398-460c-9e4a-b001b35d5587 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:13.836174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ea1b-9398-460c-9e4a-b001b35d5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:13.836461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ea1b-9398-460c-9e4a-b001b35d5587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:13.837240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ea1b-9398-460c-9e4a-b001b35d5587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:13.839105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ea1b-9398-460c-9e4a-b001b35d5587 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:13.851519 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3371/6733] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:13.856666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:13.880899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660d37-21e8-42fb-8e1b-5df2570c2584 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:13.909809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:13.910539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:13.910823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:13.911103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] PATH_INFO: `/v3/projects/157fb9442d1d44748f04d2183046fd3c/users/52d9d892f5cb4bc0b12ed0eead1123fa/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:13.913280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157fb9442d1d44748f04d2183046fd3c, user_id=52d9d892f5cb4bc0b12ed0eead1123fa, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:13.916007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:13.940385 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3363/6734] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:13 2022] PUT /identity/v3/projects/157fb9442d1d44748f04d2183046fd3c/users/52d9d892f5cb4bc0b12ed0eead1123fa/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:13.950913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:13.951206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:13.952338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:13.992591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] MFA Rules not processed for user `52d9d892f5cb4bc0b12ed0eead1123fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:13.994576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:14.121413 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3372/6735] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:24:14.137760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:14.137760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:14.167164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:14.244974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc15d-6124-48ea-a174-886a5da405c5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:14.249156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:14.249795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:14.250128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:14.250898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:14.370791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:14.372781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:14.386987 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3364/6736] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:14.702181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:14.705533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:14.836409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7b00-6ee1-441b-aab9-26e2fb280fb7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:14.844018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:14.844775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:14.845125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:14.845449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:14.849435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:14.957470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:14.960941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d066f3-9f34-4e73-aa2a-826c3dfe1cb3 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:14.979539 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3373/6737] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:15.187413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:17.647448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:17.648696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:17.924454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb6d3b-c8db-4138-a92e-10a05ca33a14 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:17.970693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:17.971330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:17.971575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:17.971861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] PATH_INFO: `/v3/users/13278f571d144bfbab6da42ec980f525` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:17.984183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=13278f571d144bfbab6da42ec980f525)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:17.994743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:18.300965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:18.301457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:18.301572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:18.349630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13278f571d144bfbab6da42ec980f525'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:18.349630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13278f571d144bfbab6da42ec980f525'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:18.379757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] MFA Rules not processed for user `eab435220eb1424985b28ec0642ef70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:18.380748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:18.468321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13278f571d144bfbab6da42ec980f525'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:18.481824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13278f571d144bfbab6da42ec980f525'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:18.482740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb37c21d-e3f6-4455-937e-428f181e10fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13278f571d144bfbab6da42ec980f525'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:18.501282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3374/6738] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:24:18.502287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:18.524383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:18.527697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:18.565819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3365/6739] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:17 2022] DELETE /identity/v3/users/13278f571d144bfbab6da42ec980f525 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:18.571396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffe8ae-1f52-4b48-8590-cc0709e2dff2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:18.573073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:18.573992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:18.574853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:18.637599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:18.645452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:18.648212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:18.712133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:18.712961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:18.715095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:18.715487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:18.720394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:18.798332 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3366/6740] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:18.818068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:18.820335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:18.845274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:18.848324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:18.864274 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3375/6741] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:18.944776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b55bf-bc15-4917-bdad-44d52150c52a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:18.957467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:18.958462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:18.959025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:18.959375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:18.974432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:18.977791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:18.994284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3367/6742] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:19.822379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:19.824482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:19.989386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9805-119f-4ee4-8b70-67ce1a18b850 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:19.994232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:19.995715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:19.997080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:19.997689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:20.005928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:20.121971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:20.124554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:20.133955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:20.136529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:20.148660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dacb29-c9ba-4009-a648-1ef88db35efe service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:20.163786 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3376/6743] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:20.169188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:20.169188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:20.169188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:20.169188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] PATH_INFO: `/v3/projects/2e37c39686bc414fbed83af71809cc32` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:20.172429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e37c39686bc414fbed83af71809cc32)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:20.189000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:20.396181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e37c39686bc414fbed83af71809cc32', 'request_id': 'req-6fbb89a7-f177-483a-82d3-a0bf91327a10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:20.412382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e37c39686bc414fbed83af71809cc32', 'request_id': 'req-6fbb89a7-f177-483a-82d3-a0bf91327a10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:20.429961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e37c39686bc414fbed83af71809cc32', 'request_id': 'req-6fbb89a7-f177-483a-82d3-a0bf91327a10'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:20.475951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:20.497091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983618-08cf-44bc-9100-1ca4a74734a0 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:20.550537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:20.603418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:20.604047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:20.604326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:20.604622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:20.606977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:20.628190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] The token cache is being invalidate because project 2e37c39686bc414fbed83af71809cc32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:24:20.628492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:20.630071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:20.638198 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3368/6744] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:24:20 2022] DELETE /identity/v3/projects/2e37c39686bc414fbed83af71809cc32 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:20.639724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:20.643202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:20.740510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:20.743165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:20.759334 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3377/6745] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:20.799995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb89a7-f177-483a-82d3-a0bf91327a10 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:20.805549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:20.809591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:20.809591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:20.809591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] PATH_INFO: `/v3/users/1a00f45dc6774dbc958583cd9c030a63` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:20.810231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a00f45dc6774dbc958583cd9c030a63)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:20.813220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:21.193699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a00f45dc6774dbc958583cd9c030a63'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:21.199548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a00f45dc6774dbc958583cd9c030a63'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:21.347798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a00f45dc6774dbc958583cd9c030a63'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:21.366483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a00f45dc6774dbc958583cd9c030a63'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:21.368430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1b5bb5ea-041b-4dff-8d6a-e165592d2b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a00f45dc6774dbc958583cd9c030a63'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:21.432103 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3369/6746] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:20 2022] DELETE /identity/v3/users/1a00f45dc6774dbc958583cd9c030a63 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:21.750323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:23.351463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:23.378515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffeb84-0697-4dff-837b-4a7d41960a6f service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:23.568455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:23.569274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:23.569734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:23.570043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] PATH_INFO: `/v3/projects/c1e72a676f1742709c7f47b23bf0ffea` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:23.571668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e72a676f1742709c7f47b23bf0ffea)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:23.574314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:23.781790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e72a676f1742709c7f47b23bf0ffea', 'request_id': 'req-c2b89399-70a1-4ccf-a28d-616789fe7195'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:23.793452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e72a676f1742709c7f47b23bf0ffea', 'request_id': 'req-c2b89399-70a1-4ccf-a28d-616789fe7195'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:23.801557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e72a676f1742709c7f47b23bf0ffea', 'request_id': 'req-c2b89399-70a1-4ccf-a28d-616789fe7195'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:23.975440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:23.981900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] The token cache is being invalidate because project c1e72a676f1742709c7f47b23bf0ffea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:24:23.981900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:23.984370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c2b89399-70a1-4ccf-a28d-616789fe7195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:23.987009 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3378/6747] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:24:23 2022] DELETE /identity/v3/projects/c1e72a676f1742709c7f47b23bf0ffea => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:23.992667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:23.993447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:23.993447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:24.039923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:24.043680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:24.201911 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3370/6748] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:24.205654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:24.208852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:24.212358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:24.238504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:24.240872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:24.255816 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3379/6749] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:24.256702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:24.268023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224b497-2e8d-4983-a94a-263b56b56f0a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:24.274171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:24.275067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:24.275512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:24.275965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:24.277396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:24:24.278112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:24.283106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:24.305410 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3371/6750] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:24:24.310335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:24.324363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a07d7-c047-4155-8742-4a3403f2360a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:24.331023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:24.332804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:24.333499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:24.334456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:24.336189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:24.340831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:24.534799 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3380/6751] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:24 2022] POST /identity/v3/projects => generated 363 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:24.539288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:24.559211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d080321-8147-45c8-9c20-5eb410699d36 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:24.749001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:24.754495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:24.754495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:24.754495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:24.757230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:24.760817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:24.917947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3372/6752] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:24 2022] POST /identity/v3/users => generated 282 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:24.922660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:24.959764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960289a-dc7c-4d6a-8f7c-2b388a40fe5a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:24.966761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:24.968318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:24.969007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:24.969701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:24.970604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:24.974002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:25.002452 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3381/6753] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:25.007722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:25.035469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131da41-e9dc-4ae2-83ab-5e85de12c4d1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:25.043773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f1673-8bf3-4c8d-a625-b978770e5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:25.046309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1673-8bf3-4c8d-a625-b978770e5f34 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:25.046956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1673-8bf3-4c8d-a625-b978770e5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:25.047665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1673-8bf3-4c8d-a625-b978770e5f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:25.049911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f1673-8bf3-4c8d-a625-b978770e5f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:25.054669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f1673-8bf3-4c8d-a625-b978770e5f34 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:25.082625 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3373/6754] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:25.090535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:25.106583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed963278-c6d0-44a5-8f7a-d268441c7a76 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:25.128287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:25.129403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:25.129562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:25.129911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] PATH_INFO: `/v3/projects/51885d2d1b524c53b50f825e708e9a7d/users/5fe98e3a94b14145ad40f0ffe949e190/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:25.149035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51885d2d1b524c53b50f825e708e9a7d, user_id=5fe98e3a94b14145ad40f0ffe949e190, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:25.152199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:25.274785 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3382/6755] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:25 2022] PUT /identity/v3/projects/51885d2d1b524c53b50f825e708e9a7d/users/5fe98e3a94b14145ad40f0ffe949e190/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:25.286292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:25.286472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:25.286706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:25.332609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] MFA Rules not processed for user `5fe98e3a94b14145ad40f0ffe949e190`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:25.334216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:25.445767 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3374/6756] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:25.450674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:25.594575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cbc3e-244e-4969-91c5-6a7ed35dfa85 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:25.602319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae67171-8387-4222-b904-aab041d19348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:25.603057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67171-8387-4222-b904-aab041d19348 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:25.603693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67171-8387-4222-b904-aab041d19348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:25.603828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67171-8387-4222-b904-aab041d19348 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:25.604639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae67171-8387-4222-b904-aab041d19348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:25.607392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae67171-8387-4222-b904-aab041d19348 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:25.753503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3383/6757] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:25 2022] POST /identity/v3/projects => generated 365 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:25.755213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:25.772544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febec7f-858c-40ea-9442-9a55c7707a25 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:25.785133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:25.785527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:25.785824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:25.823962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] MFA Rules not processed for user `eab435220eb1424985b28ec0642ef70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:25.825320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:25.874204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:25.874204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:25.874204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:25.874204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:25.874718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:25.876510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:25.949046 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3384/6758] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:26.084629 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3375/6759] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:25 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:26.089413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:26.108852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843cf4-81f2-42dd-a9e0-5c7f3e39af45 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:26.118236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:26.118761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:26.120033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:26.120033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:26.120433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:26.127610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:26.185107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3385/6760] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:26.195004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:26.209963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e617e-8d3b-46bb-8d3a-32ba60f2bb06 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:26.219062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:26.219062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:26.219062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:26.219062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] PATH_INFO: `/v3/projects/1141a6c713024f28b49fdf4e326cebed/users/acaf19f453044ed3bc1fe4a0001e7677/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:26.241619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1141a6c713024f28b49fdf4e326cebed, user_id=acaf19f453044ed3bc1fe4a0001e7677, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:26.245429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:26.406714 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3376/6761] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:26 2022] PUT /identity/v3/projects/1141a6c713024f28b49fdf4e326cebed/users/acaf19f453044ed3bc1fe4a0001e7677/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:26.411421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:26.447252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae277be1-1a40-4b36-87b4-1a96c1106351 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:26.500813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:26.611193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b8eb7-74ae-4ece-92f4-2cb000e69c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:26.615160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8eb7-74ae-4ece-92f4-2cb000e69c76 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:26.616403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8eb7-74ae-4ece-92f4-2cb000e69c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:26.617328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8eb7-74ae-4ece-92f4-2cb000e69c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:26.619494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b8eb7-74ae-4ece-92f4-2cb000e69c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:26.622292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b8eb7-74ae-4ece-92f4-2cb000e69c76 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:26.652992 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3386/6762] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:26.662119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:26.675801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2c55-bddd-4821-8b20-bbd4e00200ae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:26.681802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:26.682543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:26.682828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:26.683268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] PATH_INFO: `/v3/projects/1141a6c713024f28b49fdf4e326cebed/users/acaf19f453044ed3bc1fe4a0001e7677/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:26.687161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1141a6c713024f28b49fdf4e326cebed, user_id=acaf19f453044ed3bc1fe4a0001e7677, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:26.690228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:26.705486 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3377/6763] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:26 2022] PUT /identity/v3/projects/1141a6c713024f28b49fdf4e326cebed/users/acaf19f453044ed3bc1fe4a0001e7677/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:26.716822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:26.717116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:26.717396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:26.758330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] MFA Rules not processed for user `acaf19f453044ed3bc1fe4a0001e7677`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:26.759761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:26.940061 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3387/6764] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:26.954372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:26.961766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:27.084578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a70fb-3705-461f-b27c-d48c06d1ab4c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:27.089487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:27.090330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:27.090715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:27.091099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:27.106257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:27.106257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:27.119300 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3378/6765] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:27.448118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:27.472494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416e57-95f1-487d-8e10-159a8c068142 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:27.487340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb0f2-b5be-4a8b-972c-75af78f49480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:27.488431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb0f2-b5be-4a8b-972c-75af78f49480 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:27.488936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb0f2-b5be-4a8b-972c-75af78f49480 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:27.489431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb0f2-b5be-4a8b-972c-75af78f49480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:27.546426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:27.615055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fb0f2-b5be-4a8b-972c-75af78f49480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:27.618221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fb0f2-b5be-4a8b-972c-75af78f49480 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:27.649482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3388/6766] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:29.212534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:32.249242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:32.449649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d6093-7ac1-4848-9a48-20feeacd4fc0 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:32.465284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:32.466234 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:32.466788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:32.468628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] PATH_INFO: `/v3/users/5fe98e3a94b14145ad40f0ffe949e190` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:32.488803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe98e3a94b14145ad40f0ffe949e190)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:32.488803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:33.070191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe98e3a94b14145ad40f0ffe949e190'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:33.072176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe98e3a94b14145ad40f0ffe949e190'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:33.161666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe98e3a94b14145ad40f0ffe949e190'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:33.172199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe98e3a94b14145ad40f0ffe949e190'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:33.173814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe98e3a94b14145ad40f0ffe949e190'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:33.235762 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3379/6767] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:32 2022] DELETE /identity/v3/users/5fe98e3a94b14145ad40f0ffe949e190 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:24:33.241713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:33.242684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:33.243120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:33.276660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:33.278211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:33.356973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:33.426727 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3389/6768] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:33.459812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:33.462489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:33.475683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:33.592146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002860d7-5717-4982-94aa-d6f71f044093 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:33.600452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:33.601943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:33.602452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:33.603144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:33.620965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:33.623618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:33.641380 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3380/6769] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:34.717569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:34.721128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:34.920327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7c291-4996-4ad6-ac60-d5d33c516ff8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:34.931159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:34.934665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:34.936078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:34.936578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:34.941999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:34.995236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:35.000149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:35.058782 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3390/6770] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:35.240328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:35.241824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:35.262962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95d50f-ef16-45a9-8b1e-f17e99af6c4b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:35.269827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:35.270695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:35.271145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:35.271562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] PATH_INFO: `/v3/projects/51885d2d1b524c53b50f825e708e9a7d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:35.273458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51885d2d1b524c53b50f825e708e9a7d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:35.275822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:35.456206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51885d2d1b524c53b50f825e708e9a7d', 'request_id': 'req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:35.467196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51885d2d1b524c53b50f825e708e9a7d', 'request_id': 'req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:35.485103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51885d2d1b524c53b50f825e708e9a7d', 'request_id': 'req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:35.622007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] The token cache is being invalidate because project 51885d2d1b524c53b50f825e708e9a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:24:35.622468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:35.624389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:35.644803 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3381/6771] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:24:35 2022] DELETE /identity/v3/projects/51885d2d1b524c53b50f825e708e9a7d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:35.645224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:35.650657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a238548-339d-4ae6-a88c-a41d033fd7e4 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:35.756110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:35.759460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:35.759460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:35.759460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] PATH_INFO: `/v3/users/acaf19f453044ed3bc1fe4a0001e7677` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:35.759917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acaf19f453044ed3bc1fe4a0001e7677)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:35.762143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:36.403570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acaf19f453044ed3bc1fe4a0001e7677'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:36.435336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:36.437055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acaf19f453044ed3bc1fe4a0001e7677'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:36.455665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acaf19f453044ed3bc1fe4a0001e7677'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:36.456910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acaf19f453044ed3bc1fe4a0001e7677'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:36.458129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da6dd0bc-ba40-4350-ba70-dc7f8b3329b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acaf19f453044ed3bc1fe4a0001e7677'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:36.627973 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3391/6772] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:35 2022] DELETE /identity/v3/users/acaf19f453044ed3bc1fe4a0001e7677 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:36.998331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:37.000809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:37.004037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:37.004538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:37.004652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:37.050991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] MFA Rules not processed for user `46645ce79a674b29bc7b0805f553726f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:37.053168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:37.155900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cbf72-c599-46c9-9b0d-3f153da1ffb7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:37.175533 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3392/6773] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:37.195380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:37.290177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:37.292802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:37.294294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:37.296285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:37.302117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:37.363453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:37.365366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3130e86-964b-43fd-b141-3ebfcbe41c5a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:37.401713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3382/6774] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:37.863346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:37.864841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:38.021154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b2c8c-283b-41d2-ae79-fa9884f8675e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:38.027935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:38.028605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:38.029457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:38.030261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] PATH_INFO: `/v3/projects/1141a6c713024f28b49fdf4e326cebed` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:38.031951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1141a6c713024f28b49fdf4e326cebed)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:38.040038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:38.329569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1141a6c713024f28b49fdf4e326cebed', 'request_id': 'req-02379507-a001-441b-976c-7412f3f01e40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:38.406563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1141a6c713024f28b49fdf4e326cebed', 'request_id': 'req-02379507-a001-441b-976c-7412f3f01e40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:38.438536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1141a6c713024f28b49fdf4e326cebed', 'request_id': 'req-02379507-a001-441b-976c-7412f3f01e40'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:38.548345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] The token cache is being invalidate because project 1141a6c713024f28b49fdf4e326cebed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:24:38.548649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:38.552271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-02379507-a001-441b-976c-7412f3f01e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:38.557680 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3393/6775] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:24:37 2022] DELETE /identity/v3/projects/1141a6c713024f28b49fdf4e326cebed => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:38.559578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:38.561255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:38.561696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:38.587552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:38.589066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:38.700160 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3383/6776] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:38.710571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:38.710860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:38.711149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:38.748739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:38.755752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:38.771138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:38.779322 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3394/6777] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:38.783960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041f72c-f44c-4c16-ac26-ce373f940580 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:38.795664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:38.797032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:38.797631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:38.798231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:38.799632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:24:38.800496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:38.803854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:38.846393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:38.853530 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3384/6778] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:24:38.859831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259fec2-7666-4f08-b217-f56c53b64905 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:38.866029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:38.868807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:38.868807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:38.868807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:38.869945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:38.874043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:38.899922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:39.020086 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3395/6779] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:38 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:39.029360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:39.053272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400480c-d96b-4b6f-9023-683bbd1bcac2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:39.147307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:39.147884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.148251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.148532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:39.149209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:39.151763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:39.285646 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3385/6780] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:39 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:39.291496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:39.305655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e85a0-85e6-4479-bb8a-74c7f5a9700a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:39.313885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:39.314725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.315144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.315590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:39.316419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:39.318545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:39.339845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3396/6781] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:24:39.341802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:39.361019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed004ef-412f-4770-a14e-29d84621cc2c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:39.386299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b804e-c02c-4efe-95d2-c34edd3710c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:39.387021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b804e-c02c-4efe-95d2-c34edd3710c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.387309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b804e-c02c-4efe-95d2-c34edd3710c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.387697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b804e-c02c-4efe-95d2-c34edd3710c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:39.389138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b804e-c02c-4efe-95d2-c34edd3710c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:39.394966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b804e-c02c-4efe-95d2-c34edd3710c8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:39.413981 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3386/6782] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:39.416111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:39.437603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba37d1-4688-448f-b19d-d3a093b049c7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:39.450456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:39.453625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.454159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.454583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] PATH_INFO: `/v3/projects/7bc3470ec7e84679b9e9497ef7610fe1/users/e77d15ef1b26483282d44cafb3d1a0bc/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:39.489517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc3470ec7e84679b9e9497ef7610fe1, user_id=e77d15ef1b26483282d44cafb3d1a0bc, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:39.492343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:39.620752 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3397/6783] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:39 2022] PUT /identity/v3/projects/7bc3470ec7e84679b9e9497ef7610fe1/users/e77d15ef1b26483282d44cafb3d1a0bc/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:39.632658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.633252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.633252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:39.670763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] MFA Rules not processed for user `e77d15ef1b26483282d44cafb3d1a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:39.672101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:39.852323 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3387/6784] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:39.858512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:39.979517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8914c3-e079-4c2d-aff6-f79aa59a5781 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:39.985511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:39.986215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.986533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.986808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:39.988482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:39.990488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:40.177470 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3398/6785] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:24:39 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:40.179320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:40.199338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de48e-6367-45e5-8ccc-8d20002eb778 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:40.295593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:40.296131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:40.296485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:40.296762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.297417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:40.299660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:40.436506 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3388/6786] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:24:40 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:24:40.441653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:40.469776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101b5f-2eba-4d79-9383-3c559e1f392b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:40.487914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:40.488707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:40.488851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:40.489369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.490289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:40.492113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:40.510889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:40.520472 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3399/6787] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:24:40.523021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d099-4c46-46cd-9729-efac6b07606d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:40.530223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:40.530981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:40.531266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:40.531545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] PATH_INFO: `/v3/projects/d99743e2e32747cdad3730c1099ee1b4/users/9367f48ed53f42e9a8d64648e8901a8b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.549977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99743e2e32747cdad3730c1099ee1b4, user_id=9367f48ed53f42e9a8d64648e8901a8b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:40.552910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:40.648142 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3389/6788] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:40 2022] PUT /identity/v3/projects/d99743e2e32747cdad3730c1099ee1b4/users/9367f48ed53f42e9a8d64648e8901a8b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:40.652715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:40.664143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc03221-f425-4d91-b29d-1db10599de18 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:40.728445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693f62-1dcb-4334-9a0b-6db14eacfb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:40.729160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693f62-1dcb-4334-9a0b-6db14eacfb3e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:40.729496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693f62-1dcb-4334-9a0b-6db14eacfb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:40.730313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693f62-1dcb-4334-9a0b-6db14eacfb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.730699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693f62-1dcb-4334-9a0b-6db14eacfb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:40.732908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693f62-1dcb-4334-9a0b-6db14eacfb3e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:40.745305 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3400/6789] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:24:40.750383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:40.764082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3561-cb58-4cc7-8131-f8be931f90f8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:40.768708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:40.769679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:40.770077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:40.770438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] PATH_INFO: `/v3/projects/d99743e2e32747cdad3730c1099ee1b4/users/9367f48ed53f42e9a8d64648e8901a8b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.772590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99743e2e32747cdad3730c1099ee1b4, user_id=9367f48ed53f42e9a8d64648e8901a8b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:40.775698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:40.788559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3390/6790] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:24:40 2022] PUT /identity/v3/projects/d99743e2e32747cdad3730c1099ee1b4/users/9367f48ed53f42e9a8d64648e8901a8b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:40.802815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:40.803653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:40.804281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.852810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] MFA Rules not processed for user `9367f48ed53f42e9a8d64648e8901a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:40.854307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:40.954389 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3401/6791] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:40.969597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:40.969597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:40.971261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:41.099739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3447-f13c-4018-b104-761030bdf84d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:41.105080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dd2b7-9e52-4b8c-b83f-f2829d7260b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:41.106433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd2b7-9e52-4b8c-b83f-f2829d7260b3 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:41.107599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd2b7-9e52-4b8c-b83f-f2829d7260b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:41.108152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd2b7-9e52-4b8c-b83f-f2829d7260b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:41.205473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dd2b7-9e52-4b8c-b83f-f2829d7260b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:41.207275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dd2b7-9e52-4b8c-b83f-f2829d7260b3 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:41.226645 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3391/6792] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:43.024484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:43.828032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:44.426532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:44.469921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f149e-c8d6-4fde-b43f-d87a3ab39417 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:44.496250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189579-6327-4bea-9828-134f38d381da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:44.496969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189579-6327-4bea-9828-134f38d381da service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:44.497256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189579-6327-4bea-9828-134f38d381da service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:44.500014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189579-6327-4bea-9828-134f38d381da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:44.526805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189579-6327-4bea-9828-134f38d381da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:44.527721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189579-6327-4bea-9828-134f38d381da service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:44.555930 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3402/6793] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:24:46.107916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612bb07-256c-470c-b5fb-433ee011b1e1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:46.108983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612bb07-256c-470c-b5fb-433ee011b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:46.109601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612bb07-256c-470c-b5fb-433ee011b1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:46.158285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3612bb07-256c-470c-b5fb-433ee011b1e1 None None] MFA Rules not processed for user `ed9ff24f139b4ff59e3659b0dcc4a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:46.163680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3612bb07-256c-470c-b5fb-433ee011b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:46.313202 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3392/6794] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:56.062260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=30 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:56.438635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=46 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:58.968929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189579-6327-4bea-9828-134f38d381da service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:59.053810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189579-6327-4bea-9828-134f38d381da service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:59.067757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:59.080358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:59.080358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:59.080358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] PATH_INFO: `/v3/users/e77d15ef1b26483282d44cafb3d1a0bc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:59.080358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77d15ef1b26483282d44cafb3d1a0bc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:59.080358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:59.373256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77d15ef1b26483282d44cafb3d1a0bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:59.409118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77d15ef1b26483282d44cafb3d1a0bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:59.429687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77d15ef1b26483282d44cafb3d1a0bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:59.431556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77d15ef1b26483282d44cafb3d1a0bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:59.432931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77d15ef1b26483282d44cafb3d1a0bc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:24:59.570321 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3403/6795] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:24:58 2022] DELETE /identity/v3/users/e77d15ef1b26483282d44cafb3d1a0bc => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:24:59.574707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:59.576252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:59.576694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:59.599458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:59.603055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:59.766733 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3393/6796] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:59.786658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:59.786658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:59.867542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd7fbc-e09f-4293-8e9b-dc189a4cb550 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:59.872879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:59.876292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:59.876853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:59.877292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:59.892952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:59.895055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:59.924118 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3404/6797] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:00.879061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:00.880537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:00.900049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa26a7-7861-4d0e-8b64-f9356432f802 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:00.915964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:00.916937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:00.917479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:00.918010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] PATH_INFO: `/v3/projects/7bc3470ec7e84679b9e9497ef7610fe1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:00.923480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc3470ec7e84679b9e9497ef7610fe1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:00.925790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:01.120274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc3470ec7e84679b9e9497ef7610fe1', 'request_id': 'req-df305402-7f0b-446f-be74-b29b6d16db57'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.131389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc3470ec7e84679b9e9497ef7610fe1', 'request_id': 'req-df305402-7f0b-446f-be74-b29b6d16db57'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.138246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc3470ec7e84679b9e9497ef7610fe1', 'request_id': 'req-df305402-7f0b-446f-be74-b29b6d16db57'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.266143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] The token cache is being invalidate because project 7bc3470ec7e84679b9e9497ef7610fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:01.268588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.268588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.269564 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3394/6798] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:00 2022] DELETE /identity/v3/projects/7bc3470ec7e84679b9e9497ef7610fe1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:01.274461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:01.290999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c8f75-68d5-4973-99e8-32dc2aafd530 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:01.317132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:01.380699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:01.381370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:01.381628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:01.381964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] PATH_INFO: `/v3/users/9367f48ed53f42e9a8d64648e8901a8b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:01.383491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9367f48ed53f42e9a8d64648e8901a8b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:01.385690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:01.650605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9367f48ed53f42e9a8d64648e8901a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.665624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9367f48ed53f42e9a8d64648e8901a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.681687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9367f48ed53f42e9a8d64648e8901a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.682846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9367f48ed53f42e9a8d64648e8901a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.688689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ac16b227-91c8-41d5-b18a-ba4b98be355c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9367f48ed53f42e9a8d64648e8901a8b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:01.834115 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3405/6799] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:01 2022] DELETE /identity/v3/users/9367f48ed53f42e9a8d64648e8901a8b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:02.488134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:02.490013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:02.505913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305402-7f0b-446f-be74-b29b6d16db57 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:02.582054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:02.582692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:02.582978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:02.583253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] PATH_INFO: `/v3/projects/d99743e2e32747cdad3730c1099ee1b4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:02.584399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99743e2e32747cdad3730c1099ee1b4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:02.586572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:02.740042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:02.758891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99743e2e32747cdad3730c1099ee1b4', 'request_id': 'req-a51b4fa2-ff94-4b84-9a76-e637eefea276'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:02.766433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99743e2e32747cdad3730c1099ee1b4', 'request_id': 'req-a51b4fa2-ff94-4b84-9a76-e637eefea276'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:02.777123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99743e2e32747cdad3730c1099ee1b4', 'request_id': 'req-a51b4fa2-ff94-4b84-9a76-e637eefea276'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:02.950504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] The token cache is being invalidate because project d99743e2e32747cdad3730c1099ee1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:02.951057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:02.952164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a51b4fa2-ff94-4b84-9a76-e637eefea276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:02.954245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3395/6800] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:02 2022] DELETE /identity/v3/projects/d99743e2e32747cdad3730c1099ee1b4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:02.959587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:02.960072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:02.960186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:02.984359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:02.985943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:03.069123 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3406/6801] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:25:03.078161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.078445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.078721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.103952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:03.105200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:03.114601 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3396/6802] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:03.119348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:03.135243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af230f-00b7-485d-9ade-728b4ff73b69 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:03.145439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:03.146415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.152885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.152885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.152885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:25:03.152885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:03.152885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:03.168264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3407/6803] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:25:03.172586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:03.184983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e742104-b370-4a7d-bd73-58dcda820aa9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:03.190871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:03.191588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.192403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.192403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.192782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:03.194925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:03.319991 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3397/6804] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:03 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:03.321887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:03.340916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e718-06cb-44ef-a424-57abdfad2359 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:03.425671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:03.426376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.426659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.427925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.427925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:03.430308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:03.573766 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3408/6805] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:03 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:03.582413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:03.591101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae30c2-7d08-408c-befa-f9c1fcd6ac6e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:03.621123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:03.622594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.623277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.624437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.629059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:03.632138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:03.649399 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3398/6806] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:03.653379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:03.664520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90139-0a28-49b1-912f-55022926c641 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:03.673377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b167-fdb5-4dbc-880d-761b6a05e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:03.676358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b167-fdb5-4dbc-880d-761b6a05e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.676358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b167-fdb5-4dbc-880d-761b6a05e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.676358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b167-fdb5-4dbc-880d-761b6a05e0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.676358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b167-fdb5-4dbc-880d-761b6a05e0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:03.677351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b167-fdb5-4dbc-880d-761b6a05e0a3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:03.693905 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3409/6807] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:03.697674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:03.708649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35c3ac-60b2-4c17-9724-53cb36a384fa admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:03.713397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:03.714102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.714375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.714729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] PATH_INFO: `/v3/projects/09d4eef1ed7041539007042c9667af8f/users/7aafe2c9d4ca47999f0119abb47de94c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.731985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d4eef1ed7041539007042c9667af8f, user_id=7aafe2c9d4ca47999f0119abb47de94c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:03.738977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:03.857878 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3399/6808] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:03 2022] PUT /identity/v3/projects/09d4eef1ed7041539007042c9667af8f/users/7aafe2c9d4ca47999f0119abb47de94c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:03.868846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:03.869254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:03.869590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:03.940506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] MFA Rules not processed for user `7aafe2c9d4ca47999f0119abb47de94c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:03.941798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:04.043012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:04.068952 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3410/6809] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:04.074446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:04.174382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a55d3-8568-4bdb-b71f-56a9261bb066 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:04.182158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:04.182807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:04.183088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:04.183363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:04.184004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:04.188454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:04.307613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3400/6810] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:04.313328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:04.332637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f50da5-9aed-49cf-b424-b242139d2a30 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:04.420901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:04.422557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:04.422557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:04.422557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:04.423251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:04.425705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:04.535477 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3411/6811] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:04 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:04.539142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:04.564176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdb5b-e854-481f-b952-465ca9423cee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:04.570687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:04.571786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:04.572174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:04.572459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:04.573128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:04.575613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:04.593613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3401/6812] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:04.602904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:04.618828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973c0a-eb96-4234-8c84-5f0912effa66 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:04.626841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:04.627832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:04.628258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:04.628682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] PATH_INFO: `/v3/projects/985244b247124ff087b6a5599c294c67/users/18829d7f76a842fbbbd60c07fd857d36/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:04.649348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=985244b247124ff087b6a5599c294c67, user_id=18829d7f76a842fbbbd60c07fd857d36, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:04.653751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:04.828769 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3412/6813] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:04 2022] PUT /identity/v3/projects/985244b247124ff087b6a5599c294c67/users/18829d7f76a842fbbbd60c07fd857d36/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:04.834391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:04.852453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8bb80-27cb-428d-a851-efe0c0edcde2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:04.963431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc97fd-655b-441d-a263-456409f9b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:04.964525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc97fd-655b-441d-a263-456409f9b449 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:04.965164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc97fd-655b-441d-a263-456409f9b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:04.966339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc97fd-655b-441d-a263-456409f9b449 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:04.967377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc97fd-655b-441d-a263-456409f9b449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:04.971440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc97fd-655b-441d-a263-456409f9b449 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:05.011719 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3402/6814] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:05.019026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:05.033285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b016-7c4e-490e-803a-2f3fed2c2b6e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:05.041954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:05.042588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:05.043321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:05.044404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] PATH_INFO: `/v3/projects/985244b247124ff087b6a5599c294c67/users/18829d7f76a842fbbbd60c07fd857d36/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:05.046235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985244b247124ff087b6a5599c294c67, user_id=18829d7f76a842fbbbd60c07fd857d36, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:05.049074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:05.063029 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3413/6815] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:05 2022] PUT /identity/v3/projects/985244b247124ff087b6a5599c294c67/users/18829d7f76a842fbbbd60c07fd857d36/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:05.075226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:05.075756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:05.076235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:05.113838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] MFA Rules not processed for user `18829d7f76a842fbbbd60c07fd857d36`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:05.115281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:05.156174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:05.267871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:05.270303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:05.279748 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3403/6816] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:05.360565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b524c1-4bdf-43ed-9368-3087177926e4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:05.365669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:05.366691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:05.367290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:05.367826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:05.441981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:05.443947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:05.467790 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3414/6817] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:25:05.577905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:13.836283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:13.837885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:13.913218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06694ae-cc00-4094-83f5-9529f26cba12 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:13.918610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:13.919255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:13.919539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:13.919822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] PATH_INFO: `/v3/users/f9cc29ea1c8646cb9f5275ecf8f97ab2` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:13.920987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cc29ea1c8646cb9f5275ecf8f97ab2)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:13.922942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:14.181737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cc29ea1c8646cb9f5275ecf8f97ab2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.184325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cc29ea1c8646cb9f5275ecf8f97ab2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.186414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:14.263011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cc29ea1c8646cb9f5275ecf8f97ab2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.271353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cc29ea1c8646cb9f5275ecf8f97ab2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.272118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cc29ea1c8646cb9f5275ecf8f97ab2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.291218 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3404/6818] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:13 2022] DELETE /identity/v3/users/f9cc29ea1c8646cb9f5275ecf8f97ab2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:14.599099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:14.619484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967de51-8d75-4f97-bf50-482a7dc5743f service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:14.673737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:14.675260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:14.693917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:14.693917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:14.693917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:14.693917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] PATH_INFO: `/v3/projects/63e5adc71e1d4a24bc35d650fb5650fa` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:14.695379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e5adc71e1d4a24bc35d650fb5650fa)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:14.704855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:14.749150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eaa10-5193-4b67-99d1-12c0b382e638 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:14.753199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:14.753907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:14.754293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:14.754575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:14.756488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:14.832505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:14.833965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:14.845212 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3405/6819] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:25:14.849264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:14.852486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e5adc71e1d4a24bc35d650fb5650fa', 'request_id': 'req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.858425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e5adc71e1d4a24bc35d650fb5650fa', 'request_id': 'req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.865117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e5adc71e1d4a24bc35d650fb5650fa', 'request_id': 'req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.973219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] The token cache is being invalidate because project 63e5adc71e1d4a24bc35d650fb5650fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:14.973424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.974817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:14.976395 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3415/6820] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:14 2022] DELETE /identity/v3/projects/63e5adc71e1d4a24bc35d650fb5650fa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:14.980509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:14.982138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:14.996402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705a78f-dfc5-4033-8b1a-8e8ffac94834 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:15.056622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:15.057260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:15.057547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:15.057832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] PATH_INFO: `/v3/users/aa19e07e50d14eee8a3b32597d2c6bf7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:15.058998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa19e07e50d14eee8a3b32597d2c6bf7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:15.061609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:15.079452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=1,keystone:DELETE=4,keystone:SELECT=95 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:15.236989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa19e07e50d14eee8a3b32597d2c6bf7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.237598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa19e07e50d14eee8a3b32597d2c6bf7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.308800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa19e07e50d14eee8a3b32597d2c6bf7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.317711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa19e07e50d14eee8a3b32597d2c6bf7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.318431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45a3c521-4583-4d73-b29e-acbab5147468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa19e07e50d14eee8a3b32597d2c6bf7'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.336681 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3406/6821] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:14 2022] DELETE /identity/v3/users/aa19e07e50d14eee8a3b32597d2c6bf7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:25:15.596705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:15.598410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:15.613576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9860c-2231-4b8d-aa38-b16f9e4eddf0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:15.690214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:15.691014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:15.691301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:15.691643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] PATH_INFO: `/v3/projects/9f7b2e0d70914967b0d8caf43937310e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:15.692872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7b2e0d70914967b0d8caf43937310e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:15.694938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:15.852288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7b2e0d70914967b0d8caf43937310e', 'request_id': 'req-9630131e-ab7a-4cef-8855-08173a0d4966'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.859798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7b2e0d70914967b0d8caf43937310e', 'request_id': 'req-9630131e-ab7a-4cef-8855-08173a0d4966'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:15.868079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7b2e0d70914967b0d8caf43937310e', 'request_id': 'req-9630131e-ab7a-4cef-8855-08173a0d4966'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:16.025032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] The token cache is being invalidate because project 9f7b2e0d70914967b0d8caf43937310e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:16.025378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:16.026382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9630131e-ab7a-4cef-8855-08173a0d4966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:16.028640 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3416/6822] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:15 2022] DELETE /identity/v3/projects/9f7b2e0d70914967b0d8caf43937310e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:16.039589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.040155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.040155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.061748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:16.063016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:16.130927 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3407/6823] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:16.139758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.140045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.140324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.167867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:16.169877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:16.178765 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3417/6824] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:16.183218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.194132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992d71-e7bc-4c11-856e-8d8796209762 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:16.201140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:16.201778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.202095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.202378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.205146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:25:16.205479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:16.207232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:16.224157 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3408/6825] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:25:16.225248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.235417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04483-7e47-4260-ac36-f67e46be2c60 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:16.240390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:16.241002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.241314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.241583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.242257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:16.244232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:16.379863 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3418/6826] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:16 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:16.384326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.395738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1bf0-f0e1-48cf-8d0c-101eb04ab3dd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:16.459444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:16.460066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.460454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.460739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.461570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:16.463736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:16.578951 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3409/6827] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:16 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:16.587314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.599895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729643cb-cb06-43cd-9451-8b50e42dfe77 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:16.605330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:16.606098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.606393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.606644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.607488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:16.609115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:16.625033 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3419/6828] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:16.629316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.641438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972ee0f-0c13-4184-86bb-f8d0021525d1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:16.646583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc3aad-2eee-4b6e-a8b6-cff79f4587b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:16.647339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3aad-2eee-4b6e-a8b6-cff79f4587b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.647732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3aad-2eee-4b6e-a8b6-cff79f4587b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.648023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3aad-2eee-4b6e-a8b6-cff79f4587b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.648679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc3aad-2eee-4b6e-a8b6-cff79f4587b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:16.651504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc3aad-2eee-4b6e-a8b6-cff79f4587b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:16.659264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:16.667775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3410/6829] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:16.672989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.683800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67587-7eb9-4daf-a6cb-f52a878458ba admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:16.689487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:16.690251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.690537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.690812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] PATH_INFO: `/v3/projects/66ae9302951844da8fa940ed2004f564/users/5d9667ef4b0a4c2d818da97b935c886d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.709515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ae9302951844da8fa940ed2004f564, user_id=5d9667ef4b0a4c2d818da97b935c886d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:16.712316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:16.796832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:16.802047 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3420/6830] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:16 2022] PUT /identity/v3/projects/66ae9302951844da8fa940ed2004f564/users/5d9667ef4b0a4c2d818da97b935c886d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:25:16.823817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:16.823817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:16.823817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:16.853375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] MFA Rules not processed for user `5d9667ef4b0a4c2d818da97b935c886d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:16.854664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:16.927357 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3411/6831] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:16.940384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:16.942872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:17.014393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24eba9-9dd0-4438-9cea-c888b00c5885 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:17.019492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee5fc-c83f-40a6-bea6-242415e5b8b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:17.020357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee5fc-c83f-40a6-bea6-242415e5b8b1 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:17.020474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee5fc-c83f-40a6-bea6-242415e5b8b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:17.020753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee5fc-c83f-40a6-bea6-242415e5b8b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:17.035039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee5fc-c83f-40a6-bea6-242415e5b8b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:17.036640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee5fc-c83f-40a6-bea6-242415e5b8b1 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:17.050847 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3421/6832] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:17.071319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:17.152270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee65f-ead6-42de-978e-2a11b138a4ad None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:17.158030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:17.158728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:17.159011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:17.159291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] PATH_INFO: `/v3/users/5d9667ef4b0a4c2d818da97b935c886d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:17.160518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9667ef4b0a4c2d818da97b935c886d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:17.162714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:17.380213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9667ef4b0a4c2d818da97b935c886d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:17.380913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9667ef4b0a4c2d818da97b935c886d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:17.474718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9667ef4b0a4c2d818da97b935c886d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:17.482794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9667ef4b0a4c2d818da97b935c886d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:17.483499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9667ef4b0a4c2d818da97b935c886d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:17.506022 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3412/6833] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:17 2022] DELETE /identity/v3/users/5d9667ef4b0a4c2d818da97b935c886d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:17.511050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:17.511340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:17.511618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:17.532723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:17.534010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:17.615872 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3422/6834] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:25:17.626442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:17.627878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:17.669786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:17.705086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98520-e373-4ac5-a4c0-5e42236691c4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:17.709138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a30ce-a420-49d0-a198-4459079e72dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:17.709931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a30ce-a420-49d0-a198-4459079e72dd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:17.710176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a30ce-a420-49d0-a198-4459079e72dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:17.716794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a30ce-a420-49d0-a198-4459079e72dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:17.721865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a30ce-a420-49d0-a198-4459079e72dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:17.723337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a30ce-a420-49d0-a198-4459079e72dd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:17.735022 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3413/6835] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:18.196740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:18.198677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:18.226046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9f284-5fcd-481b-be11-84192eb68f9a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:18.236199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:18.236199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:18.236199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:18.236199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] PATH_INFO: `/v3/projects/66ae9302951844da8fa940ed2004f564` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:18.248971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ae9302951844da8fa940ed2004f564)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:18.256158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:18.427763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ae9302951844da8fa940ed2004f564', 'request_id': 'req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:18.438764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ae9302951844da8fa940ed2004f564', 'request_id': 'req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:18.447155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ae9302951844da8fa940ed2004f564', 'request_id': 'req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:18.583828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] The token cache is being invalidate because project 66ae9302951844da8fa940ed2004f564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:18.584563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:18.585466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f4617350-3d0a-4dae-8be5-a3c0f9d5c6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:18.591584 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3423/6836] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:18 2022] DELETE /identity/v3/projects/66ae9302951844da8fa940ed2004f564 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:18.593296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:18.593740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:18.593938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:18.616929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:18.618106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:18.683867 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3414/6837] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:18.691867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:18.692161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:18.692446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:18.714457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:18.716320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:18.725875 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3424/6838] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:18.730426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:18.745820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fff55-8e50-4fa9-ba83-78f44874d2f2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:18.751362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:18.752808 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:18.753259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:18.753692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:18.754715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:25:18.755308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:18.757369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:18.773505 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3415/6839] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:25:18.782808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:18.793661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e882a-77bf-4851-b797-23d04d2bb4bd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:18.799549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:18.800383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:18.800671 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:18.800970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:18.801618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:18.803599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:18.897863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:18.906793 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3425/6840] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:18 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:18.910327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:18.922344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33872-9189-4abe-b6a1-d5cc8edf8ef0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:18.998330 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:18.999328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:18.999894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.000351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:19.001541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:19.003651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:19.146724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:19.148912 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3416/6841] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:18 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:19.163670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d445-dd9b-4052-ae1b-6659707c302e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:19.171235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:19.172036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:19.172427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.172779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:19.173527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:19.175597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:19.191224 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3426/6842] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:19.195565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:19.207797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bd835-7087-4a06-8943-dfdcb4ccf2ae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:19.213002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c842b1-5130-4057-bc46-51b1df5277a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:19.216461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c842b1-5130-4057-bc46-51b1df5277a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:19.216461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c842b1-5130-4057-bc46-51b1df5277a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.216461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c842b1-5130-4057-bc46-51b1df5277a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:19.216461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c842b1-5130-4057-bc46-51b1df5277a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:19.216461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c842b1-5130-4057-bc46-51b1df5277a7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:19.234716 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3417/6843] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:19.236156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:19.250157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380417c-6f25-470b-9860-2b012eceb1af admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:19.255858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:19.256825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:19.258942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.258942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] PATH_INFO: `/v3/projects/112352edc8804c89b426c06f9b7a62e1/users/dc8c1e324ae441ca90769f1fbdc5accd/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:19.279818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112352edc8804c89b426c06f9b7a62e1, user_id=dc8c1e324ae441ca90769f1fbdc5accd, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:19.282522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:19.385318 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3427/6844] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:19 2022] PUT /identity/v3/projects/112352edc8804c89b426c06f9b7a62e1/users/dc8c1e324ae441ca90769f1fbdc5accd/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:19.407430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:19.407838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.408302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:19.454482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] MFA Rules not processed for user `dc8c1e324ae441ca90769f1fbdc5accd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:19.456181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:19.463880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:19.572152 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3418/6845] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:25:19.572909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:19.708521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bc314-e459-4fb1-b7e8-c4923b3f74e7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:19.733113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:19.733113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:19.733113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.733113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:19.733645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:19.736987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:19.853790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:19.863950 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3428/6846] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:19 2022] POST /identity/v3/projects => generated 381 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:19.880086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d67582-75a0-49a5-8f27-87c75b6c32bc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:19.995117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:19.996829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:19.998901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:19.999312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:20.000680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:20.003814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:20.128651 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3419/6847] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:19 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:20.133176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:20.147487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8de78-be89-4d81-a6a2-5ea9f7efba01 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:20.155084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:20.156043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:20.156565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:20.157011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:20.158090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:20.161408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:20.184167 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3429/6848] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:20.190971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:20.218996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bf77a-e183-498b-a08a-a78bd89dc5e1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:20.236135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aff6c7-7f9d-4dc3-a31a-4e57a65437b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:20.238111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aff6c7-7f9d-4dc3-a31a-4e57a65437b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:20.238111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aff6c7-7f9d-4dc3-a31a-4e57a65437b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:20.238423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aff6c7-7f9d-4dc3-a31a-4e57a65437b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:20.239497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aff6c7-7f9d-4dc3-a31a-4e57a65437b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:20.245504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aff6c7-7f9d-4dc3-a31a-4e57a65437b8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:20.263040 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3420/6849] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:20.270355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:20.283591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306fdc-d672-4b27-81c2-8c1dc96abf00 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:20.288839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:20.289524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:20.289805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:20.290151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] PATH_INFO: `/v3/projects/86cbde14a51b416c9c11fc36f41233a6/users/35e2906e112d418e997b5c1cf78a809f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:20.313333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cbde14a51b416c9c11fc36f41233a6, user_id=35e2906e112d418e997b5c1cf78a809f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:20.316100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:20.437293 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3430/6850] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:20 2022] PUT /identity/v3/projects/86cbde14a51b416c9c11fc36f41233a6/users/35e2906e112d418e997b5c1cf78a809f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:25:20.449270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:20.449578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:20.450000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:20.504404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] MFA Rules not processed for user `35e2906e112d418e997b5c1cf78a809f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:20.505675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:20.606079 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3421/6851] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:25:20.612872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:20.709594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949af1bc-be08-47dd-9391-b14d3bfec214 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:20.715118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:20.715823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:20.716120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:20.722874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:20.722874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:20.722874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:20.906130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:20.917542 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3431/6852] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:20 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:20.921245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:20.940331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fb5a5-7697-4950-bd0f-f963753f8580 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:20.960560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:21.014085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:21.014707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.014999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.015329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.015926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:21.017870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:21.109260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3422/6853] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:20 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:21.113837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:21.127639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea4f5-ea84-4469-b1cd-0addbaa4958e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:21.134482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:21.135381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.135820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.138602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.139421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:21.141913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:21.156046 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3432/6854] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:25:21.160226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:21.174365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df6571-1e5b-40c2-8766-2ebffa0a7dff admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:21.186400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:21.187470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.187915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.188350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] PATH_INFO: `/v3/projects/3aa154db2f974ed6951dbdd2b4426b46/users/aed8ebc610d94ef3973814efbf00eef8/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.209085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa154db2f974ed6951dbdd2b4426b46, user_id=aed8ebc610d94ef3973814efbf00eef8, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:21.212627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:21.298557 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3423/6855] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:21 2022] PUT /identity/v3/projects/3aa154db2f974ed6951dbdd2b4426b46/users/aed8ebc610d94ef3973814efbf00eef8/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:21.303362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:21.318150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6a0e-3f52-4b40-8bad-9c9223efb0d9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:21.449421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01da00e-77ff-4414-98e5-3e7c3db5a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:21.450313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01da00e-77ff-4414-98e5-3e7c3db5a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.450670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01da00e-77ff-4414-98e5-3e7c3db5a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.451048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01da00e-77ff-4414-98e5-3e7c3db5a8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.452120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01da00e-77ff-4414-98e5-3e7c3db5a8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:21.454309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01da00e-77ff-4414-98e5-3e7c3db5a8c4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:21.468699 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3433/6856] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:21.472914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:21.490041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096eb49-5ed5-403d-a176-7c8d9927be25 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:21.496216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:21.497138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.497533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.497998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] PATH_INFO: `/v3/projects/3aa154db2f974ed6951dbdd2b4426b46/users/aed8ebc610d94ef3973814efbf00eef8/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.501007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa154db2f974ed6951dbdd2b4426b46, user_id=aed8ebc610d94ef3973814efbf00eef8, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:21.504250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:21.520393 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3424/6857] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:21 2022] PUT /identity/v3/projects/3aa154db2f974ed6951dbdd2b4426b46/users/aed8ebc610d94ef3973814efbf00eef8/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:25:21.531627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754dec-f433-442f-97fc-763662ead441 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.531975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754dec-f433-442f-97fc-763662ead441 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.532294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754dec-f433-442f-97fc-763662ead441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.574741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4b754dec-f433-442f-97fc-763662ead441 None None] MFA Rules not processed for user `aed8ebc610d94ef3973814efbf00eef8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:21.577297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4b754dec-f433-442f-97fc-763662ead441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:21.686431 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3434/6858] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:21.700905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:21.703703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:21.794428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da76b6-b18c-401e-821b-ec92aa2d7c56 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:21.799860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:21.800818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:21.801210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:21.801558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:21.947422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:21.949181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:21.976823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3425/6859] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:22.255413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:22.255704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:22.255986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:22.281566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] MFA Rules not processed for user `cb0cd81939cf4620b52a7aa4b9882c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:22.283242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:22.390819 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3435/6860] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:23.440906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:23.442437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:23.475237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:23.540743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeeab6-f33f-44d7-8378-571eaf530799 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:23.548672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:23.549595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:23.550073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:23.550507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:23.552545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:23.637690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:23.640185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:23.655095 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3426/6861] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:25.275819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:25.290240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965602d-c666-4059-980e-dd26abc4bb42 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:25.295261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:25.295944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:25.296219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:25.296665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:25.320070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:25.447141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:25.448987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:25.478680 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3436/6862] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:27.887385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:27.901780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7266-c1d2-47b3-ba9c-855eed9956db service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:27.907051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc19d43-6184-4f09-b18b-15ba75ddffde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:27.907994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc19d43-6184-4f09-b18b-15ba75ddffde service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:27.908438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc19d43-6184-4f09-b18b-15ba75ddffde service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:27.908907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc19d43-6184-4f09-b18b-15ba75ddffde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:27.927231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc19d43-6184-4f09-b18b-15ba75ddffde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:27.929939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc19d43-6184-4f09-b18b-15ba75ddffde service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:27.962115 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3427/6863] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:28.597194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:28.599130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:28.696077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87962dd-ea75-4758-80b5-7e893d493092 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:28.703384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:28.704132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:28.704526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:28.704894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] PATH_INFO: `/v3/users/7aafe2c9d4ca47999f0119abb47de94c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:28.706275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aafe2c9d4ca47999f0119abb47de94c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:28.709750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:29.044453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aafe2c9d4ca47999f0119abb47de94c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:29.061322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aafe2c9d4ca47999f0119abb47de94c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:29.071322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aafe2c9d4ca47999f0119abb47de94c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:29.072234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aafe2c9d4ca47999f0119abb47de94c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:29.072973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aafe2c9d4ca47999f0119abb47de94c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:29.223325 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3437/6864] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:28 2022] DELETE /identity/v3/users/7aafe2c9d4ca47999f0119abb47de94c => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:29.227677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:29.228241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:29.228241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:29.272970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:29.275921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:29.385540 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3428/6865] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:29.403503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:29.403503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:29.526043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:29.593269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b5e6-7dbe-49b2-90b1-25154f2d554b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:29.607721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:29.608588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:29.609095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:29.609539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:29.639541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:29.641300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:29.656106 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3438/6866] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:30.517681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:30.519229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:30.549073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7389a1-875e-4d14-95f7-187b0bdc77a8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:30.562503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:30.564058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:30.564721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:30.565316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] PATH_INFO: `/v3/projects/09d4eef1ed7041539007042c9667af8f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:30.568773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d4eef1ed7041539007042c9667af8f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:30.571686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:30.791524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:30.800382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d4eef1ed7041539007042c9667af8f', 'request_id': 'req-2f3b7019-57f1-49b2-b996-58d33ec599e4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:30.810596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d4eef1ed7041539007042c9667af8f', 'request_id': 'req-2f3b7019-57f1-49b2-b996-58d33ec599e4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:30.828169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d4eef1ed7041539007042c9667af8f', 'request_id': 'req-2f3b7019-57f1-49b2-b996-58d33ec599e4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:30.936749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] The token cache is being invalidate because project 09d4eef1ed7041539007042c9667af8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:30.937213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:30.943270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f3b7019-57f1-49b2-b996-58d33ec599e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:30.947397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3429/6867] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:30 2022] DELETE /identity/v3/projects/09d4eef1ed7041539007042c9667af8f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:30.954154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:30.967775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0d05f-272c-481a-aa99-585f46c267c1 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:31.055482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:31.060139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:31.060139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:31.060139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] PATH_INFO: `/v3/users/18829d7f76a842fbbbd60c07fd857d36` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:31.060139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18829d7f76a842fbbbd60c07fd857d36)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:31.060608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:31.354380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18829d7f76a842fbbbd60c07fd857d36'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:31.390759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18829d7f76a842fbbbd60c07fd857d36'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:31.409499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18829d7f76a842fbbbd60c07fd857d36'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:31.411548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18829d7f76a842fbbbd60c07fd857d36'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:31.413037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18829d7f76a842fbbbd60c07fd857d36'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:31.585069 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3439/6868] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:30 2022] DELETE /identity/v3/users/18829d7f76a842fbbbd60c07fd857d36 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:32.416125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:32.416585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:32.416585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:32.440875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:32.442491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:32.583237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:32.585749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:32.613557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:32.647386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5658b4-cc25-4131-bab1-240822333b70 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:32.660329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:32.660994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:32.661273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:32.661548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] PATH_INFO: `/v3/projects/985244b247124ff087b6a5599c294c67` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:32.662979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=985244b247124ff087b6a5599c294c67)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:32.664947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:32.738106 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3430/6869] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:25:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:32.867934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985244b247124ff087b6a5599c294c67', 'request_id': 'req-6e966ef8-8b62-4124-b206-52d0285723ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:32.889466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985244b247124ff087b6a5599c294c67', 'request_id': 'req-6e966ef8-8b62-4124-b206-52d0285723ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:32.906319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985244b247124ff087b6a5599c294c67', 'request_id': 'req-6e966ef8-8b62-4124-b206-52d0285723ac'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:32.959531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:32.961485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:33.059633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] The token cache is being invalidate because project 985244b247124ff087b6a5599c294c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:33.059928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:33.060789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6e966ef8-8b62-4124-b206-52d0285723ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:33.062804 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3440/6870] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:32 2022] DELETE /identity/v3/projects/985244b247124ff087b6a5599c294c67 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:33.069688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706943dd-13b3-494b-9c39-e79be0de81b8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:33.072934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706943dd-13b3-494b-9c39-e79be0de81b8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:33.072934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706943dd-13b3-494b-9c39-e79be0de81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:33.109232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-706943dd-13b3-494b-9c39-e79be0de81b8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:33.111044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-706943dd-13b3-494b-9c39-e79be0de81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:33.140571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30bcd5-6150-47af-98fd-931882f5166e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:33.193149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:33.270360 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3441/6871] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:33.278425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:33.278852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:33.279008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:33.279282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:33.287004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:33.288162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:33.288465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:33.302787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:33.344022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:33.348568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:33.374709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3442/6872] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:33.379786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:33.395268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f7d1f-968a-40da-933e-3c57e30599d4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:33.402312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:33.403238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:33.403623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:33.403999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:33.404775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:25:33.405180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:33.407169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:33.433711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3443/6873] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:25:33.435729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:33.439098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:33.444413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:33.448080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e20989-1817-4189-8ff9-3c02208122e5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:33.454944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:33.456279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:33.456782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:33.457153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:33.458102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:33.460209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:33.466216 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3431/6874] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:25:33.632914 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3444/6875] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:33 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:33.634282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:33.655370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993c9ee-5521-4adb-80b3-535fe2e16b14 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:33.804497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:33.805293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:33.805580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:33.806045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:33.837354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:33.837354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:33.962713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3432/6876] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:33 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:33.967874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:33.987196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917c8b4-a79f-4159-9eab-c84225118a05 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:34.009111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:34.010078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:34.010607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:34.011719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:34.013466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:34.015607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:34.041701 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3445/6877] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:25:34.047509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:34.062058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb74f0-7e49-41e5-8d6e-cd4276ea7454 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:34.093095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de147df8-82b9-4095-8cc6-3d78da71c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:34.094629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147df8-82b9-4095-8cc6-3d78da71c0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:34.095148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147df8-82b9-4095-8cc6-3d78da71c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:34.095777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147df8-82b9-4095-8cc6-3d78da71c0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:34.096846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147df8-82b9-4095-8cc6-3d78da71c0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:34.100698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147df8-82b9-4095-8cc6-3d78da71c0b7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:34.131663 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3433/6878] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:34.134317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:34.164028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e598ae2-ca13-441f-81c7-cff202206fd4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:34.181039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:34.181927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:34.182286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:34.182634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] PATH_INFO: `/v3/projects/e8dfab3e44a74e2cabeb6b1cc28ce06c/users/63bd08c2d0cf48f3a27a0387803d15bb/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:34.225614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dfab3e44a74e2cabeb6b1cc28ce06c, user_id=63bd08c2d0cf48f3a27a0387803d15bb, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:34.228476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:34.329888 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3446/6879] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:34 2022] PUT /identity/v3/projects/e8dfab3e44a74e2cabeb6b1cc28ce06c/users/63bd08c2d0cf48f3a27a0387803d15bb/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:34.346143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:34.346677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:34.347115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:34.454026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] MFA Rules not processed for user `63bd08c2d0cf48f3a27a0387803d15bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:34.462699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:34.529240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:34.557890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3434/6880] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:34.579712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:34.582235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:34.600861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:34.709973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd72d4f-852f-4871-a504-f492d6785d7e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:34.720185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f50e3-5817-46bf-a494-f379e8843062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:34.721987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f50e3-5817-46bf-a494-f379e8843062 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:34.722529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f50e3-5817-46bf-a494-f379e8843062 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:34.722887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f50e3-5817-46bf-a494-f379e8843062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:34.735821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f50e3-5817-46bf-a494-f379e8843062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:34.738054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f50e3-5817-46bf-a494-f379e8843062 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:34.767558 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3447/6881] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:34.806132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:34.986363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c93bb6-f9ba-4a20-9beb-3b0cfdf999fc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:34.999538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:35.003642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:35.003642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:35.003642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] PATH_INFO: `/v3/users/63bd08c2d0cf48f3a27a0387803d15bb` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:35.003642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bd08c2d0cf48f3a27a0387803d15bb)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:35.007699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:35.274793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bd08c2d0cf48f3a27a0387803d15bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:35.276231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bd08c2d0cf48f3a27a0387803d15bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:35.377126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bd08c2d0cf48f3a27a0387803d15bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:35.406190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bd08c2d0cf48f3a27a0387803d15bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:35.409428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bd08c2d0cf48f3a27a0387803d15bb'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:35.460800 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3435/6882] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:34 2022] DELETE /identity/v3/users/63bd08c2d0cf48f3a27a0387803d15bb => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:35.466094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:35.466372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:35.466652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:35.501750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:35.507146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:35.642560 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3448/6883] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:35.653610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:35.659582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:35.833664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50292d-dbc4-4684-b4ef-169d08903efb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:35.837602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817bb55-495b-4e43-b604-532fe061a48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:35.838682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bb55-495b-4e43-b604-532fe061a48a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:35.838965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bb55-495b-4e43-b604-532fe061a48a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:35.839237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bb55-495b-4e43-b604-532fe061a48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:35.860219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817bb55-495b-4e43-b604-532fe061a48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:35.861731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817bb55-495b-4e43-b604-532fe061a48a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:35.877691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3436/6884] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:36.738553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:36.742221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:36.763071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cf569-5901-449f-990a-92ea1da6341c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:36.773701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:36.775680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:36.775680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:36.776300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] PATH_INFO: `/v3/projects/e8dfab3e44a74e2cabeb6b1cc28ce06c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:36.778560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dfab3e44a74e2cabeb6b1cc28ce06c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:36.781049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:36.919338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dfab3e44a74e2cabeb6b1cc28ce06c', 'request_id': 'req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:36.933533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dfab3e44a74e2cabeb6b1cc28ce06c', 'request_id': 'req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:36.951521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dfab3e44a74e2cabeb6b1cc28ce06c', 'request_id': 'req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:37.065599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] The token cache is being invalidate because project e8dfab3e44a74e2cabeb6b1cc28ce06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:37.066526 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:37.067439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2256d58d-b46c-4ddb-a84a-0c22f6119fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:37.074900 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3449/6885] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:36 2022] DELETE /identity/v3/projects/e8dfab3e44a74e2cabeb6b1cc28ce06c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:37.077606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:37.078275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:37.079822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:37.133368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:37.135505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:37.145047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:37.232047 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3437/6886] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:37.239854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:37.240142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:37.241551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:37.271132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:37.272733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:37.343520 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3450/6887] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:37.348501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:37.366844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9c03-31c5-4420-97e1-3b3403668075 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:37.378765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:37.382469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:37.382469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:37.382469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:37.382469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:25:37.382469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:37.385500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:37.412986 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3438/6888] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:25:37.423010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:37.439539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066fdb8-e6b8-461b-b664-1e402a2642e9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:37.464224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:37.474239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:37.474239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:37.474239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:37.474239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:37.474239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:37.668083 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3451/6889] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:37 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:37.672731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:37.684969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317046d-f743-47cb-a265-c6abdb2ad385 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:37.832349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:37.835803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:37.835803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:37.835803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:37.835803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:37.837266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:37.991788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3439/6890] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:37 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:37.993509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:38.003051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:38.041173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53578-70fe-43d0-b2c7-918bd4936fe2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:38.051204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:38.051840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:38.052129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:38.052413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:38.053073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:38.054887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:38.070742 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3452/6891] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:38.072620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:38.106571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d58a-516b-4887-905a-3dfb75df4535 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:38.143636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439956b-1457-488c-8d3a-90b4380a1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:38.144709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439956b-1457-488c-8d3a-90b4380a1579 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:38.151380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439956b-1457-488c-8d3a-90b4380a1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:38.151667 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439956b-1457-488c-8d3a-90b4380a1579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:38.152403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439956b-1457-488c-8d3a-90b4380a1579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:38.154212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439956b-1457-488c-8d3a-90b4380a1579 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:38.198563 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3440/6892] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:38.200542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:38.236855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f795b-36f0-498f-8480-bea79d41c96c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:38.251507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:38.252510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:38.252970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:38.253417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] PATH_INFO: `/v3/projects/89c551b83154476c9bab7f87d14ccc67/users/053ebd1cde5d45cd90d49ff5365048dd/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:38.274245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c551b83154476c9bab7f87d14ccc67, user_id=053ebd1cde5d45cd90d49ff5365048dd, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:38.278203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:38.432611 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3453/6893] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:38 2022] PUT /identity/v3/projects/89c551b83154476c9bab7f87d14ccc67/users/053ebd1cde5d45cd90d49ff5365048dd/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:38.446230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:38.456609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:38.457348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:38.530398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] MFA Rules not processed for user `053ebd1cde5d45cd90d49ff5365048dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:38.532690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:38.626376 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3441/6894] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:38.640070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:38.641904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:38.716406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362b40b-f0fa-4acd-a829-403bd5eb04ec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:38.720657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:38.721421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:38.721737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:38.722072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:38.732249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:38.733829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:38.744311 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3454/6895] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:42.125739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:42.127858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:42.140041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:42.329627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a261eb-544a-4ecd-ac19-ed9293d73969 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:42.339351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:42.340716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:42.341020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:42.341347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:42.377592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:42.461530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:42.461530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7ec3-2f1a-42ce-8f47-39e4d9314726 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:42.486663 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3442/6896] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:43.045478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:43.054359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:43.267643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfcccf-ff4e-4b0e-a8e3-91231b128359 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:43.286135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:43.289272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:43.289974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:43.291340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] PATH_INFO: `/v3/users/dc8c1e324ae441ca90769f1fbdc5accd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:43.295260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8c1e324ae441ca90769f1fbdc5accd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:43.300763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:43.659292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8c1e324ae441ca90769f1fbdc5accd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:43.700665 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8c1e324ae441ca90769f1fbdc5accd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:43.728621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8c1e324ae441ca90769f1fbdc5accd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:43.729981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8c1e324ae441ca90769f1fbdc5accd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:43.739840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8c1e324ae441ca90769f1fbdc5accd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:43.760558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:43.998021 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3455/6897] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:43 2022] DELETE /identity/v3/users/dc8c1e324ae441ca90769f1fbdc5accd => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:44.006815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:44.007355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:44.007464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:44.067302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:44.070842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:44.297973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3443/6898] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:44.336087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:44.337627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:44.610218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee7f8-ba12-4889-a881-a594c37badea admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:44.630733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeeb56-ef96-4134-8f0c-22d387f41785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:44.633419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeeb56-ef96-4134-8f0c-22d387f41785 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:44.635826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeeb56-ef96-4134-8f0c-22d387f41785 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:44.639999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeeb56-ef96-4134-8f0c-22d387f41785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:44.675500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeeb56-ef96-4134-8f0c-22d387f41785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:44.679142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeeb56-ef96-4134-8f0c-22d387f41785 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:44.760107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3456/6899] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:25:45.213564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:45.216769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:45.415407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:45.415926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:45.416025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:45.486853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] MFA Rules not processed for user `46645ce79a674b29bc7b0805f553726f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:45.494856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:45.506981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba00ab0-a346-4deb-bc04-1709f957b669 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:45.529770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:45.533773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:45.534414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:45.535427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:45.544014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:45.699007 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3457/6900] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:45.757329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:45.791147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:45.794169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:45.831689 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3444/6901] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:47.435108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:47.437092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:47.514788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48e6c5-269b-488f-99b2-45fda28f1fdc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:47.526753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:47.527502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:47.527777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:47.529586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] PATH_INFO: `/v3/projects/112352edc8804c89b426c06f9b7a62e1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:47.535730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=112352edc8804c89b426c06f9b7a62e1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:47.542502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:47.780386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112352edc8804c89b426c06f9b7a62e1', 'request_id': 'req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:47.813880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112352edc8804c89b426c06f9b7a62e1', 'request_id': 'req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:47.826637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112352edc8804c89b426c06f9b7a62e1', 'request_id': 'req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:47.987567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] The token cache is being invalidate because project 112352edc8804c89b426c06f9b7a62e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:47.987752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:47.988619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:47.990404 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3458/6902] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:47 2022] DELETE /identity/v3/projects/112352edc8804c89b426c06f9b7a62e1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:47.996419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:48.047356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304111f9-42fc-4225-9b5c-50c9014edf77 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:48.433298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:48.436474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:48.436862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:48.437201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] PATH_INFO: `/v3/users/35e2906e112d418e997b5c1cf78a809f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:48.461641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e2906e112d418e997b5c1cf78a809f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:48.466908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:48.872063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e2906e112d418e997b5c1cf78a809f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:48.874247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e2906e112d418e997b5c1cf78a809f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:49.028678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e2906e112d418e997b5c1cf78a809f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:49.045482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e2906e112d418e997b5c1cf78a809f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:49.046619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e2906e112d418e997b5c1cf78a809f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:49.114599 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3445/6903] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:47 2022] DELETE /identity/v3/users/35e2906e112d418e997b5c1cf78a809f => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:25:50.239270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:50.241900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:50.299627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a772a22-6591-4b6e-bfa4-7ed22b0a9e6d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:50.366749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:50.495752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:50.497842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:50.498527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:50.499065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] PATH_INFO: `/v3/projects/86cbde14a51b416c9c11fc36f41233a6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:50.500704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cbde14a51b416c9c11fc36f41233a6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:50.502978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:50.692072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cbde14a51b416c9c11fc36f41233a6', 'request_id': 'req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:50.713925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cbde14a51b416c9c11fc36f41233a6', 'request_id': 'req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:50.763896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cbde14a51b416c9c11fc36f41233a6', 'request_id': 'req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:50.897055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] The token cache is being invalidate because project 86cbde14a51b416c9c11fc36f41233a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:50.898062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:50.899729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:50.903752 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3459/6904] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:50 2022] DELETE /identity/v3/projects/86cbde14a51b416c9c11fc36f41233a6 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:25:50.908366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:50.911958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:50.959949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f104f-1766-431f-907f-ec40853ebb5d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:51.105255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:51.107011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:51.114745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:51.115335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] PATH_INFO: `/v3/users/aed8ebc610d94ef3973814efbf00eef8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:51.126582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed8ebc610d94ef3973814efbf00eef8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:51.131047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:51.156625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:51.470704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed8ebc610d94ef3973814efbf00eef8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:51.471664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed8ebc610d94ef3973814efbf00eef8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:51.559307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed8ebc610d94ef3973814efbf00eef8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:51.577514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed8ebc610d94ef3973814efbf00eef8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:51.578420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a1d891e5-4e1c-4387-b3c9-d05669635653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed8ebc610d94ef3973814efbf00eef8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:51.657362 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3446/6905] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:25:50 2022] DELETE /identity/v3/users/aed8ebc610d94ef3973814efbf00eef8 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:52.757373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:52.759925 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:52.798290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ab34-9b9d-42d7-a0e0-13aab4ebecec admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:52.907991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:52.908831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:52.909364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:52.909911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] PATH_INFO: `/v3/projects/3aa154db2f974ed6951dbdd2b4426b46` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:52.913035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa154db2f974ed6951dbdd2b4426b46)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:52.915764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:53.172327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa154db2f974ed6951dbdd2b4426b46', 'request_id': 'req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:53.198354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:53.218449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa154db2f974ed6951dbdd2b4426b46', 'request_id': 'req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:53.241835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa154db2f974ed6951dbdd2b4426b46', 'request_id': 'req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:53.298348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] The token cache is being invalidate because project 3aa154db2f974ed6951dbdd2b4426b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:25:53.298571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:53.299361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fe54d7ab-28a2-4769-9433-90e5cd1a02d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:25:53.301165 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3460/6906] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:25:52 2022] DELETE /identity/v3/projects/3aa154db2f974ed6951dbdd2b4426b46 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:53.306156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:53.306706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:53.309918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:53.377168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:53.382010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:53.586709 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3447/6907] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:53.595975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:53.596300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:53.596645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:53.643522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:53.644994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:53.684872 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3461/6908] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:25:53.689664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:53.712943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c421a2b-7425-4b5e-aba4-707b5e87c2f2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:53.730984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:53.732408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:53.732918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:53.733303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:53.734536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:25:53.740018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:53.743139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:53.791679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:53.793235 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3448/6909] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:25:53.814265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f757-e96f-4d89-8bc0-78f6222a4629 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:53.835183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:53.836575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:53.843073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:53.843073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:53.843073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:53.847050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:54.226659 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3462/6910] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:25:53 2022] POST /identity/v3/projects => generated 371 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:25:54.231221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:54.249430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10713-72a8-4364-b9d2-fb5bbe022b87 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:54.407269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:54.407959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:54.408900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:54.408900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:54.411993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:54.421279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:54.607855 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3449/6911] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:25:54 2022] POST /identity/v3/users => generated 286 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:25:54.614285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:54.641374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92c78-f7c4-4890-bb0a-fdb4dcde6873 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:54.663313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:54.665054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:54.665347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:54.665624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:54.667364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:54.677676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:54.761018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:54.769703 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3463/6912] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:54.772226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:25:54.784101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab476-f946-43a0-b4b1-b4d2189e2a7e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:54.817753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036b5ba-6f7a-443e-9e23-0fa599dde581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:54.819568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b5ba-6f7a-443e-9e23-0fa599dde581 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:54.822623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b5ba-6f7a-443e-9e23-0fa599dde581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:54.828626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b5ba-6f7a-443e-9e23-0fa599dde581 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:54.828626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036b5ba-6f7a-443e-9e23-0fa599dde581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:54.831490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036b5ba-6f7a-443e-9e23-0fa599dde581 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:54.915559 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3450/6913] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:25:54.917314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:54.974183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc7eb7-863e-4565-a4a4-fe0db3d06651 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:55.015655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:55.015965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:55.017629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:55.019337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] PATH_INFO: `/v3/projects/5b0f9bc8d4cb46c8af856fea8e100ef6/users/1ec8ffb835c147e7a34a47d0c2ae6ccf/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:55.058613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f9bc8d4cb46c8af856fea8e100ef6, user_id=1ec8ffb835c147e7a34a47d0c2ae6ccf, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:55.062380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:55.208392 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3464/6914] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:25:54 2022] PUT /identity/v3/projects/5b0f9bc8d4cb46c8af856fea8e100ef6/users/1ec8ffb835c147e7a34a47d0c2ae6ccf/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:25:55.219898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce840f-b9ef-4157-bde0-7d8a7bf24f07 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:55.220504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce840f-b9ef-4157-bde0-7d8a7bf24f07 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:55.220973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce840f-b9ef-4157-bde0-7d8a7bf24f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:55.304664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-21ce840f-b9ef-4157-bde0-7d8a7bf24f07 None None] MFA Rules not processed for user `1ec8ffb835c147e7a34a47d0c2ae6ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:25:55.307007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-21ce840f-b9ef-4157-bde0-7d8a7bf24f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:55.508067 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3451/6915] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:25:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:25:55.527441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:25:55.529798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:25:55.872704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc71bd3-d39d-45d0-b2bf-d7b36f8de92b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:25:55.883037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:25:55.884542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:25:55.885008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:25:55.885650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:25:55.900576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:25:55.902794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:25:55.915149 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3465/6916] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:25:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:26:01.145164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41551a-025f-4edf-8b05-854e8e50ee24 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:01.147304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41551a-025f-4edf-8b05-854e8e50ee24 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:01.157678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41551a-025f-4edf-8b05-854e8e50ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:01.231284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9f41551a-025f-4edf-8b05-854e8e50ee24 None None] MFA Rules not processed for user `1ec8ffb835c147e7a34a47d0c2ae6ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:26:01.234563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9f41551a-025f-4edf-8b05-854e8e50ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:01.255260 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3452/6917] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:26:02.331931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:02.333515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:02.494869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccff0b4-248d-43f9-a9c8-9f2eeb5794f3 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:02.502170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:02.503488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:02.503875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:02.504299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:02.506663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:02.533318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:02.539605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:02.562866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:02.563396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:02.563580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:02.582240 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3466/6918] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:26:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:26:02.605387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] MFA Rules not processed for user `f34ef02913674b04b2822574c2c478f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:26:02.606862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:02.777971 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3453/6919] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:26:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:26:03.383592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:03.385707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:03.438849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:03.551928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c8032-9538-460c-8fa5-53c3066099d2 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:03.561673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:03.562926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:03.564630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:03.564934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:03.568053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:03.612870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:03.615210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd5dfe-e5dc-40bc-89a8-360d39ea0ec9 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:03.660314 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3467/6920] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:26:03.726976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:03.728408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:03.765049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e2173-cac1-49a1-96a4-f511488f90ea None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:03.775249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:03.776374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:03.777486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:03.786433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:03.786433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:03.846361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:03.859198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:03.906883 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3454/6921] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:26:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:26:06.859838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:06.861021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:06.861303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:06.946652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:26:06.963357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:07.147318 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3468/6922] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:26:07.162163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:07.165591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:07.609473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:07.626963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df4e-4c36-4e20-a2f2-69ec10368dd8 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:07.655192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d5bf-d56a-4a94-8261-b4e7edf69913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:07.656109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d5bf-d56a-4a94-8261-b4e7edf69913 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:07.660894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d5bf-d56a-4a94-8261-b4e7edf69913 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:07.660894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d5bf-d56a-4a94-8261-b4e7edf69913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:07.721889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1d5bf-d56a-4a94-8261-b4e7edf69913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:07.724257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1d5bf-d56a-4a94-8261-b4e7edf69913 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:07.754163 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3455/6923] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:26:17.138542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=54 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:18.113438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:23.352891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:23.354974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:23.655131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b48b1-f0a4-4251-9cf7-b5e5cd7547b9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:23.666218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:23.667034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:23.667172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:23.667425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:23.672453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:23.710755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:23.712693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:23.763211 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3469/6924] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:26:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:26:33.732149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=38 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:43.830118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:43.831027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:43.831666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:43.876992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:26:43.876992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:43.900038 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3456/6925] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:26:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:26:43.929997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:43.969006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230748-2e07-412a-a7b0-cd9f445fb37f service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:43.979389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:43.981014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:43.981892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:43.982782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:44.011879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:44.016391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:44.036358 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3470/6926] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:26:47.996277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:48.055841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afbea4-fa50-474b-ada9-387f27f4e412 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:48.085360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:48.101659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:48.101659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:48.101659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:48.101659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:48.106801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:48.109077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:48.151156 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3457/6927] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:26:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:26:54.026915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:58.119805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:26:58.124655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:58.130150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=13 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:26:58.163617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8d26c-2ad3-445d-991b-7df5ee37e55c service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:26:58.176125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:26:58.179143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:26:58.217467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:26:58.219302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:26:58.234647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:26:58.562795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:26:58.562795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84445952-7a5a-4aab-951e-4a9f61fdbbf7 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:26:58.562795 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3471/6928] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:05.739711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:05.746417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:05.766252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399ec96-3f0e-4fac-8696-512d7f72f2d4 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:05.782885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:05.784270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:05.784575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:05.784849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] PATH_INFO: `/v3/users/053ebd1cde5d45cd90d49ff5365048dd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:05.786705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053ebd1cde5d45cd90d49ff5365048dd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:05.788706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:06.335581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053ebd1cde5d45cd90d49ff5365048dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:06.336583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053ebd1cde5d45cd90d49ff5365048dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:06.500236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053ebd1cde5d45cd90d49ff5365048dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:06.520684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053ebd1cde5d45cd90d49ff5365048dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:06.530406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053ebd1cde5d45cd90d49ff5365048dd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:06.587906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3458/6929] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:05 2022] DELETE /identity/v3/users/053ebd1cde5d45cd90d49ff5365048dd => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:06.590365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:06.590365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:06.590365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:06.688160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:06.689615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:06.910461 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3472/6930] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:27:06.969267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:06.970953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:07.157351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b19f8-1800-40bd-9427-37bcf4bf29a1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:07.169802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce6f44-5924-43eb-b24a-1e9c371ae0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:07.171932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce6f44-5924-43eb-b24a-1e9c371ae0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:07.172415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce6f44-5924-43eb-b24a-1e9c371ae0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:07.172863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce6f44-5924-43eb-b24a-1e9c371ae0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:07.215551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce6f44-5924-43eb-b24a-1e9c371ae0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:07.217321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce6f44-5924-43eb-b24a-1e9c371ae0c4 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:07.256029 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3459/6931] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:09.132018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:09.133713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:09.159717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745fea4-a85b-432f-bb27-01dcc8feb023 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:09.174624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:09.184403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:09.184403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:09.184403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] PATH_INFO: `/v3/projects/89c551b83154476c9bab7f87d14ccc67` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:09.184403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c551b83154476c9bab7f87d14ccc67)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:09.184403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:09.416128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c551b83154476c9bab7f87d14ccc67', 'request_id': 'req-b22339e1-fc37-41ee-8d25-4853b91ac445'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:09.449123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c551b83154476c9bab7f87d14ccc67', 'request_id': 'req-b22339e1-fc37-41ee-8d25-4853b91ac445'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:09.487291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c551b83154476c9bab7f87d14ccc67', 'request_id': 'req-b22339e1-fc37-41ee-8d25-4853b91ac445'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:09.729298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] The token cache is being invalidate because project 89c551b83154476c9bab7f87d14ccc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:09.730014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:09.730700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b22339e1-fc37-41ee-8d25-4853b91ac445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:09.732736 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3473/6932] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:27:09 2022] DELETE /identity/v3/projects/89c551b83154476c9bab7f87d14ccc67 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:09.737460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:09.738016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:09.738278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:09.773959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:09.776824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:09.927889 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3460/6933] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:27:09.936067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:09.936370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:09.936644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.017452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:10.019807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:10.042252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:10.043039 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3474/6934] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:10.060593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2927af1-db91-413c-87ab-f84bb9873038 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:10.069060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:10.069530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:10.069804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:10.070138 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.070805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:10.071185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:10.076055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:10.109334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:10.114645 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3461/6935] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:27:10.114876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:10.129921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cfeab-d6cc-4922-b1ac-e239ec619720 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:10.137972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b2ba0-b425-421e-a880-74e0f1dea16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:10.138613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b2ba0-b425-421e-a880-74e0f1dea16a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:10.139093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b2ba0-b425-421e-a880-74e0f1dea16a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:10.139537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b2ba0-b425-421e-a880-74e0f1dea16a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.140354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b2ba0-b425-421e-a880-74e0f1dea16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:10.152530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b2ba0-b425-421e-a880-74e0f1dea16a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:10.383890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3475/6936] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:10 2022] POST /identity/v3/projects => generated 371 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:10.387199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:10.391739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:10.400821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044b3b-113a-40b9-8495-41b4c1408dd0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:10.585586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:10.586170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:10.588880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.609530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:10.610490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:10.610784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:10.611063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.611727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:10.613739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:10.639084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:10.640406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:10.791224 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3476/6937] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:27:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:27:10.804299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:10.806707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:10.873222 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3462/6938] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:27:10 2022] POST /identity/v3/users => generated 286 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:10.883124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:10.913085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96770d1-ca81-413d-9cfc-aa8907d4ea29 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:10.934207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:10.935112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:10.935552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:10.935976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.936790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:10.938602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:10.963322 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3463/6939] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:10.963322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:10.972449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:10.986872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bda15b-9c85-482f-9ddb-d29bf77a1468 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:10.991806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:10.992450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:10.992737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:10.993015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] PATH_INFO: `/v3/users/cb0cd81939cf4620b52a7aa4b9882c8d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:10.994392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0cd81939cf4620b52a7aa4b9882c8d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:10.996349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:11.070464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3515c-1ae5-44ee-a0d5-77452c3a8da9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:11.088800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592155d-3248-4197-8613-aa0741756184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:11.089470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592155d-3248-4197-8613-aa0741756184 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:11.089748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592155d-3248-4197-8613-aa0741756184 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:11.090046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592155d-3248-4197-8613-aa0741756184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:11.100075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592155d-3248-4197-8613-aa0741756184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:11.101775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592155d-3248-4197-8613-aa0741756184 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:11.124025 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3477/6940] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:27:11.124906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592155d-3248-4197-8613-aa0741756184 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:11.151263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592155d-3248-4197-8613-aa0741756184 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:11.168721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:11.169338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:11.169678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:11.170143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:11.170756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:11.172541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:11.202578 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3478/6941] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:11.219480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:11.242140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e381-ff41-4b03-bac9-1a040074b903 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:11.248166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f926da-e721-4cb3-96a9-0f02a1d98898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:11.249152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f926da-e721-4cb3-96a9-0f02a1d98898 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:11.249649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f926da-e721-4cb3-96a9-0f02a1d98898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:11.250164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f926da-e721-4cb3-96a9-0f02a1d98898 admin admin] PATH_INFO: `/v3/projects/65e5ed2e0142427f81a89318c850bb7e/users/8cc36d6b991f42e9a67154c79ef034d6/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:11.276979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f926da-e721-4cb3-96a9-0f02a1d98898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e5ed2e0142427f81a89318c850bb7e, user_id=8cc36d6b991f42e9a67154c79ef034d6, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:11.280532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f926da-e721-4cb3-96a9-0f02a1d98898 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:11.424994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0cd81939cf4620b52a7aa4b9882c8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:11.425756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0cd81939cf4620b52a7aa4b9882c8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:11.490189 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3479/6942] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:27:11 2022] PUT /identity/v3/projects/65e5ed2e0142427f81a89318c850bb7e/users/8cc36d6b991f42e9a67154c79ef034d6/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:11.518306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:11.518306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:11.518306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:11.594856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] MFA Rules not processed for user `8cc36d6b991f42e9a67154c79ef034d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:11.597377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:11.609227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0cd81939cf4620b52a7aa4b9882c8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:11.621704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0cd81939cf4620b52a7aa4b9882c8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:11.621704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0cd81939cf4620b52a7aa4b9882c8d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:11.689776 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3464/6943] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:10 2022] DELETE /identity/v3/users/cb0cd81939cf4620b52a7aa4b9882c8d => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:11.777944 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3480/6944] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:27:11.791478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:11.796541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:12.066464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b71f7-9711-43eb-9094-91877e1b234a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:12.085741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:12.086536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:12.086827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:12.087650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:12.226668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:12.232095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:12.261415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:12.269425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:12.287753 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3465/6945] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:12.506254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe5ec6-7175-463d-9595-d86b9fd7ee39 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:12.615207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:12.615870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:12.616230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:12.616602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] PATH_INFO: `/v3/projects/cd0d0379a2ef431c98328e490b1febcd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:12.618463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0d0379a2ef431c98328e490b1febcd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:12.620934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:12.845560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0d0379a2ef431c98328e490b1febcd', 'request_id': 'req-7db734d7-0c0e-4971-8835-75c8d24385ce'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:12.858126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0d0379a2ef431c98328e490b1febcd', 'request_id': 'req-7db734d7-0c0e-4971-8835-75c8d24385ce'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:12.867209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0d0379a2ef431c98328e490b1febcd', 'request_id': 'req-7db734d7-0c0e-4971-8835-75c8d24385ce'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:12.990419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:12.992612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:13.022354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] The token cache is being invalidate because project cd0d0379a2ef431c98328e490b1febcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:13.022661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:13.023737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7db734d7-0c0e-4971-8835-75c8d24385ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:13.029166 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3481/6946] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:27:12 2022] DELETE /identity/v3/projects/cd0d0379a2ef431c98328e490b1febcd => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:13.036764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee606b-2558-47d1-a818-5c3c64214301 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.038165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee606b-2558-47d1-a818-5c3c64214301 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.039823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee606b-2558-47d1-a818-5c3c64214301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.091434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-93ee606b-2558-47d1-a818-5c3c64214301 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:13.092819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-93ee606b-2558-47d1-a818-5c3c64214301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:13.148998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b65ecf-5baa-4265-bfca-7a7960443b8a service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:13.218308 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3482/6947] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:13.229161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.229831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.229831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.269293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:13.271264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.271653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.272314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.280626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:13.302858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:13.304435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:13.319895 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3466/6948] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:27:13.327472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:13.329566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:13.342471 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3483/6949] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:13.346725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:13.359669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:13.386087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88166e-41b7-4b32-81c9-5e2108ba74d2 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:13.409697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:13.410849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.411545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.411814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.412398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:13.412890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:13.414538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:13.438819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3467/6950] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:13.443511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:13.455980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755bf83-6736-4567-8fa1-ce214374c3a6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:13.468306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:13.469056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.475896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.476544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.478551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:13.481463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:13.727733 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3484/6951] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:13 2022] POST /identity/v3/projects => generated 405 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:13.731916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:13.744544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbb0a-40b3-4d51-ad2c-b26d1d86945c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:13.910379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:13.914328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c7540-49ad-48f4-9104-9c14a60ac837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:13.914328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7540-49ad-48f4-9104-9c14a60ac837 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.914328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7540-49ad-48f4-9104-9c14a60ac837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.914328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7540-49ad-48f4-9104-9c14a60ac837 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.914756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c7540-49ad-48f4-9104-9c14a60ac837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:13.918065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c7540-49ad-48f4-9104-9c14a60ac837 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:13.919217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:14.004081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:14.029229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5118-fb3b-4004-847e-764a17762735 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:14.035633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:14.036532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.036800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.037213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.042986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:14.056484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:14.060985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2fb3-db37-4914-ad2f-799a4b047bf2 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:14.074107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3485/6952] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:14.159463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.159924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.160371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.184401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:14.186136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:14.199251 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3468/6953] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:27:13 2022] POST /identity/v3/users => generated 303 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:14.201841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f1bd6-5a82-4945-9183-d2a856bfdefb None None] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.202445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f1bd6-5a82-4945-9183-d2a856bfdefb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.202958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f1bd6-5a82-4945-9183-d2a856bfdefb None None] PATH_INFO: `/` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.204405 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3469/6954] 10.222.0.78 () {54 vars in 921 bytes} [Sun Aug 28 20:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:27:14.205455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f1bd6-5a82-4945-9183-d2a856bfdefb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:14.219519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f1bd6-5a82-4945-9183-d2a856bfdefb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:14.224191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377796e-b438-40ad-944c-f16fede9b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:14.224816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377796e-b438-40ad-944c-f16fede9b3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.225101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377796e-b438-40ad-944c-f16fede9b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.225377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377796e-b438-40ad-944c-f16fede9b3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.226151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377796e-b438-40ad-944c-f16fede9b3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:14.228342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377796e-b438-40ad-944c-f16fede9b3b5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:14.239794 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3470/6955] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:14.241215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.242039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.242412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.257105 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3486/6956] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:14.258027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:14.271472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ba7d-7707-4e53-987c-b70704b9075e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:14.287139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:14.289658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.289658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.289658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.289658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:14.291468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:14.298704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] MFA Rules not processed for user `c9cf360f24634e1aa0edb2900994d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:14.300064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:14.303333 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3487/6957] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:14.304303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:14.308817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:14.438445 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3471/6958] 10.222.0.78 () {58 vars in 1018 bytes} [Sun Aug 28 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:14.440358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:14.473106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349e6c-bc1f-40c9-9a90-9b714a328d7e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:14.476944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e14d39-94e8-4ba0-a77d-e065d73c70f3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:14.479493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:14.480483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.480953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.481696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.486704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:14.487903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.488432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.488935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] PATH_INFO: `/v3/projects/f44ed60223d44e13a761814a201211ed/users/c7634b791dde4a1fa4a7bef2232127a3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.495854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:14.497917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:14.511347 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3488/6959] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:27:14.513606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:14.514747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44ed60223d44e13a761814a201211ed, user_id=c7634b791dde4a1fa4a7bef2232127a3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:14.518515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:14.533313 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c452c-912d-4d7e-bb29-ce7de29d86d6 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:14.540242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f00536-b77c-4fe9-b51b-71851fa64e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:14.541414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00536-b77c-4fe9-b51b-71851fa64e0d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.541701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00536-b77c-4fe9-b51b-71851fa64e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.542059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00536-b77c-4fe9-b51b-71851fa64e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.554108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f00536-b77c-4fe9-b51b-71851fa64e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:14.555621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f00536-b77c-4fe9-b51b-71851fa64e0d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:14.569267 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3489/6960] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:14.679798 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3472/6961] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:27:14 2022] PUT /identity/v3/projects/f44ed60223d44e13a761814a201211ed/users/c7634b791dde4a1fa4a7bef2232127a3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:14.685133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40de33-07ef-4fd9-9fee-cee07e9cdba5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:14.685775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40de33-07ef-4fd9-9fee-cee07e9cdba5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:14.686078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40de33-07ef-4fd9-9fee-cee07e9cdba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:14.767038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6c40de33-07ef-4fd9-9fee-cee07e9cdba5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:14.768361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6c40de33-07ef-4fd9-9fee-cee07e9cdba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:14.932265 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3490/6962] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:27:14.943116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:15.035773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859d977-5d2a-43c5-8fd1-d47487446e59 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:15.061345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:15.062019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:15.065373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:15.065716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:15.098842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:15.100393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:15.128977 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3473/6963] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:15.312278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:16.327600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:16.327600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:16.327600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:16.361005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:16.366496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:16.563335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:16.590702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:16.611124 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3491/6964] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:16.632610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:16.866042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a7923-c083-4f14-8289-796dbdb377fb service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:16.882904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e5fb9-1094-4863-8f20-86b5e624a877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:16.883571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e5fb9-1094-4863-8f20-86b5e624a877 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:16.883886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e5fb9-1094-4863-8f20-86b5e624a877 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:16.888660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e5fb9-1094-4863-8f20-86b5e624a877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:16.910204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e5fb9-1094-4863-8f20-86b5e624a877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:16.918299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e5fb9-1094-4863-8f20-86b5e624a877 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:16.944614 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3474/6965] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:27:17.210289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:18.866896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:25.410893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:25.413372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:25.443762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3a0ea-b6f4-4fae-864c-76332997e387 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:25.454795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:25.455831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:25.456515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:25.457130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:25.464657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:25.518778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:25.526154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:25.568363 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3492/6966] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:28.745322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=51 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:29.251591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:29.252277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:29.252764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:29.334948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] MFA Rules not processed for user `c7634b791dde4a1fa4a7bef2232127a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:29.336507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:29.485705 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3475/6967] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:29.490156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:29.505783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb247-bafd-413b-9de7-cbaafe329d12 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:29.513087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:29.514063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:29.514525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:29.514978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:29.516130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:29.519121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:29.667144 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3493/6968] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:29 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:29.671222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:29.694743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ae321-d7db-4761-a845-c2ce39f37c97 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:29.838470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:29.839146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:29.839146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:29.839599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:29.842125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:29.844934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:29.938377 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3476/6969] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:27:29 2022] POST /identity/v3/users => generated 303 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:29.941842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:29.957879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5a571-c4bc-46e0-a68a-8c2bd74deb26 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:29.983372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:29.985082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:29.986437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:29.987664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:29.989492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:29.992393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:30.015098 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3494/6970] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:30.018886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:30.032863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6433473-6b15-4186-bbf6-8bb74f41d5b0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:30.038961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:30.040303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:30.040775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:30.042917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:30.043904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:30.045803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:30.061417 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3477/6971] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:30.065234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:30.086154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de8e5-4b7a-4b7d-868a-8882c45f2459 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:30.093304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914662fc-1835-4850-bc0c-98a47c18f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:30.094982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914662fc-1835-4850-bc0c-98a47c18f0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:30.095922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914662fc-1835-4850-bc0c-98a47c18f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:30.098300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914662fc-1835-4850-bc0c-98a47c18f0ae admin admin] PATH_INFO: `/v3/projects/68f289a90b4f4b19bf6beef0a930d79a/users/c93925d0b0a54d53ac16efcde7837807/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:30.179272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914662fc-1835-4850-bc0c-98a47c18f0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f289a90b4f4b19bf6beef0a930d79a, user_id=c93925d0b0a54d53ac16efcde7837807, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:30.184087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914662fc-1835-4850-bc0c-98a47c18f0ae admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:30.266075 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3495/6972] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:27:30 2022] PUT /identity/v3/projects/68f289a90b4f4b19bf6beef0a930d79a/users/c93925d0b0a54d53ac16efcde7837807/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:31.051099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:31.222427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7e8be-f19d-4941-99d7-8df57e79b5f3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:31.223233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7e8be-f19d-4941-99d7-8df57e79b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:31.223787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7e8be-f19d-4941-99d7-8df57e79b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:31.298813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc75c-cfaa-40c4-b5b9-0f3e89cf7dd7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:31.300246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-31a7e8be-f19d-4941-99d7-8df57e79b5f3 None None] MFA Rules not processed for user `eab435220eb1424985b28ec0642ef70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:31.306375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-31a7e8be-f19d-4941-99d7-8df57e79b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:31.318717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:31.391691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:31.391691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:31.391691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:31.391691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:31.392450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:31.563713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:31.576701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:31.614969 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3478/6973] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:27:31.657291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3496/6974] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:41.591322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=49 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:41.616307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:42.630715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:42.633161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:42.675323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:42.676321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:42.676797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:42.716832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] MFA Rules not processed for user `46645ce79a674b29bc7b0805f553726f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:42.718287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:42.871064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434bdbd-acd0-4bb4-ae5c-dc112f0e9b9a service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:42.880295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3497/6975] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:27:42.954300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:42.955530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:42.956096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:42.956602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:42.958902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:42.987453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:42.989483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:43.022897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3479/6976] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:43.091027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:43.092959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:43.253348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdb133-4b5d-41d5-9c90-cbc1f0dca39d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:43.263951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:43.264995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:43.265433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:43.265878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] PATH_INFO: `/v3/users/ed9ff24f139b4ff59e3659b0dcc4a3f3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:43.268750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9ff24f139b4ff59e3659b0dcc4a3f3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:43.270314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:43.548272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9ff24f139b4ff59e3659b0dcc4a3f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.585235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9ff24f139b4ff59e3659b0dcc4a3f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.605276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9ff24f139b4ff59e3659b0dcc4a3f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.607866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9ff24f139b4ff59e3659b0dcc4a3f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.620081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9ff24f139b4ff59e3659b0dcc4a3f3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.756732 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3498/6977] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:43 2022] DELETE /identity/v3/users/ed9ff24f139b4ff59e3659b0dcc4a3f3 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:44.042701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:44.191183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a14f6-d845-49e1-b36d-ecf63ba10e84 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:44.329703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:44.330747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:44.330747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:44.330987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:44.332907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:44.401221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:44.402814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b499a3-4411-46b0-9995-52839d5f9659 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:44.424169 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3480/6978] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:44.762962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:44.764932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:44.840389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:44.944218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21c7a-4b5f-4d6b-a642-9c04cf94829f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:44.953794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:44.954484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:44.954764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:44.955038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] PATH_INFO: `/v3/projects/25929238d35e4de0b4f6bff77f18b544` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:44.960408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25929238d35e4de0b4f6bff77f18b544)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:44.966446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:45.176768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25929238d35e4de0b4f6bff77f18b544', 'request_id': 'req-cccca05e-d7da-4a4b-893a-c054b23d3466'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:45.193731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25929238d35e4de0b4f6bff77f18b544', 'request_id': 'req-cccca05e-d7da-4a4b-893a-c054b23d3466'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:45.205750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25929238d35e4de0b4f6bff77f18b544', 'request_id': 'req-cccca05e-d7da-4a4b-893a-c054b23d3466'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:45.332506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] The token cache is being invalidate because project 25929238d35e4de0b4f6bff77f18b544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:45.333067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:45.334266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cccca05e-d7da-4a4b-893a-c054b23d3466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:45.341269 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3499/6979] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:27:44 2022] DELETE /identity/v3/projects/25929238d35e4de0b4f6bff77f18b544 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:45.345250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:45.345250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:45.345250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:45.478531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:45.479904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:45.550611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:45.769165 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3481/6980] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:45.780609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:45.781086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:45.781199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:45.846970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:45.848275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:45.895373 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3500/6981] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:45.900453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:45.913675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbdf18-ff7b-416f-94ef-65cfc03017bb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:45.921476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:45.922430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:45.922966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:45.923469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:45.926141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:45.927088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:45.929374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:45.976304 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3482/6982] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:27:45.976986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:45.989393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39622-9d03-4979-9dd4-2a12278aa932 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:45.997403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:45.998286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:45.998725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:46.003873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:46.003873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:46.003873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:46.134979 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3501/6983] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:45 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:46.136926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:46.172733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a7ed-05f2-45bb-b8f7-10800cdc5b16 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:46.358748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:46.359441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:46.359732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:46.360217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:46.361050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:46.363372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:46.528768 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3483/6984] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:27:46 2022] POST /identity/v3/users => generated 287 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:46.534249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:46.552459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d287-5d15-4650-9d38-38b75d307cd5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:46.564746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:46.565382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:46.566109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:46.566632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:46.568628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:46.574716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:46.589222 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3502/6985] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:46.593598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:46.613407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87fe8-63dd-4374-9b9f-118f2e13213b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:46.627580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f1a9-9493-453e-a549-e45a06d382cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:46.628507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f1a9-9493-453e-a549-e45a06d382cb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:46.628946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f1a9-9493-453e-a549-e45a06d382cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:46.629397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f1a9-9493-453e-a549-e45a06d382cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:46.630259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f1a9-9493-453e-a549-e45a06d382cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:46.632062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f1a9-9493-453e-a549-e45a06d382cb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:46.659414 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3484/6986] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:46.663465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:46.685791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b72d-b37a-4e2d-a0bf-21edb583a7b9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:46.709455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:46.711913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:46.721381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:46.721381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] PATH_INFO: `/v3/projects/25ef552906f944f3a999c74c11467f4e/users/50c1f2c921e04231bb88d2851ec3d10a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:46.742853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ef552906f944f3a999c74c11467f4e, user_id=50c1f2c921e04231bb88d2851ec3d10a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:46.747897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:46.886863 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3503/6987] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:27:46 2022] PUT /identity/v3/projects/25ef552906f944f3a999c74c11467f4e/users/50c1f2c921e04231bb88d2851ec3d10a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:46.889115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:46.889603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:46.890150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:46.986262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] MFA Rules not processed for user `50c1f2c921e04231bb88d2851ec3d10a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:46.987858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:47.152625 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3485/6988] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:47.156820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:47.272841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:47.327111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ead95-cc27-4da8-ac4c-32653546ac1e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:47.374632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:47.395201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:47.395674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:47.397623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:47.397623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:47.404836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:47.565428 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3504/6989] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:47 2022] POST /identity/v3/projects => generated 373 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:47.568531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:47.596862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca9ba-bfa8-4146-95b2-4787ad3c3ef5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:47.613722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:47.794819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:47.795662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:47.796039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:47.796408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:47.797157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:47.800158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:47.924717 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3486/6990] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:27:47 2022] POST /identity/v3/users => generated 293 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:47.928517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:47.945171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7397db-fae5-419a-ad87-aed9eeee11b7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:47.955438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:47.956622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:47.957107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:47.957577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:47.958810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:47.960760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:48.003715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:48.004129 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3505/6991] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:48.016900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de584ec1-7792-4fd9-bc9f-eec112cf914b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:48.025566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:48.026505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.026888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.027289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] PATH_INFO: `/v3/projects/00337d62bc344083b64a9f07360170f2/users/a116e908eb794c749708ecf7c5c8089b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.050254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00337d62bc344083b64a9f07360170f2, user_id=a116e908eb794c749708ecf7c5c8089b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:48.054962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:48.130068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:48.132396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:48.157102 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3487/6992] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:27:48 2022] PUT /identity/v3/projects/00337d62bc344083b64a9f07360170f2/users/a116e908eb794c749708ecf7c5c8089b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:48.158173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:48.300519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0ed96-704c-47bc-9ecc-6793aa1830f8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:48.311062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25008d-ff06-47a6-8883-93360a0138e5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:48.353919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:48.353919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.353919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.353919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.355213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:48.355213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:48.377518 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3488/6993] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:27:48.379043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:48.397091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21b8a-1f5f-4bee-b485-ba317d5991b9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:48.406316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb55c0-5a22-40bb-ba62-5629b40b3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:48.407006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb55c0-5a22-40bb-ba62-5629b40b3613 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.407298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb55c0-5a22-40bb-ba62-5629b40b3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.407579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb55c0-5a22-40bb-ba62-5629b40b3613 admin admin] PATH_INFO: `/v3/projects/00337d62bc344083b64a9f07360170f2/users/a116e908eb794c749708ecf7c5c8089b/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.418060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb55c0-5a22-40bb-ba62-5629b40b3613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00337d62bc344083b64a9f07360170f2, user_id=a116e908eb794c749708ecf7c5c8089b, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:48.421274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb55c0-5a22-40bb-ba62-5629b40b3613 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:48.442405 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3489/6994] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:27:48 2022] PUT /identity/v3/projects/00337d62bc344083b64a9f07360170f2/users/a116e908eb794c749708ecf7c5c8089b/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:48.444004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc916f1-72d4-49f0-892e-f26ffbdc1db1 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.444305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc916f1-72d4-49f0-892e-f26ffbdc1db1 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.444735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc916f1-72d4-49f0-892e-f26ffbdc1db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.498337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:48.498969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.499591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.506477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.506477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:48.517618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2fc916f1-72d4-49f0-892e-f26ffbdc1db1 None None] MFA Rules not processed for user `c93925d0b0a54d53ac16efcde7837807`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:48.520559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fc916f1-72d4-49f0-892e-f26ffbdc1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:48.620951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:48.621973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e4386-c6a5-4530-8b02-0df9c1fa5e1a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:48.637473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:48.645139 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3506/6995] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:27:48.646554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.647049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.649240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.667671 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3490/6996] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:48.678541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:48.684083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:48.684620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:48.730819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] MFA Rules not processed for user `c7634b791dde4a1fa4a7bef2232127a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:48.733947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:48.753760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] MFA Rules not processed for user `a116e908eb794c749708ecf7c5c8089b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:48.761053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:48.803074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:48.861225 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3491/6997] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:48.927529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:48.930546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:48.967674 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3507/6998] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:48.973945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:49.009428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0350-5a85-4b89-8334-aa469b9ec714 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:49.025066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:49.025994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:49.026546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:49.027035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:49.027966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:49.029778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:49.114380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0079-550a-4e6b-9f53-e662a46f6885 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:49.126574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:49.127420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:49.127785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:49.128143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:49.138672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:49.328919 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3508/6999] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:27:48 2022] POST /identity/v3/domains => generated 277 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:49.329722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:49.332209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:49.334861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:49.335565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:49.364852 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3492/7000] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:27:49.378769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:49.429254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3390b1-f41b-4ae5-89c3-286a7d9618f5 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:49.542563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:49.599752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fcdc6-0782-46c9-bc95-1d90f570fff1 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:49.612707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:49.614363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:49.616976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:49.619751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:49.620732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:49.628183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:49.636458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:49.637107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:49.637392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:49.637656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:49.646132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:49.793717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:49.795683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:49.811741 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3509/7001] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:49 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:49.978570 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3493/7002] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:49 2022] POST /identity/v3/projects => generated 402 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:49.981711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:49.994292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab00b1-548b-4d48-ba50-51a8ded35572 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:50.065069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:50.132125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:50.132954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:50.133337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:50.133721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/groups` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:50.134582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:50.136735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:50.313890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3510/7003] 10.222.0.78 () {60 vars in 1147 bytes} [Sun Aug 28 20:27:49 2022] POST /identity/v3/groups => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:50.314848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:50.335847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59260bb-ac61-4495-adeb-8e079546449e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:50.353688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:50.357807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:50.357994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:50.359898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:50.361782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:50.368556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:50.557772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3494/7004] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:27:50 2022] POST /identity/v3/users => generated 439 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:50.559335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:50.591508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1869813-2379-4301-afd9-2cee7f0e3ddd tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:50.606710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:50.607348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:50.607640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:50.610420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:50.611154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:50.615218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:50.749607 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3511/7005] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:27:50 2022] POST /identity/v3/roles => generated 239 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:50.754116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:50.783770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc65a5-0193-48ba-b315-886d2f05aa7c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:50.797703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:50.798874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:50.799351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:50.799824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/groups/da59bfae736d4486bbafcc5681dd9e62/roles/bfb8ed728d764f1d8bc82a0f7abd2fed/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:50.815845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, group_id=da59bfae736d4486bbafcc5681dd9e62, role_id=bfb8ed728d764f1d8bc82a0f7abd2fed)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:50.819862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:50.959893 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3495/7006] 10.222.0.78 () {60 vars in 1585 bytes} [Sun Aug 28 20:27:50 2022] PUT /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/groups/da59bfae736d4486bbafcc5681dd9e62/roles/bfb8ed728d764f1d8bc82a0f7abd2fed/inherited_to_projects => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:50.960296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:50.974461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1db3c-9934-4cfc-9468-7077cbbd1685 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:51.067754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:51.070446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:51.071087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:51.071631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/groups/da59bfae736d4486bbafcc5681dd9e62/roles/bfb8ed728d764f1d8bc82a0f7abd2fed/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:51.075626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, group_id=da59bfae736d4486bbafcc5681dd9e62, role_id=bfb8ed728d764f1d8bc82a0f7abd2fed)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:51.079219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:51.091051 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3512/7007] 10.222.0.78 () {58 vars in 1567 bytes} [Sun Aug 28 20:27:50 2022] HEAD /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/groups/da59bfae736d4486bbafcc5681dd9e62/roles/bfb8ed728d764f1d8bc82a0f7abd2fed/inherited_to_projects => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:51.095353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:51.108969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f169-8516-4dcf-bbd3-dff930cc6fc6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:51.114991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:51.115984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:51.116575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:51.117695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/groups/da59bfae736d4486bbafcc5681dd9e62/roles/bfb8ed728d764f1d8bc82a0f7abd2fed/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:51.120948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, group_id=da59bfae736d4486bbafcc5681dd9e62, role_id=bfb8ed728d764f1d8bc82a0f7abd2fed)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:51.124614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:51.134371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role bfb8ed728d764f1d8bc82a0f7abd2fed was removed from group da59bfae736d4486bbafcc5681dd9e62 on project 0523244d1b814ad7b93f2d92b460d4bb. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:51.134986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:51.135932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:51.348200 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3496/7008] 10.222.0.78 () {58 vars in 1569 bytes} [Sun Aug 28 20:27:51 2022] DELETE /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/groups/da59bfae736d4486bbafcc5681dd9e62/roles/bfb8ed728d764f1d8bc82a0f7abd2fed/inherited_to_projects => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:51.348730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:51.350331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:51.391838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c566006-7172-4674-bcac-348ec7ad563b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:51.545059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:51.548152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:51.548472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:51.548754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles/bfb8ed728d764f1d8bc82a0f7abd2fed` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:51.553604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bfb8ed728d764f1d8bc82a0f7abd2fed)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:51.555941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:51.807896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role bfb8ed728d764f1d8bc82a0f7abd2fed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:51.808266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:51.810724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:51.832980 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3513/7009] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:51 2022] DELETE /identity/v3/roles/bfb8ed728d764f1d8bc82a0f7abd2fed => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:51.838486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:51.859191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cfcf5-66fc-427b-9048-5dd10dd70260 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:52.020282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:52.025358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:52.026298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:52.027412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:52.033597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:52.035299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:52.172819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3497/7010] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:27:51 2022] POST /identity/v3/roles => generated 239 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:52.173430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:52.173430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:52.197242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516d45-c422-42db-ae44-49d317e62fd6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:52.213044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:52.214095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:52.214539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:52.214836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/0b61c7d15485463eb91819dc15bb24e8/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:52.235922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=0b61c7d15485463eb91819dc15bb24e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:52.244647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:52.264770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:52.448999 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3514/7011] 10.222.0.78 () {60 vars in 1582 bytes} [Sun Aug 28 20:27:52 2022] PUT /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/0b61c7d15485463eb91819dc15bb24e8/inherited_to_projects => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:52.449194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:52.468384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e26030-5d9c-40f5-a0d5-79759e926a51 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:52.574267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:52.595709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:52.596858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:52.597254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:52.597690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/0b61c7d15485463eb91819dc15bb24e8/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:52.600688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=0b61c7d15485463eb91819dc15bb24e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:52.605825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:52.618300 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3498/7012] 10.222.0.78 () {58 vars in 1564 bytes} [Sun Aug 28 20:27:52 2022] HEAD /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/0b61c7d15485463eb91819dc15bb24e8/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:52.620465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:52.639212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402652a9-b094-4856-aa6c-96d66e7fac4a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:52.647846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:52.649007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:52.650289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:52.650844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/0b61c7d15485463eb91819dc15bb24e8/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:52.654625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=0b61c7d15485463eb91819dc15bb24e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:52.658062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:52.686538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 0b61c7d15485463eb91819dc15bb24e8 was removed from user a0de3eceb0f5435d8a262626f142d1d3 on project 0523244d1b814ad7b93f2d92b460d4bb. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:52.688548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:52.691275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:52.906464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:52.906920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3515/7013] 10.222.0.78 () {58 vars in 1566 bytes} [Sun Aug 28 20:27:52 2022] DELETE /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/0b61c7d15485463eb91819dc15bb24e8/inherited_to_projects => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:52.908249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:52.927329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07a645-ae92-4297-93e8-9e4f7fc3570a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:53.021621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:53.028532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:53.028532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:53.028532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles/0b61c7d15485463eb91819dc15bb24e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:53.028532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0b61c7d15485463eb91819dc15bb24e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:53.028532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:53.227743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 0b61c7d15485463eb91819dc15bb24e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:53.228387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:53.228964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:53.232361 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3499/7014] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:52 2022] DELETE /identity/v3/roles/0b61c7d15485463eb91819dc15bb24e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:53.236581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:53.249044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f7c8-19b0-450c-a6dc-ff50a14fbcba tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:53.390268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:53.390268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:53.390268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:53.390625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:53.390625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:53.390625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:53.576335 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3516/7015] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:27:53 2022] POST /identity/v3/roles => generated 240 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:53.580990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:53.584931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:53.656137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e2f7-8d49-4595-9949-13b6226e463c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:53.675311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:53.678816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:53.681250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:53.681801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/434fa10bdcdb4e618533525589fed57a/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:53.709792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, group_id=da59bfae736d4486bbafcc5681dd9e62, role_id=434fa10bdcdb4e618533525589fed57a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:53.717427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:53.965080 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3500/7016] 10.222.0.78 () {60 vars in 1582 bytes} [Sun Aug 28 20:27:53 2022] PUT /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/434fa10bdcdb4e618533525589fed57a/inherited_to_projects => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:53.969298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:53.995797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab483f-f5ed-4214-b511-176fb6c8ec64 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:54.087187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:54.088559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:54.088858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:54.089143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:54.092237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a6e0c2de621e4de7bc629659f5cc8846, group_id=da59bfae736d4486bbafcc5681dd9e62)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:54.095983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:54.117129 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3517/7017] 10.222.0.78 () {58 vars in 1464 bytes} [Sun Aug 28 20:27:53 2022] GET /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/inherited_to_projects => generated 448 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:54.118935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:54.134914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40608cb-e167-4564-bf52-e286bb848fc9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:54.140148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:54.140835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:54.141313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:54.141803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/434fa10bdcdb4e618533525589fed57a/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:54.144397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, group_id=da59bfae736d4486bbafcc5681dd9e62, role_id=434fa10bdcdb4e618533525589fed57a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:54.148117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:54.157273 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3501/7018] 10.222.0.78 () {58 vars in 1564 bytes} [Sun Aug 28 20:27:54 2022] HEAD /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/434fa10bdcdb4e618533525589fed57a/inherited_to_projects => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:54.161840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:54.177434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab274e1c-c912-4754-b6aa-f454b6b8678d tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:54.189598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:54.190630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:54.191014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:54.191345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/434fa10bdcdb4e618533525589fed57a/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:54.197015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, group_id=da59bfae736d4486bbafcc5681dd9e62, role_id=434fa10bdcdb4e618533525589fed57a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:54.212461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:54.220413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 434fa10bdcdb4e618533525589fed57a was removed from group da59bfae736d4486bbafcc5681dd9e62 on domain a6e0c2de621e4de7bc629659f5cc8846. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:54.220715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:54.221766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:54.312393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3518/7019] 10.222.0.78 () {58 vars in 1566 bytes} [Sun Aug 28 20:27:54 2022] DELETE /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/groups/da59bfae736d4486bbafcc5681dd9e62/roles/434fa10bdcdb4e618533525589fed57a/inherited_to_projects => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:54.316319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:54.318509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:54.334976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e5b28-c8fb-4d86-9933-7babc50f464c tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:54.423971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:54.425000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:54.425507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:54.426059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles/434fa10bdcdb4e618533525589fed57a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:54.428247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_role(role_id=434fa10bdcdb4e618533525589fed57a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:54.430319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:54.597181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 434fa10bdcdb4e618533525589fed57a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:54.597590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:54.598579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:54.600573 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3502/7020] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:54 2022] DELETE /identity/v3/roles/434fa10bdcdb4e618533525589fed57a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:54.606258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:54.639256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720deda-692b-45f1-ad82-6cae1ee3aabf tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:54.762470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:54.763115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:54.763374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:54.763637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:54.764326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:54.765989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:54.942798 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3519/7021] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:27:54 2022] POST /identity/v3/roles => generated 240 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:54.947816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:54.949281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:54.964454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee0f4f-f1d9-4e46-ad91-df6f84fc8680 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:54.971209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:54.972216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:54.972600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:54.972975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/da471dcac5d347b68e032f724d685319/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:54.976388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=da471dcac5d347b68e032f724d685319)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:54.979433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:55.088235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:55.168998 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3503/7022] 10.222.0.78 () {60 vars in 1579 bytes} [Sun Aug 28 20:27:54 2022] PUT /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/da471dcac5d347b68e032f724d685319/inherited_to_projects => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:55.173566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:55.187818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c99c6-ad44-4537-9735-bd64fc688da4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:55.268571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:55.298437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:55.299132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:55.299416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:55.299908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:55.313649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a6e0c2de621e4de7bc629659f5cc8846, user_id=a0de3eceb0f5435d8a262626f142d1d3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:55.317513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:55.342617 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3520/7023] 10.222.0.78 () {58 vars in 1461 bytes} [Sun Aug 28 20:27:55 2022] GET /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/inherited_to_projects => generated 447 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:55.345153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:55.363481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc154f8f-1f6d-417f-bfc0-86de66b6934a tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:55.369654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:55.370526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:55.370891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:55.371425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/da471dcac5d347b68e032f724d685319/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:55.379162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=da471dcac5d347b68e032f724d685319)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:55.384627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:55.392397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3504/7024] 10.222.0.78 () {58 vars in 1561 bytes} [Sun Aug 28 20:27:55 2022] HEAD /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/da471dcac5d347b68e032f724d685319/inherited_to_projects => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:55.396891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:55.415348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf10832-e076-4e0a-ba0a-18e139caab12 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:55.423248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:55.428136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:55.428136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:55.428136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/da471dcac5d347b68e032f724d685319/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:55.428136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=da471dcac5d347b68e032f724d685319)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:55.431099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:55.437598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role da471dcac5d347b68e032f724d685319 was removed from user a0de3eceb0f5435d8a262626f142d1d3 on domain a6e0c2de621e4de7bc629659f5cc8846. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:55.438045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:55.438790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:55.671135 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3521/7025] 10.222.0.78 () {58 vars in 1563 bytes} [Sun Aug 28 20:27:55 2022] DELETE /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/da471dcac5d347b68e032f724d685319/inherited_to_projects => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:55.675331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:55.677368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:55.698633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b0b0e-be9d-4320-8f34-ec1d9a2630b2 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:55.825933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:55.826770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:55.827069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:55.827499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles/da471dcac5d347b68e032f724d685319` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:55.829185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_role(role_id=da471dcac5d347b68e032f724d685319)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:55.855343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:56.000888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role da471dcac5d347b68e032f724d685319 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:56.001624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:56.002745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:56.014550 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3505/7026] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:55 2022] DELETE /identity/v3/roles/da471dcac5d347b68e032f724d685319 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:56.015253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:56.029024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f53e0-7a6c-4ec6-9f05-1da084acfd88 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:56.122197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:56.123024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:56.123288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:56.123771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:56.124529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:56.127033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:56.276743 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3522/7027] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:27:56 2022] POST /identity/v3/roles => generated 239 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:27:56.281550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:56.283749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:56.302521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676cd65-10eb-468f-836e-46f4f705ad75 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:56.310959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:56.310959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:56.310959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:56.311696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:56.313789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:56.316062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:56.558669 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3506/7028] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:56 2022] POST /identity/v3/projects => generated 409 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:56.563081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:56.579477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c160-fb15-456b-9dbe-c5d7223a280e tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:56.677221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:56.678164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:56.679475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:56.679924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/10481cedcb294712a92972147f71f0ae/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:56.682871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=10481cedcb294712a92972147f71f0ae)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:56.686765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:56.870088 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3523/7029] 10.222.0.78 () {60 vars in 1579 bytes} [Sun Aug 28 20:27:56 2022] PUT /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/10481cedcb294712a92972147f71f0ae/inherited_to_projects => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:56.870810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:56.883726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7636b-e12c-4ecd-88e3-0b9e5982f1fe tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:57.004570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:57.005636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:57.006145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:57.006616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:57.008223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Adding query filter params (scope.project.id=0523244d1b814ad7b93f2d92b460d4bb, user.id=a0de3eceb0f5435d8a262626f142d1d3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:57.008822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:57.010929 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:57.095722 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3507/7030] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:27:56 2022] GET /identity/v3/role_assignments?scope.project.id=0523244d1b814ad7b93f2d92b460d4bb&user.id=a0de3eceb0f5435d8a262626f142d1d3&effective => generated 648 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:57.100609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:57.117176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91086-6b9e-4248-a8e3-9fa5a76135c7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:57.122996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:57.123658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:57.123918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:57.124201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:57.126005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Adding query filter params (scope.project.id=407fd393bb1f4ee38369f1d49eccb822, user.id=a0de3eceb0f5435d8a262626f142d1d3) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:57.126364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:57.128396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:57.213001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3524/7031] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:27:57 2022] GET /identity/v3/role_assignments?scope.project.id=407fd393bb1f4ee38369f1d49eccb822&user.id=a0de3eceb0f5435d8a262626f142d1d3&effective => generated 648 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:57.213429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:57.231480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b83f6-e333-459b-89ca-3fe71f3519c6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:57.247940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:57.248714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:57.249554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:57.249678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/10481cedcb294712a92972147f71f0ae/inherited_to_projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:57.252220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a6e0c2de621e4de7bc629659f5cc8846, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=10481cedcb294712a92972147f71f0ae)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:57.255268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:57.270082 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 10481cedcb294712a92972147f71f0ae was removed from user a0de3eceb0f5435d8a262626f142d1d3 on domain a6e0c2de621e4de7bc629659f5cc8846. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:57.270810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:57.271743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:57.385440 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3508/7032] 10.222.0.78 () {58 vars in 1563 bytes} [Sun Aug 28 20:27:57 2022] DELETE /identity/v3/OS-INHERIT/domains/a6e0c2de621e4de7bc629659f5cc8846/users/a0de3eceb0f5435d8a262626f142d1d3/roles/10481cedcb294712a92972147f71f0ae/inherited_to_projects => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:57.389540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:57.394626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:57.431544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07954b-99d0-42d7-9d75-e6f18770bf13 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:57.589763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:57.590552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:57.590817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:57.591100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:57.591853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Adding query filter params (scope.project.id=0523244d1b814ad7b93f2d92b460d4bb, user.id=a0de3eceb0f5435d8a262626f142d1d3) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:57.592175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:57.594359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:57.717957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3525/7033] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:27:57 2022] GET /identity/v3/role_assignments?scope.project.id=0523244d1b814ad7b93f2d92b460d4bb&user.id=a0de3eceb0f5435d8a262626f142d1d3&effective => generated 228 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:57.721718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:57.739403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984a34-c583-401f-b5a0-ee979fa8470b tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:57.751632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:57.752578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:57.753666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:57.753833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:57.755807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Adding query filter params (scope.project.id=407fd393bb1f4ee38369f1d49eccb822, user.id=a0de3eceb0f5435d8a262626f142d1d3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:57.756435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:57.759971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:57.856119 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3509/7034] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:27:57 2022] GET /identity/v3/role_assignments?scope.project.id=407fd393bb1f4ee38369f1d49eccb822&user.id=a0de3eceb0f5435d8a262626f142d1d3&effective => generated 228 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:27:57.856936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:57.870481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5436-0a9c-418a-99b0-667fa5e55e04 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:57.879296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:57.881396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:57.881396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:57.883105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/projects/407fd393bb1f4ee38369f1d49eccb822` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:57.884822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_project(project_id=407fd393bb1f4ee38369f1d49eccb822)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:57.889372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:58.161625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407fd393bb1f4ee38369f1d49eccb822', 'request_id': 'req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.168227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407fd393bb1f4ee38369f1d49eccb822', 'request_id': 'req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.176312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407fd393bb1f4ee38369f1d49eccb822', 'request_id': 'req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.329146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] The token cache is being invalidate because project 407fd393bb1f4ee38369f1d49eccb822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:58.330043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.331618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.344415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3526/7035] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:27:57 2022] DELETE /identity/v3/projects/407fd393bb1f4ee38369f1d49eccb822 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:58.345687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:58.348326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:58.383901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258aa89e-d294-4e41-a156-660bd56e34e6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:58.529648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:58.531448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:58.531885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:58.532304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles/10481cedcb294712a92972147f71f0ae` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:58.534404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_role(role_id=10481cedcb294712a92972147f71f0ae)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:58.536708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:58.555098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:58.724283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 10481cedcb294712a92972147f71f0ae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:58.729720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.729720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:58.731899 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3510/7036] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:58 2022] DELETE /identity/v3/roles/10481cedcb294712a92972147f71f0ae => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:58.737153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:58.756987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe60bc-d496-4a5e-ad5e-ecc770e683b9 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:58.858924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:58.919755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:58.920552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:58.921245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:58.921369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:58.922056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:58.923703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:59.065926 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3527/7037] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:27:58 2022] POST /identity/v3/roles => generated 239 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:27:59.066192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:59.068537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:59.102348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540d73b-ff64-4543-87e1-f7bf62212a61 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:59.128257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:59.128906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:59.129195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:59.129477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:59.130333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:59.132976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:59.465744 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3511/7038] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:27:59 2022] POST /identity/v3/projects => generated 408 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:27:59.467690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:59.485310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccbacb-057a-41f8-bcdb-e77ed020eb59 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:59.629170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:59.630130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:59.631210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:59.631722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/915b567cc53a4687b42754cc05243d1e/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:59.636306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=915b567cc53a4687b42754cc05243d1e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:59.639458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:59.761801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3528/7039] 10.222.0.78 () {60 vars in 1582 bytes} [Sun Aug 28 20:27:59 2022] PUT /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/915b567cc53a4687b42754cc05243d1e/inherited_to_projects => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:59.767298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:59.784371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7b88a-3d03-447d-b02e-9c118fc40b68 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:59.977134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:59.978060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:59.978478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:59.979706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:59.979706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Adding query filter params (scope.project.id=21ad501cd80f4edebca4f9fc7eb56ed0, user.id=a0de3eceb0f5435d8a262626f142d1d3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:27:59.980517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:59.982708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:00.081725 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3512/7040] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:27:59 2022] GET /identity/v3/role_assignments?scope.project.id=21ad501cd80f4edebca4f9fc7eb56ed0&user.id=a0de3eceb0f5435d8a262626f142d1d3&effective => generated 649 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:00.086272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:00.105048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e2b0-6d24-445c-95b7-0e7a0b905ac8 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:00.112796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:00.114175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:00.114456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:00.114919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/915b567cc53a4687b42754cc05243d1e/inherited_to_projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:00.123392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0523244d1b814ad7b93f2d92b460d4bb, user_id=a0de3eceb0f5435d8a262626f142d1d3, role_id=915b567cc53a4687b42754cc05243d1e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:00.126172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:00.137074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 915b567cc53a4687b42754cc05243d1e was removed from user a0de3eceb0f5435d8a262626f142d1d3 on project 0523244d1b814ad7b93f2d92b460d4bb. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:00.137362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:00.138271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:00.256299 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3529/7041] 10.222.0.78 () {58 vars in 1566 bytes} [Sun Aug 28 20:28:00 2022] DELETE /identity/v3/OS-INHERIT/projects/0523244d1b814ad7b93f2d92b460d4bb/users/a0de3eceb0f5435d8a262626f142d1d3/roles/915b567cc53a4687b42754cc05243d1e/inherited_to_projects => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:00.262111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:00.264103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:00.288164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb3cd7-8b6f-481a-8be6-a1edd0f556ab tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:00.468246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:00.468878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:00.469161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:00.469434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:00.470317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Adding query filter params (scope.project.id=21ad501cd80f4edebca4f9fc7eb56ed0, user.id=a0de3eceb0f5435d8a262626f142d1d3) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:00.470566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:00.472498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:00.648508 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3513/7042] 10.222.0.78 () {58 vars in 1356 bytes} [Sun Aug 28 20:28:00 2022] GET /identity/v3/role_assignments?scope.project.id=21ad501cd80f4edebca4f9fc7eb56ed0&user.id=a0de3eceb0f5435d8a262626f142d1d3&effective => generated 228 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:00.653124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:00.676367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa2b5-bbcd-40eb-b863-67c8f8d5eec5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:00.688616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:00.689097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:00.690228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:00.690509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/projects/21ad501cd80f4edebca4f9fc7eb56ed0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:00.696550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21ad501cd80f4edebca4f9fc7eb56ed0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:00.700341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:00.936448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ad501cd80f4edebca4f9fc7eb56ed0', 'request_id': 'req-71649238-228b-405b-9ce8-6611a94026d4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:00.944441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ad501cd80f4edebca4f9fc7eb56ed0', 'request_id': 'req-71649238-228b-405b-9ce8-6611a94026d4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:00.963997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ad501cd80f4edebca4f9fc7eb56ed0', 'request_id': 'req-71649238-228b-405b-9ce8-6611a94026d4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.079691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] The token cache is being invalidate because project 21ad501cd80f4edebca4f9fc7eb56ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:01.080639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.084368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.101792 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3530/7043] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:00 2022] DELETE /identity/v3/projects/21ad501cd80f4edebca4f9fc7eb56ed0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:01.103584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:01.105167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:01.133309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e748-08a4-499c-959f-d8c6a7573ef5 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:01.264732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:01.265391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:01.265676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:01.265993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/roles/915b567cc53a4687b42754cc05243d1e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:01.267453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_role(role_id=915b567cc53a4687b42754cc05243d1e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:01.269664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:01.414379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invalidating the token cache because role 915b567cc53a4687b42754cc05243d1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:01.414758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.416050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.419370 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3514/7044] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:01 2022] DELETE /identity/v3/roles/915b567cc53a4687b42754cc05243d1e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:01.428727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:01.452224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71649238-228b-405b-9ce8-6611a94026d4 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:01.549081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:01.553507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:01.553507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:01.553507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/users/a0de3eceb0f5435d8a262626f142d1d3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:01.553507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a0de3eceb0f5435d8a262626f142d1d3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:01.559918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:01.795907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0de3eceb0f5435d8a262626f142d1d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.810918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0de3eceb0f5435d8a262626f142d1d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.827230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0de3eceb0f5435d8a262626f142d1d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.829593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0de3eceb0f5435d8a262626f142d1d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.830874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0de3eceb0f5435d8a262626f142d1d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:01.906414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:01.927671 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3531/7045] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:01 2022] DELETE /identity/v3/users/a0de3eceb0f5435d8a262626f142d1d3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:01.932515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:01.934261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:01.974890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ad32-2f49-4d64-b055-5bd7aa4274f6 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:02.105665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:02.123787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:02.124439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:02.124727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:02.125175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/groups/da59bfae736d4486bbafcc5681dd9e62` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:02.126519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_group(group_id=da59bfae736d4486bbafcc5681dd9e62)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:02.128950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:02.271108 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3515/7046] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:28:01 2022] DELETE /identity/v3/groups/da59bfae736d4486bbafcc5681dd9e62 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:02.272789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:02.274397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:02.287983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27454c7-4ae8-476f-afcf-021db86c7ae0 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:02.377768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:02.378507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:02.378790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:02.379122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/projects/0523244d1b814ad7b93f2d92b460d4bb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:02.380503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0523244d1b814ad7b93f2d92b460d4bb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:02.382663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:02.542767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0523244d1b814ad7b93f2d92b460d4bb', 'request_id': 'req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.548262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0523244d1b814ad7b93f2d92b460d4bb', 'request_id': 'req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.554690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0523244d1b814ad7b93f2d92b460d4bb', 'request_id': 'req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.665657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] The token cache is being invalidate because project 0523244d1b814ad7b93f2d92b460d4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:02.666057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.666795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.668295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3532/7047] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:02 2022] DELETE /identity/v3/projects/0523244d1b814ad7b93f2d92b460d4bb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:02.672372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:02.674113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:02.687064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92f763-b0d6-4ec2-bd37-4e670a2eb8cb tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:02.772685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:02.774172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:02.774499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:02.774741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/domains/a6e0c2de621e4de7bc629659f5cc8846` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:02.776034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a6e0c2de621e4de7bc629659f5cc8846)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:02.777885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:02.801727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.802754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.922839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.923352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:02.926241 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3516/7048] 10.222.0.78 () {60 vars in 1249 bytes} [Sun Aug 28 20:28:02 2022] PATCH /identity/v3/domains/a6e0c2de621e4de7bc629659f5cc8846 => generated 278 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:02.930864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:02.949273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbe6e4-5a89-4df5-a81e-bc7c5f6804df tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:03.077029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a116e908eb794c749708ecf7c5c8089b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00337d62bc344083b64a9f07360170f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:03.077695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:03.078007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:03.078288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] PATH_INFO: `/v3/domains/a6e0c2de621e4de7bc629659f5cc8846` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:03.095848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a6e0c2de621e4de7bc629659f5cc8846)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:03.096584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:03.122607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.126557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.290652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846', 'request_id': 'req-4abbf452-4db4-46c6-af9f-170fd5b182a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.305675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846', 'request_id': 'req-4abbf452-4db4-46c6-af9f-170fd5b182a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.311629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846', 'request_id': 'req-4abbf452-4db4-46c6-af9f-170fd5b182a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.392347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] The token cache is being invalidate because project a6e0c2de621e4de7bc629659f5cc8846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:03.392922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.394186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.419386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846', 'request_id': 'req-4abbf452-4db4-46c6-af9f-170fd5b182a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.420367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846', 'request_id': 'req-4abbf452-4db4-46c6-af9f-170fd5b182a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.436514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4abbf452-4db4-46c6-af9f-170fd5b182a7 tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a6e0c2de621e4de7bc629659f5cc8846', 'request_id': 'req-4abbf452-4db4-46c6-af9f-170fd5b182a7'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:03.445304 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3533/7049] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:28:02 2022] DELETE /identity/v3/domains/a6e0c2de621e4de7bc629659f5cc8846 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:03.449677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:03.452849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:03.617883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d77583-3755-4da8-8168-0cdb5feb9aac tempest-InheritsV3TestJSON-1435182453 tempest-InheritsV3TestJSON-1435182453-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:03.702356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:03.703347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:03.703892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:03.704324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] PATH_INFO: `/v3/users/50c1f2c921e04231bb88d2851ec3d10a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:03.705884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c1f2c921e04231bb88d2851ec3d10a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:03.708905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:04.059697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c1f2c921e04231bb88d2851ec3d10a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:04.060605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c1f2c921e04231bb88d2851ec3d10a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:04.218726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c1f2c921e04231bb88d2851ec3d10a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:04.230881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c1f2c921e04231bb88d2851ec3d10a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:04.232210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c1f2c921e04231bb88d2851ec3d10a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:04.262474 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3517/7050] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:03 2022] DELETE /identity/v3/users/50c1f2c921e04231bb88d2851ec3d10a => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:04.266729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:04.267015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:04.267460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:04.315275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:04.316218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:04.409403 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3534/7051] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:04.414032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:04.415762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:04.515279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919742c-07f0-49b1-880f-5b933bbadc79 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:04.524692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:04.524692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:04.524692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:04.524692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:04.535035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:04.537786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:04.561758 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3518/7052] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:05.477590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:05.586716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:05.588913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:05.603178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88058-1e58-4b1b-8aad-1916e93621b0 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:05.609118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:05.610228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:05.610674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:05.611130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] PATH_INFO: `/v3/projects/25ef552906f944f3a999c74c11467f4e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:05.612674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ef552906f944f3a999c74c11467f4e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:05.615149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:05.754171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ef552906f944f3a999c74c11467f4e', 'request_id': 'req-714f0470-ae98-4afd-98eb-b839c70fc8e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:05.760775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ef552906f944f3a999c74c11467f4e', 'request_id': 'req-714f0470-ae98-4afd-98eb-b839c70fc8e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:05.768159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ef552906f944f3a999c74c11467f4e', 'request_id': 'req-714f0470-ae98-4afd-98eb-b839c70fc8e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:05.922296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] The token cache is being invalidate because project 25ef552906f944f3a999c74c11467f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:05.922777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:05.923666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:05.925708 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3535/7053] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:05 2022] DELETE /identity/v3/projects/25ef552906f944f3a999c74c11467f4e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:05.930577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:05.941137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebd73-7f95-473a-8b95-b3dbbe5b83fd service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:06.018309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:06.019534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:06.020073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:06.021501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:06.022373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] PATH_INFO: `/v3/users/a116e908eb794c749708ecf7c5c8089b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:06.031343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a116e908eb794c749708ecf7c5c8089b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:06.031343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:06.278058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a116e908eb794c749708ecf7c5c8089b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:06.279553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a116e908eb794c749708ecf7c5c8089b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:06.380694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a116e908eb794c749708ecf7c5c8089b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:06.389397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a116e908eb794c749708ecf7c5c8089b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:06.390350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-394fdb49-782a-44f1-91a2-21c1be834465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a116e908eb794c749708ecf7c5c8089b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:06.420397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3519/7054] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:05 2022] DELETE /identity/v3/users/a116e908eb794c749708ecf7c5c8089b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:06.967944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:07.061884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:07.063363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:07.078031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0470-ae98-4afd-98eb-b839c70fc8e0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:07.177682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:07.178696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:07.179290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:07.179788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] PATH_INFO: `/v3/projects/00337d62bc344083b64a9f07360170f2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:07.181503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=00337d62bc344083b64a9f07360170f2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:07.183898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:07.329627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00337d62bc344083b64a9f07360170f2', 'request_id': 'req-903595cf-cbfc-4489-bf75-965653276cbb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:07.337371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00337d62bc344083b64a9f07360170f2', 'request_id': 'req-903595cf-cbfc-4489-bf75-965653276cbb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:07.348230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00337d62bc344083b64a9f07360170f2', 'request_id': 'req-903595cf-cbfc-4489-bf75-965653276cbb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:07.439564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] The token cache is being invalidate because project 00337d62bc344083b64a9f07360170f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:07.439866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:07.442065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-903595cf-cbfc-4489-bf75-965653276cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:07.445672 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3536/7055] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:07 2022] DELETE /identity/v3/projects/00337d62bc344083b64a9f07360170f2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:07.450746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:07.451038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:07.451339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:07.495794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:07.497218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:07.586412 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3520/7056] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:07.594684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:07.594964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:07.595246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:07.617312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:07.621638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:07.627189 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3537/7057] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:07.631774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:07.644382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e334e22-a145-4a15-b12c-f439103fe702 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:07.651028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:07.651663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:07.651947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:07.652223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:07.652886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:07.653198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:07.654883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:07.668483 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3521/7058] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:07.673270 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:07.683940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7de21-a825-42e4-b763-3d0552b24bff None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:07.689553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:07.690710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:07.691068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:07.691441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:07.706217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:07.708992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:07.862825 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3538/7059] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:07 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:07.867730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:07.878812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019539bd-072a-4d15-9cbf-24945a3094a5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:07.928771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:08.013647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:08.016218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.016727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.017607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.018915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:08.021237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:08.049280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:08.144462 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3522/7060] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:07 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:08.152933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:08.166255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae33c-f3a2-4fd0-a544-f5391566f009 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:08.171820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:08.182639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.182639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.182639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.182639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:08.182639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:08.223205 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3539/7061] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:08.232014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:08.242727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:08.244861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:08.258395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ddf85-3bdd-47c8-a886-c06daf544dab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:08.291718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:08.300116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.300433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.301141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.301825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:08.306130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:08.331335 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3523/7062] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:08.332572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:08.354318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b5fb9-cb4b-4177-8c52-20b55cff9acb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:08.370555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48eebb-7402-4f56-8811-4891aecbbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:08.371365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48eebb-7402-4f56-8811-4891aecbbe63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.371650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48eebb-7402-4f56-8811-4891aecbbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.371933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48eebb-7402-4f56-8811-4891aecbbe63 admin admin] PATH_INFO: `/v3/projects/902f2c37a948404d8d480c6cd06384ab/users/6af16245c1a14421bb40187a0fe8d9c3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.409969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48eebb-7402-4f56-8811-4891aecbbe63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902f2c37a948404d8d480c6cd06384ab, user_id=6af16245c1a14421bb40187a0fe8d9c3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:08.412601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48eebb-7402-4f56-8811-4891aecbbe63 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:08.510621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3524/7063] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:08 2022] PUT /identity/v3/projects/902f2c37a948404d8d480c6cd06384ab/users/6af16245c1a14421bb40187a0fe8d9c3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:08.524069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.524448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.524899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.544932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d688e2-d687-4e72-b517-87ca9276a42a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:08.585738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] MFA Rules not processed for user `6af16245c1a14421bb40187a0fe8d9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:08.587455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:08.713151 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3525/7064] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:08.718236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:08.779690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:08.780811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.781302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.782008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.785462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:08.827398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15d16-97a5-4024-bd3d-a14e3b2d0826 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:08.834928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:08.836529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:08.837056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:08.837694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:08.839063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:08.842171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:08.890697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:08.892841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:08.907743 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3540/7065] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:08 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:28:09.152639 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3526/7066] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:09.155154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:09.186778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83739b81-38dc-411f-a58d-a922741ec4a8 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:09.373962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:09.374504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:09.375007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:09.375282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:09.376089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:09.377955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:09.530859 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3541/7067] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:09 2022] POST /identity/v3/users => generated 290 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:09.540016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:09.551343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ed14-c6ae-423b-914c-73bee1f584e8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:09.585348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:09.586020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:09.586313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:09.586597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:09.606139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:09.606139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:09.645906 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3527/7068] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:09.648626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:09.664648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd7c7-1f64-40aa-a98d-20193e154a90 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:09.681901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:09.682616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:09.682982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:09.683183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] PATH_INFO: `/v3/projects/c275883d98884a6583cd895874eb82db/users/5f816c4ee6654a02b73655223e94a11c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:09.711758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c275883d98884a6583cd895874eb82db, user_id=5f816c4ee6654a02b73655223e94a11c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:09.714838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:09.727905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:09.866507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:09.888560 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3542/7069] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:09 2022] PUT /identity/v3/projects/c275883d98884a6583cd895874eb82db/users/5f816c4ee6654a02b73655223e94a11c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:09.892631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:09.915020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113d3a8-a7bb-4a3f-bab4-385723e1e54c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:10.111578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e4e4-86a9-4340-b509-49c80af8bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:10.113534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e4e4-86a9-4340-b509-49c80af8bb0a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:10.114106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e4e4-86a9-4340-b509-49c80af8bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:10.115337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e4e4-86a9-4340-b509-49c80af8bb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:10.116471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e4e4-86a9-4340-b509-49c80af8bb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:10.118965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e4e4-86a9-4340-b509-49c80af8bb0a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:10.138340 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3528/7070] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:10.143697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:10.161973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5537b-5680-4c96-b47f-89fdea3c41dd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:10.174448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:10.174448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:10.174448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:10.174448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] PATH_INFO: `/v3/projects/c275883d98884a6583cd895874eb82db/users/5f816c4ee6654a02b73655223e94a11c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:10.176722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c275883d98884a6583cd895874eb82db, user_id=5f816c4ee6654a02b73655223e94a11c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:10.181223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:10.195458 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3543/7071] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:10 2022] PUT /identity/v3/projects/c275883d98884a6583cd895874eb82db/users/5f816c4ee6654a02b73655223e94a11c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:10.209225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:10.216695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:10.216695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:10.284349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] MFA Rules not processed for user `5f816c4ee6654a02b73655223e94a11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:10.287271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:10.464762 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3529/7072] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:10.469015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:10.485076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b198f8-5d47-4941-87dd-0a0d7e478e0c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:10.501403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:10.502068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:10.502352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:10.502627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:10.504319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:10.505414 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:28:10.505414 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:28:10.505414 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:28:10.506367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:10.695949 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3544/7073] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:28:10 2022] POST /identity/v3/regions => generated 224 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:10.701285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:10.712653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71ccb-5056-475b-9e66-ac3faea701eb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:10.759770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:10.760739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:10.761198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:10.761666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:10.762686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:10.764143 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:28:10.764143 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:28:10.764143 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:28:10.766989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:10.934539 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3530/7074] 10.222.0.78 () {60 vars in 1149 bytes} [Sun Aug 28 20:28:10 2022] POST /identity/v3/regions => generated 223 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:10.939584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:10.957638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f518-a75e-46d6-9ba7-8bdf71f90a72 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:10.979579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:10.980551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:10.981011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:10.981503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/0678499a-d02b-4f9a-b188-ac8eed1487f4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:10.982944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:create_region(region_id=0678499a-d02b-4f9a-b188-ac8eed1487f4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:10.985183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:11.152679 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3545/7075] 10.222.0.78 () {60 vars in 1259 bytes} [Sun Aug 28 20:28:10 2022] PUT /identity/v3/regions/0678499a-d02b-4f9a-b188-ac8eed1487f4 => generated 231 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:11.154201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:11.182241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ca192-de23-4fc0-b209-503a0e802b2e tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:11.213637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:11.215889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:11.216403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:11.217021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/0678499a-d02b-4f9a-b188-ac8eed1487f4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:11.218087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0678499a-d02b-4f9a-b188-ac8eed1487f4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:11.221015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:11.389455 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3531/7076] 10.222.0.78 () {58 vars in 1242 bytes} [Sun Aug 28 20:28:11 2022] DELETE /identity/v3/regions/0678499a-d02b-4f9a-b188-ac8eed1487f4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:11.395039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:11.407895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979433-3ab3-4baa-b659-e383611a16bf tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:11.428111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:11.428815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:11.429249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:11.429599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:11.430556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:11.432348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:11.633920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3546/7077] 10.222.0.78 () {60 vars in 1150 bytes} [Sun Aug 28 20:28:11 2022] POST /identity/v3/regions => generated 253 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:11.637587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:11.654065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ca9cc-8094-4897-aeef-fe760b7c9d66 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:11.701816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:11.704414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:11.704414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:11.704414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/130353b6a46a46c2af1484edf0bde0ce` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:11.709526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:update_region(region_id=130353b6a46a46c2af1484edf0bde0ce)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:11.710998 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:28:11.710998 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:28:11.710998 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:28:11.712186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:11.920289 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3532/7078] 10.222.0.78 () {60 vars in 1250 bytes} [Sun Aug 28 20:28:11 2022] PATCH /identity/v3/regions/130353b6a46a46c2af1484edf0bde0ce => generated 254 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:11.925557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:11.934945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:11.941796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91562-30ab-44d6-b26f-f54aca73a8fe tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:11.979695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:11.980327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:11.980807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:11.981246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/130353b6a46a46c2af1484edf0bde0ce` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:11.982061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:get_region(region_id=130353b6a46a46c2af1484edf0bde0ce)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:11.983311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.003655 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3547/7079] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:28:11 2022] GET /identity/v3/regions/130353b6a46a46c2af1484edf0bde0ce => generated 254 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:12.008076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.036805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da75dc-7654-453e-b521-d6dcd823ba88 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.053816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.058914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.061416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.062730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/130353b6a46a46c2af1484edf0bde0ce` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.063501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:delete_region(region_id=130353b6a46a46c2af1484edf0bde0ce)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.075421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.075864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:12.209819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3533/7080] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:28:12 2022] DELETE /identity/v3/regions/130353b6a46a46c2af1484edf0bde0ce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:12.214354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.236148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7276b-6aea-48bc-980d-24284a035735 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.266696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.267608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.268049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.268621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.269384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.270690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.285923 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3548/7081] 10.222.0.78 () {58 vars in 1128 bytes} [Sun Aug 28 20:28:12 2022] GET /identity/v3/regions => generated 669 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:12.290691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.304840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92afe-56a0-498e-b2ff-b63dc4511357 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.336903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.337883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.338345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.338802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/130353b6a46a46c2af1484edf0bde0ce` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.339562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:delete_region(region_id=130353b6a46a46c2af1484edf0bde0ce)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.341343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Could not find region: 130353b6a46a46c2af1484edf0bde0ce.: keystone.exception.RegionNotFound: Could not find region: 130353b6a46a46c2af1484edf0bde0ce. Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 130353b6a46a46c2af1484edf0bde0ce. Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:12.369193 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 130353b6a46a46c2af1484edf0bde0ce. Aug 28 20:28:12.370655 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:12.373342 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3534/7082] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:28:12 2022] DELETE /identity/v3/regions/130353b6a46a46c2af1484edf0bde0ce => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:12.378907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.395820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd5a7-652b-4d97-8ace-c13326d3f8f1 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.411591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.412615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.413904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.414420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.418614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.420082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.436733 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3549/7083] 10.222.0.78 () {58 vars in 1128 bytes} [Sun Aug 28 20:28:12 2022] GET /identity/v3/regions => generated 669 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:12.441622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.473716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53b37-f84b-4133-b387-e37dc7ef2d95 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.496409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.497270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.497763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.498251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.499106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.500901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.631408 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3535/7084] 10.222.0.78 () {60 vars in 1150 bytes} [Sun Aug 28 20:28:12 2022] POST /identity/v3/regions => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:12.633300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.652419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c486369-6390-412c-8389-a28e8957c451 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.680857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.681466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.682169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.682640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.683281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Adding query filter params (parent_region_id=21d77e3621ac40a7a67ff6669fa69e39) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:12.683590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.684803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.700340 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3550/7085] 10.222.0.78 () {58 vars in 1227 bytes} [Sun Aug 28 20:28:12 2022] GET /identity/v3/regions?parent_region_id=21d77e3621ac40a7a67ff6669fa69e39 => generated 400 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:12.704679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.722502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511c15-25c4-4a10-9b11-487e61246ee8 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.735777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.736762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.736931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.737443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/5dcb10991be947de8b296e39f1fbefb8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.738277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5dcb10991be947de8b296e39f1fbefb8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.740904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:12.915939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3536/7086] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:28:12 2022] DELETE /identity/v3/regions/5dcb10991be947de8b296e39f1fbefb8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:12.916039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:12.955394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1068c6-752c-44e0-88b0-eb92a0717497 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:12.988566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:12.989640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:12.990250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:12.990766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/0a70393f51e24e89b8535b4306c5931c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:12.992197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0a70393f51e24e89b8535b4306c5931c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:12.994348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:13.123393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3551/7087] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:28:12 2022] DELETE /identity/v3/regions/0a70393f51e24e89b8535b4306c5931c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:13.127681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:13.140437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feafe9a-8130-4f44-8832-13a01512b7a4 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:13.159923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779c224-155e-4352-adee-db1df2a86f35 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f816c4ee6654a02b73655223e94a11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c275883d98884a6583cd895874eb82db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:13.160577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779c224-155e-4352-adee-db1df2a86f35 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:13.160860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779c224-155e-4352-adee-db1df2a86f35 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:13.161135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779c224-155e-4352-adee-db1df2a86f35 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] PATH_INFO: `/v3/regions/21d77e3621ac40a7a67ff6669fa69e39` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:13.162953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779c224-155e-4352-adee-db1df2a86f35 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorizing `identity:delete_region(region_id=21d77e3621ac40a7a67ff6669fa69e39)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:13.165936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779c224-155e-4352-adee-db1df2a86f35 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:13.329607 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3537/7088] 10.222.0.78 () {58 vars in 1230 bytes} [Sun Aug 28 20:28:13 2022] DELETE /identity/v3/regions/21d77e3621ac40a7a67ff6669fa69e39 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:13.336129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:13.473827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0158-36e8-4bc2-9a92-2545b7331dd2 tempest-RegionsTestJSON-2049791904 tempest-RegionsTestJSON-2049791904-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:13.493525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:13.494524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:13.494858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:13.495129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] PATH_INFO: `/v3/users/6af16245c1a14421bb40187a0fe8d9c3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:13.496951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af16245c1a14421bb40187a0fe8d9c3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:13.499862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:13.793904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af16245c1a14421bb40187a0fe8d9c3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:13.821992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af16245c1a14421bb40187a0fe8d9c3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:13.858085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af16245c1a14421bb40187a0fe8d9c3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:13.858961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af16245c1a14421bb40187a0fe8d9c3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:13.863319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af16245c1a14421bb40187a0fe8d9c3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:14.112730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:14.113327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:14.113781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:14.117431 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3552/7089] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:13 2022] DELETE /identity/v3/users/6af16245c1a14421bb40187a0fe8d9c3 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:14.136363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:14.138010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:14.261565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:14.309238 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3538/7090] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:14.319062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:14.320892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:14.332590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:14.450520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6fed6-8104-41e6-a934-84d52ed5db84 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:14.454913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:14.455715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:14.456097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:14.456472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:14.468565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:14.470753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:14.482900 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3553/7091] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:15.577056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:15.578659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:15.603891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de266d9-994a-4eb3-9af4-95006e5fcfdc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:15.607870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:15.635584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:15.636593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:15.637135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:15.637627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] PATH_INFO: `/v3/projects/902f2c37a948404d8d480c6cd06384ab` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:15.641845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902f2c37a948404d8d480c6cd06384ab)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:15.645281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:15.951073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902f2c37a948404d8d480c6cd06384ab', 'request_id': 'req-de634daf-dc33-4296-a4cf-5b8897493cd3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:15.990521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902f2c37a948404d8d480c6cd06384ab', 'request_id': 'req-de634daf-dc33-4296-a4cf-5b8897493cd3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.015014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902f2c37a948404d8d480c6cd06384ab', 'request_id': 'req-de634daf-dc33-4296-a4cf-5b8897493cd3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.152461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] The token cache is being invalidate because project 902f2c37a948404d8d480c6cd06384ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:16.152981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.154313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.158950 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3539/7092] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:15 2022] DELETE /identity/v3/projects/902f2c37a948404d8d480c6cd06384ab => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:16.165381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:16.207073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022af18e-c4fe-489d-bfb8-1c120926019a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:16.264827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:16.342094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:16.343325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:16.343772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:16.344247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] PATH_INFO: `/v3/users/5f816c4ee6654a02b73655223e94a11c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:16.346025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f816c4ee6654a02b73655223e94a11c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:16.348921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:16.566721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f816c4ee6654a02b73655223e94a11c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.603020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f816c4ee6654a02b73655223e94a11c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.614383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f816c4ee6654a02b73655223e94a11c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.615504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f816c4ee6654a02b73655223e94a11c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.616572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2c114958-941e-4aa8-9bad-f20e088a861c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f816c4ee6654a02b73655223e94a11c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:16.698801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3554/7093] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:16 2022] DELETE /identity/v3/users/5f816c4ee6654a02b73655223e94a11c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:17.599368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:18.266161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:18.266161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:18.288685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634daf-dc33-4296-a4cf-5b8897493cd3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:18.368024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0bca-b489-4a30-bcac-2bc6eeaa5480 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:18.368319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0bca-b489-4a30-bcac-2bc6eeaa5480 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:18.382776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0bca-b489-4a30-bcac-2bc6eeaa5480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:18.415862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4edc0bca-b489-4a30-bcac-2bc6eeaa5480 None None] MFA Rules not processed for user `f34ef02913674b04b2822574c2c478f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:18.419524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4edc0bca-b489-4a30-bcac-2bc6eeaa5480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:18.479710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:18.480671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:18.481133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:18.481572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] PATH_INFO: `/v3/projects/c275883d98884a6583cd895874eb82db` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:18.483179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c275883d98884a6583cd895874eb82db)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:18.485349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:18.502402 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:18.659408 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3555/7094] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:18.685374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c275883d98884a6583cd895874eb82db', 'request_id': 'req-ebff465e-173b-485b-b409-79ad2aaac2b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:18.704877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c275883d98884a6583cd895874eb82db', 'request_id': 'req-ebff465e-173b-485b-b409-79ad2aaac2b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:18.723436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c275883d98884a6583cd895874eb82db', 'request_id': 'req-ebff465e-173b-485b-b409-79ad2aaac2b3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:18.780662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:18.819942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] The token cache is being invalidate because project c275883d98884a6583cd895874eb82db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:18.826021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:18.826021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ebff465e-173b-485b-b409-79ad2aaac2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:18.826021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3540/7095] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:18 2022] DELETE /identity/v3/projects/c275883d98884a6583cd895874eb82db => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:18.830074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:18.830686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:18.831130 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:18.886459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:18.887709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:19.079792 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3556/7096] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:19.087994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.089562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.089979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:19.134740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:19.137701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:19.161747 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3541/7097] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:19.166357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:19.188762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3457313-1d50-4791-864d-efab7b70fa67 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:19.199420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:19.201143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.201576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.202048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:19.202874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:19.203344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:19.205109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:19.235593 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3557/7098] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:19.240752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:19.267324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be491ca-6702-45f4-94bb-2c0a4dc0fd56 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:19.285198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:19.286622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.286941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.287217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:19.290127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:19.293663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:19.457728 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3542/7099] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:19 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:19.460517 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:19.466051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:19.470701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35c68-5e35-46fd-9cc8-77599ff79922 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:19.644743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:19.645705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.647002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.647492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:19.648531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:19.653632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:19.804273 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3558/7100] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:19 2022] POST /identity/v3/users => generated 284 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:19.805087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:19.818278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3a729-1844-4c22-b315-fbec31aa882f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:19.835499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:19.836300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.837219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.837525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:19.838535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:19.840184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:19.865742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:19.881468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c67237-9fb2-41b4-8709-ec26ea3c5fde admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:19.882789 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3543/7101] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:28:19.907917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd676-f6da-4c94-bb53-1220ef59938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:19.908552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd676-f6da-4c94-bb53-1220ef59938f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.908831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd676-f6da-4c94-bb53-1220ef59938f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.909103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd676-f6da-4c94-bb53-1220ef59938f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:19.909877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acd676-f6da-4c94-bb53-1220ef59938f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:19.911781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acd676-f6da-4c94-bb53-1220ef59938f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:19.942963 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3559/7102] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:28:19.945236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:19.959785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca23fd-9902-4ef9-a0c9-a5f99ecea72d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:19.973063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:19.974184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:19.974622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:19.975051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] PATH_INFO: `/v3/projects/fb8547b8e8064d818f0d97e0de09767b/users/a612dd11726d4934b1f41b6e02380b7a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:20.026610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8547b8e8064d818f0d97e0de09767b, user_id=a612dd11726d4934b1f41b6e02380b7a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:20.031415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:20.186632 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3544/7103] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:19 2022] PUT /identity/v3/projects/fb8547b8e8064d818f0d97e0de09767b/users/a612dd11726d4934b1f41b6e02380b7a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:20.208828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:20.208828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:20.209133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:20.269810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] MFA Rules not processed for user `a612dd11726d4934b1f41b6e02380b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:20.271141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:20.422990 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3560/7104] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:20.423391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:20.572092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc0610-4dbc-4390-a92b-625ebb5e9c54 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:20.577899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:20.578668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:20.579148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:20.579539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:20.581314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:20.583869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:20.779808 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3545/7105] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:20 2022] POST /identity/v3/projects => generated 367 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:20.781254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:20.795484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ebe9-8590-4324-80c1-1bed1054f624 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:21.068310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:21.071514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:21.072721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:21.083912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:21.085290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:21.092945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:21.281599 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3561/7106] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:20 2022] POST /identity/v3/users => generated 290 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:21.286224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:21.301273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02871f-db0b-4f1e-88a0-58d27b36019a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:21.342537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:21.343811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:21.344350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:21.346713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:21.347968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:21.355147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:21.454890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3546/7107] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:21.458072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:21.502847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:21.529537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90776-2bcf-4551-871c-4a677e5b40e4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:21.537549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:21.539781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:21.544547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:21.544547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] PATH_INFO: `/v3/projects/0f3bd454174c4682b5325447b317a82d/users/0a2316395e88441c8722a60fb38bde27/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:21.581607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3bd454174c4682b5325447b317a82d, user_id=0a2316395e88441c8722a60fb38bde27, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:21.586179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:21.714608 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3562/7108] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:21 2022] PUT /identity/v3/projects/0f3bd454174c4682b5325447b317a82d/users/0a2316395e88441c8722a60fb38bde27/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:21.718386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:21.745607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e415cdd-df95-4b9b-9931-e62d15cea876 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:21.793754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:22.055640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986227b-bf97-4abb-b2dd-bd9220706041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:22.056599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986227b-bf97-4abb-b2dd-bd9220706041 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:22.057061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986227b-bf97-4abb-b2dd-bd9220706041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:22.057515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986227b-bf97-4abb-b2dd-bd9220706041 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:22.058461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986227b-bf97-4abb-b2dd-bd9220706041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:22.060943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986227b-bf97-4abb-b2dd-bd9220706041 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:22.101211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:22.101946 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3547/7109] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:28:22.123952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705924d2-1e64-450f-9f55-21bb8c896334 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:22.140050 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:22.140746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:22.141208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:22.141635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] PATH_INFO: `/v3/projects/0f3bd454174c4682b5325447b317a82d/users/0a2316395e88441c8722a60fb38bde27/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:22.144093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3bd454174c4682b5325447b317a82d, user_id=0a2316395e88441c8722a60fb38bde27, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:22.147546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:22.173613 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3563/7110] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:22 2022] PUT /identity/v3/projects/0f3bd454174c4682b5325447b317a82d/users/0a2316395e88441c8722a60fb38bde27/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:22.191875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:22.192366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:22.192774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:22.308811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] MFA Rules not processed for user `0a2316395e88441c8722a60fb38bde27`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:22.316368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:22.509298 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3548/7111] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:22.514539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:22.528508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72169b4c-7214-429e-9077-9971667195f7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:22.538638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:22.539378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:22.539760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:22.540143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:22.541771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:22.544201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:22.735566 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3564/7112] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:22 2022] POST /identity/v3/projects => generated 328 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:22.740257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:22.755362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f6fd-b5af-43f7-954e-ee8f0baafeb3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:22.926636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:22.929381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:22.929878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:22.930354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:22.931243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:22.939290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:23.201513 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3549/7113] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:22 2022] POST /identity/v3/users => generated 416 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:23.205588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:23.221579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759f7a-e7b9-4f6d-9ad5-c66df61f17bf tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:23.236437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:23.237339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:23.238013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:23.238618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:23.240263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:23.244543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:23.434544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3565/7114] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:23 2022] POST /identity/v3/roles => generated 244 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:23.435525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:23.450476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9a50-dd7b-45bf-a07c-a4c38bd0e83e tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:23.476397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:23.477583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:23.478077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:23.478540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:23.479493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:23.481510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:23.568456 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3550/7115] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:23 2022] POST /identity/v3/roles => generated 246 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:23.575718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:23.588943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412b95-23b0-467e-b14d-56aee3013f6a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:23.595944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:23.597166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:23.597673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:23.598079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/7d9e8c0eddc849418af42ca7358c9da8/users/de183ed3e3fa497c9b3de81b403fe656/roles/766f14f21fdf441c9e684b48f9ae16f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:23.620371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d9e8c0eddc849418af42ca7358c9da8, user_id=de183ed3e3fa497c9b3de81b403fe656, role_id=766f14f21fdf441c9e684b48f9ae16f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:23.623415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:23.699079 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3566/7116] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:23 2022] PUT /identity/v3/projects/7d9e8c0eddc849418af42ca7358c9da8/users/de183ed3e3fa497c9b3de81b403fe656/roles/766f14f21fdf441c9e684b48f9ae16f7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:23.703288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:23.725834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcdb5-db7a-4bc1-9fee-ce01f8446476 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:23.730374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:23.816669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d583a-ab20-43e0-aee4-a91e9312943c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:23.817474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d583a-ab20-43e0-aee4-a91e9312943c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:23.817832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d583a-ab20-43e0-aee4-a91e9312943c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:23.818209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d583a-ab20-43e0-aee4-a91e9312943c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/7d9e8c0eddc849418af42ca7358c9da8/users/de183ed3e3fa497c9b3de81b403fe656/roles/47635467853742dca56656f9366e4345` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:23.821530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d583a-ab20-43e0-aee4-a91e9312943c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d9e8c0eddc849418af42ca7358c9da8, user_id=de183ed3e3fa497c9b3de81b403fe656, role_id=47635467853742dca56656f9366e4345)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:23.824797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d583a-ab20-43e0-aee4-a91e9312943c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:24.065196 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3551/7117] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:23 2022] PUT /identity/v3/projects/7d9e8c0eddc849418af42ca7358c9da8/users/de183ed3e3fa497c9b3de81b403fe656/roles/47635467853742dca56656f9366e4345 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:24.070672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:24.092708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb8ff-6a71-4e8d-93f0-9f2aaf9912a7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:24.272764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56e83-9535-4a3b-9d2f-c5bd96e77860 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:24.274946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56e83-9535-4a3b-9d2f-c5bd96e77860 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:24.276870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56e83-9535-4a3b-9d2f-c5bd96e77860 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:24.277312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56e83-9535-4a3b-9d2f-c5bd96e77860 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:24.278260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd56e83-9535-4a3b-9d2f-c5bd96e77860 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:24.285389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd56e83-9535-4a3b-9d2f-c5bd96e77860 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:24.366808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3567/7118] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:24 2022] GET /identity/v3/users => generated 8646 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:24.371349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:24.371832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:24.371947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:24.434267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] MFA Rules not processed for user `de183ed3e3fa497c9b3de81b403fe656`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:24.435760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:24.601466 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3552/7119] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:24.622575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:24.623083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:24.623645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:24.664058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] MFA Rules not processed for user `de183ed3e3fa497c9b3de81b403fe656`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:24.666308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:24.690066 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3568/7120] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:24.693945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:24.728154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c87ab-9389-4e07-a014-e549d64104fa None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:24.733288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de183ed3e3fa497c9b3de81b403fe656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d9e8c0eddc849418af42ca7358c9da8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1770715101', 'tempest-NotDelegatedRole-727677121'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:24.734263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:24.734768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:24.735025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:24.735908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: Authorizing `identity:create_trust()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:24.740117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:24.944059 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3553/7121] 10.222.0.78 () {60 vars in 1174 bytes} [Sun Aug 28 20:28:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:24.944714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:24.962695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88288bc9-4530-4849-8d71-03fa827beaa3 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:24.976016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:24.976583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:24.976879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:24.977227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:24.978082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:24.979151 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:28:24.979151 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:28:24.979151 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:28:24.983082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:25.006422 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3569/7122] 10.222.0.78 () {58 vars in 1155 bytes} [Sun Aug 28 20:28:24 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:25.008102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:25.024532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ca68-a679-4247-9677-7ee43dd393cc tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:25.052751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de183ed3e3fa497c9b3de81b403fe656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d9e8c0eddc849418af42ca7358c9da8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1770715101', 'tempest-NotDelegatedRole-727677121'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:25.055828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:25.056668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:25.058783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] PATH_INFO: `/v3/OS-TRUST/trusts/f0e01b52f2ae4caa82aa22e2131ea54d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:25.090453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: Authorizing `identity:delete_trust(trust_id=f0e01b52f2ae4caa82aa22e2131ea54d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:25.092051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:25.094699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:25.212425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f0e01b52f2ae4caa82aa22e2131ea54d', 'request_id': 'req-5fc1afcd-43c3-4445-9c23-6c19deece611'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:25.303277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f0e01b52f2ae4caa82aa22e2131ea54d', 'request_id': 'req-5fc1afcd-43c3-4445-9c23-6c19deece611'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:25.304553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f0e01b52f2ae4caa82aa22e2131ea54d', 'request_id': 'req-5fc1afcd-43c3-4445-9c23-6c19deece611'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:25.312417 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3554/7123] 10.222.0.78 () {58 vars in 1254 bytes} [Sun Aug 28 20:28:25 2022] DELETE /identity/v3/OS-TRUST/trusts/f0e01b52f2ae4caa82aa22e2131ea54d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:25.316440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:25.319129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:25.335525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69b37-dbcb-41a0-9b28-ffaa00447c07 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:25.341698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4beade-4bca-4ece-9688-df8ab75d4b72 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de183ed3e3fa497c9b3de81b403fe656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d9e8c0eddc849418af42ca7358c9da8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1770715101', 'tempest-NotDelegatedRole-727677121'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:25.342441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4beade-4bca-4ece-9688-df8ab75d4b72 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:25.342794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4beade-4bca-4ece-9688-df8ab75d4b72 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:25.343133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4beade-4bca-4ece-9688-df8ab75d4b72 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] PATH_INFO: `/v3/OS-TRUST/trusts/f0e01b52f2ae4caa82aa22e2131ea54d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-8a4beade-4bca-4ece-9688-df8ab75d4b72 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Could not find trust: f0e01b52f2ae4caa82aa22e2131ea54d.: keystone.exception.TrustNotFound: Could not find trust: f0e01b52f2ae4caa82aa22e2131ea54d. Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 20:28:25.383751 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: f0e01b52f2ae4caa82aa22e2131ea54d. Aug 28 20:28:25.384880 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:28:25.393482 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3570/7124] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:25 2022] GET /identity/v3/OS-TRUST/trusts/f0e01b52f2ae4caa82aa22e2131ea54d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:25.397281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:25.400729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:25.429888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1afcd-43c3-4445-9c23-6c19deece611 tempest-TrustsV3TestJSON-117246886 tempest-user-1693944425] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:25.438201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:25.438917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:25.439214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:25.439885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/47635467853742dca56656f9366e4345` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:25.441350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=47635467853742dca56656f9366e4345)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:25.443185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:25.582928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:25.583426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:25.584558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:25.615367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] MFA Rules not processed for user `eab435220eb1424985b28ec0642ef70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:25.620297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:25.666482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:25.704980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 47635467853742dca56656f9366e4345 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:25.705609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:25.706007 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3571/7125] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:25.706289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:25.714940 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3555/7126] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:25 2022] DELETE /identity/v3/roles/47635467853742dca56656f9366e4345 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:25.729700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:25.754380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5904-93d4-441a-8c34-67ab401c29f1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:25.864321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:25.865794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:25.866137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:25.866478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/766f14f21fdf441c9e684b48f9ae16f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:25.869055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=766f14f21fdf441c9e684b48f9ae16f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:25.871549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:26.156911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 766f14f21fdf441c9e684b48f9ae16f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:26.157206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.159235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.165286 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3572/7127] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:25 2022] DELETE /identity/v3/roles/766f14f21fdf441c9e684b48f9ae16f7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:26.168148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:26.170191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:26.205376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c9fa-8295-4269-9b6c-bb08a7e5156c tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:26.312983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:26.315833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:26.315833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:26.315833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users/de183ed3e3fa497c9b3de81b403fe656` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:26.322063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=de183ed3e3fa497c9b3de81b403fe656)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:26.327520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:26.643084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de183ed3e3fa497c9b3de81b403fe656'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.644167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de183ed3e3fa497c9b3de81b403fe656'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.790740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de183ed3e3fa497c9b3de81b403fe656'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.806828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de183ed3e3fa497c9b3de81b403fe656'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.814642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de183ed3e3fa497c9b3de81b403fe656'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:26.853910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3556/7128] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:26 2022] DELETE /identity/v3/users/de183ed3e3fa497c9b3de81b403fe656 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:26.857621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:26.859373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:26.876312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631eeb5-f94f-48c2-af2b-28c8789b675a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:27.045142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:27.046063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:27.046446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:27.046907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/7d9e8c0eddc849418af42ca7358c9da8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:27.048819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d9e8c0eddc849418af42ca7358c9da8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:27.051444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:27.348005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:27.495125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9e8c0eddc849418af42ca7358c9da8', 'request_id': 'req-c126d970-65c5-4bc6-8257-d2c6d572abba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:27.507496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9e8c0eddc849418af42ca7358c9da8', 'request_id': 'req-c126d970-65c5-4bc6-8257-d2c6d572abba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:27.516755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9e8c0eddc849418af42ca7358c9da8', 'request_id': 'req-c126d970-65c5-4bc6-8257-d2c6d572abba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:27.604629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] The token cache is being invalidate because project 7d9e8c0eddc849418af42ca7358c9da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:27.605034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:27.612784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:27.615138 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3573/7129] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:26 2022] DELETE /identity/v3/projects/7d9e8c0eddc849418af42ca7358c9da8 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:27.624338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:27.626253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:27.641193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9a80-2520-4fb5-ad74-d4aa5b3b77fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:27.651156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:27.739743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:27.740642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:27.741498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:27.741882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:27.742993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:27.745888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:27.900225 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3557/7130] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:27 2022] POST /identity/v3/projects => generated 329 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:27.903293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:27.904794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:27.982303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d970-65c5-4bc6-8257-d2c6d572abba tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:28.112253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:28.112898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:28.113189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:28.115106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:28.116473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:28.119733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:28.266017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:28.272153 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3574/7131] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:27 2022] POST /identity/v3/users => generated 416 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:28.289719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a0341-e40a-4918-ba09-cbb4c745a306 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:28.296782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:28.297439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:28.297777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:28.298169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:28.298898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:28.305123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:28.457520 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3558/7132] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:28 2022] POST /identity/v3/roles => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:28.461904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:28.484442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1710-0227-486d-8920-ae162e49165b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:28.497615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:28.498615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:28.499133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:28.499459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:28.501493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:28.523826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:28.671578 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3575/7133] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:28 2022] POST /identity/v3/roles => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:28.676232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:28.695264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf784e-670e-49b6-83a0-38e85620b893 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:28.709292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:28.710452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:28.711061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:28.711981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/a15f6fb2a5124ede95a52236af7ba682/users/03c7bab56ee7473e89db0507bc475eb6/roles/9c48711b9c064d42997db47aa485c67d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:28.759688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a15f6fb2a5124ede95a52236af7ba682, user_id=03c7bab56ee7473e89db0507bc475eb6, role_id=9c48711b9c064d42997db47aa485c67d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:28.765568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:28.890678 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3559/7134] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:28 2022] PUT /identity/v3/projects/a15f6fb2a5124ede95a52236af7ba682/users/03c7bab56ee7473e89db0507bc475eb6/roles/9c48711b9c064d42997db47aa485c67d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:28.896782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:28.912040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48491-2e1b-41f5-975d-9ea98c2c8899 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:29.025369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6d678-7df0-4280-a250-e216d19a0617 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:29.026441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6d678-7df0-4280-a250-e216d19a0617 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:29.030478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6d678-7df0-4280-a250-e216d19a0617 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:29.031374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6d678-7df0-4280-a250-e216d19a0617 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/a15f6fb2a5124ede95a52236af7ba682/users/03c7bab56ee7473e89db0507bc475eb6/roles/12575291a0054ef6a4f35b5322321689` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:29.051546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6d678-7df0-4280-a250-e216d19a0617 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a15f6fb2a5124ede95a52236af7ba682, user_id=03c7bab56ee7473e89db0507bc475eb6, role_id=12575291a0054ef6a4f35b5322321689)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:29.054407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6d678-7df0-4280-a250-e216d19a0617 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:29.156997 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3576/7135] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:28 2022] PUT /identity/v3/projects/a15f6fb2a5124ede95a52236af7ba682/users/03c7bab56ee7473e89db0507bc475eb6/roles/12575291a0054ef6a4f35b5322321689 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:29.163511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:29.192818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ecc54-7ab9-44f6-8b4c-3d639b62ed06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:29.392539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:29.393903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:29.393903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:29.394166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:29.394815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:29.395958 n-d-854121-7 devstack@keystone.service[82298]: WARNING py.warnings [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:28:29.395958 n-d-854121-7 devstack@keystone.service[82298]: warnings.warn(msg) Aug 28 20:28:29.395958 n-d-854121-7 devstack@keystone.service[82298]: Aug 28 20:28:29.400653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04baf8e3-5de5-4438-9b75-bc2adde845fd tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:29.488259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3560/7136] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:29 2022] GET /identity/v3/users => generated 8646 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:29.493492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:29.493788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:29.494099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:29.576642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] MFA Rules not processed for user `03c7bab56ee7473e89db0507bc475eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:29.577980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:29.638725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:UPDATE=1,keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:29.702017 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3577/7137] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:29 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:29.714184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:29.714747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:29.715225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:29.758492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] MFA Rules not processed for user `03c7bab56ee7473e89db0507bc475eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:29.760213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:29.772084 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3561/7138] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:29 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:29.776357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:29.789677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9c80-ca6b-4a9d-931c-27e2fe04a01c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:29.795203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c7bab56ee7473e89db0507bc475eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15f6fb2a5124ede95a52236af7ba682', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-93906238', 'tempest-NotDelegatedRole-1694693778'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:29.795847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:29.797761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:29.797761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:29.797761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: Authorizing `identity:create_trust()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:29.801438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:30.068263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:30.070758 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3578/7139] 10.222.0.78 () {60 vars in 1174 bytes} [Sun Aug 28 20:28:29 2022] POST /identity/v3/OS-TRUST/trusts => generated 832 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:30.083269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c99faf-7117-4150-abb5-ad612cd19c8f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:30.102935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c7bab56ee7473e89db0507bc475eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15f6fb2a5124ede95a52236af7ba682', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-93906238', 'tempest-NotDelegatedRole-1694693778'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:30.103833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:30.104122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:30.105153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:30.106230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:30.108061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:30.125791 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3562/7140] 10.222.0.78 () {58 vars in 1252 bytes} [Sun Aug 28 20:28:30 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=03c7bab56ee7473e89db0507bc475eb6 => generated 611 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:30.130230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:30.143972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8598a-903a-43ba-9225-04fc88b229ca tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:30.153010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c7bab56ee7473e89db0507bc475eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15f6fb2a5124ede95a52236af7ba682', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-93906238', 'tempest-NotDelegatedRole-1694693778'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:30.155124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:30.155975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:30.156556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] PATH_INFO: `/v3/OS-TRUST/trusts/d4fb196686604aa1a7480e5cfd3f891e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:30.177593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: Authorizing `identity:delete_trust(trust_id=d4fb196686604aa1a7480e5cfd3f891e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:30.182041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:30.300387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd4fb196686604aa1a7480e5cfd3f891e', 'request_id': 'req-253b83bf-a162-473f-bc0a-eb1730343d2d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:30.392969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd4fb196686604aa1a7480e5cfd3f891e', 'request_id': 'req-253b83bf-a162-473f-bc0a-eb1730343d2d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:30.393964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd4fb196686604aa1a7480e5cfd3f891e', 'request_id': 'req-253b83bf-a162-473f-bc0a-eb1730343d2d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:30.408177 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3579/7141] 10.222.0.78 () {58 vars in 1254 bytes} [Sun Aug 28 20:28:30 2022] DELETE /identity/v3/OS-TRUST/trusts/d4fb196686604aa1a7480e5cfd3f891e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:30.412913 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:30.422757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:30.458187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee08a5-6fff-4682-aef3-51c1c2acdcaa tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:30.469207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c7bab56ee7473e89db0507bc475eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15f6fb2a5124ede95a52236af7ba682', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-93906238', 'tempest-NotDelegatedRole-1694693778'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:30.471275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:30.471585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:30.471873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] PATH_INFO: `/v3/OS-TRUST/trusts/d4fb196686604aa1a7480e5cfd3f891e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Could not find trust: d4fb196686604aa1a7480e5cfd3f891e.: keystone.exception.TrustNotFound: Could not find trust: d4fb196686604aa1a7480e5cfd3f891e. Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 20:28:30.515789 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d4fb196686604aa1a7480e5cfd3f891e. Aug 28 20:28:30.517040 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:30.523473 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3563/7142] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:30 2022] GET /identity/v3/OS-TRUST/trusts/d4fb196686604aa1a7480e5cfd3f891e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:30.529081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:30.531098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:30.586044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b83bf-a162-473f-bc0a-eb1730343d2d tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:30.598173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:30.599126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:30.599568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:30.600003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/12575291a0054ef6a4f35b5322321689` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:30.602630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12575291a0054ef6a4f35b5322321689)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:30.604965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:31.004477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 12575291a0054ef6a4f35b5322321689 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:31.005007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:31.006045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:31.008416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3580/7143] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:30 2022] DELETE /identity/v3/roles/12575291a0054ef6a4f35b5322321689 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:31.013269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:31.015946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:31.079317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5de0a-aaa0-449f-8c6e-ca0860a91a78 tempest-TrustsV3TestJSON-1394416853 tempest-user-1413149856] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:31.149363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:31.219594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:31.220212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:31.220492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:31.222655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/9c48711b9c064d42997db47aa485c67d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:31.227891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9c48711b9c064d42997db47aa485c67d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:31.229533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:31.577053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 9c48711b9c064d42997db47aa485c67d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:31.577698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:31.578258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:31.587009 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3564/7144] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:31 2022] DELETE /identity/v3/roles/9c48711b9c064d42997db47aa485c67d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:31.591307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:31.606569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a9b62-2d5a-469a-9f00-e230e7b64c40 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:31.669247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:31.756460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:31.757263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:31.757482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:31.757686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users/03c7bab56ee7473e89db0507bc475eb6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:31.763905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=03c7bab56ee7473e89db0507bc475eb6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:31.765901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:31.974108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c7bab56ee7473e89db0507bc475eb6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.003125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c7bab56ee7473e89db0507bc475eb6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.025405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c7bab56ee7473e89db0507bc475eb6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.026841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c7bab56ee7473e89db0507bc475eb6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.027778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c7bab56ee7473e89db0507bc475eb6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.130997 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3581/7145] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:31 2022] DELETE /identity/v3/users/03c7bab56ee7473e89db0507bc475eb6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:32.135477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:32.137468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:32.166350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9deb4-a6ee-4a45-8400-c39828b3c225 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:32.312208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:32.312856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:32.313149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:32.313430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/a15f6fb2a5124ede95a52236af7ba682` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:32.314702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a15f6fb2a5124ede95a52236af7ba682)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:32.316794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:32.396366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:32.399265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:32.576735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d3e46-4b4e-46a7-91f7-1ffe2fb42989 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:32.607453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15f6fb2a5124ede95a52236af7ba682', 'request_id': 'req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.626702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15f6fb2a5124ede95a52236af7ba682', 'request_id': 'req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.643512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15f6fb2a5124ede95a52236af7ba682', 'request_id': 'req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.729286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:32.730062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:32.730408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:32.730694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] PATH_INFO: `/v3/users/c7634b791dde4a1fa4a7bef2232127a3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:32.732398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7634b791dde4a1fa4a7bef2232127a3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:32.736849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:32.830294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] The token cache is being invalidate because project a15f6fb2a5124ede95a52236af7ba682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:32.830845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.836312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:32.853990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3565/7146] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:32 2022] DELETE /identity/v3/projects/a15f6fb2a5124ede95a52236af7ba682 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:32.856388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:32.869337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:32.948575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:33.010914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8641-2e6e-44ee-b06f-1fdef2a8a0ff tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.018276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.024897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:33.025065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.025065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.025065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.025065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.025065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:33.069752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7634b791dde4a1fa4a7bef2232127a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:33.082864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7634b791dde4a1fa4a7bef2232127a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:33.091247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7634b791dde4a1fa4a7bef2232127a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:33.091942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7634b791dde4a1fa4a7bef2232127a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:33.092589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7634b791dde4a1fa4a7bef2232127a3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:33.152134 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3566/7147] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:32 2022] POST /identity/v3/projects => generated 328 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:33.158642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:33.161400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:33.206323 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3582/7148] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:32 2022] DELETE /identity/v3/users/c7634b791dde4a1fa4a7bef2232127a3 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:33.207334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:33.209098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:33.271818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772ed1-2ed5-46b4-9ead-93e652e2c844 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.337969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b80f6-73b7-46c8-a989-57cfc9990d2d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.344477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.344693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.345105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.345578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.346072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.346198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.346587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.346958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.348657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:33.348871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.351283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:33.376026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.378357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:33.434229 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3567/7149] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:33.482036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:33.487418 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3583/7150] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:33 2022] POST /identity/v3/users => generated 413 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:33.503893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb9a0d-6b06-4ec5-aa46-966118e6d518 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.525321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.526391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.526844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.527280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.528688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.530833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:33.644368 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3568/7151] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:33 2022] POST /identity/v3/roles => generated 244 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:33.648829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:33.670954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06974607-39ad-4f6d-9f8c-583aa7131d04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.679226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.679865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.680147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.680420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.681095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.682770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:33.687612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:33.689477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:33.832379 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3584/7152] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:33 2022] POST /identity/v3/roles => generated 247 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:33.834956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:33.859179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc845d-73c6-4298-b66c-738fa0ae4226 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.875591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.876296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.876539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.876850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/982420600a81450fb50fcfcca5cd0346/users/b9302cee377e46ef9f4b27d2a4404fb2/roles/6c07d15b26e74cb5af0fd653708c43a6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.883397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198a49-9426-4130-9cf8-ad75aaac8c29 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:33.898354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:33.899518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:33.900161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:33.900676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] PATH_INFO: `/v3/projects/f44ed60223d44e13a761814a201211ed` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:33.902742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44ed60223d44e13a761814a201211ed)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.914928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:33.923465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=982420600a81450fb50fcfcca5cd0346, user_id=b9302cee377e46ef9f4b27d2a4404fb2, role_id=6c07d15b26e74cb5af0fd653708c43a6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:33.928678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:34.076075 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3585/7153] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:33 2022] PUT /identity/v3/projects/982420600a81450fb50fcfcca5cd0346/users/b9302cee377e46ef9f4b27d2a4404fb2/roles/6c07d15b26e74cb5af0fd653708c43a6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:34.093550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:34.113414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44ed60223d44e13a761814a201211ed', 'request_id': 'req-d76cebbb-1f4e-41df-8964-1f7e919a53be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.124113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44ed60223d44e13a761814a201211ed', 'request_id': 'req-d76cebbb-1f4e-41df-8964-1f7e919a53be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.133712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44ed60223d44e13a761814a201211ed', 'request_id': 'req-d76cebbb-1f4e-41df-8964-1f7e919a53be'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.235253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] The token cache is being invalidate because project f44ed60223d44e13a761814a201211ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:34.235253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.237714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.246879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3569/7154] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:33 2022] DELETE /identity/v3/projects/f44ed60223d44e13a761814a201211ed => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:34.257067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:34.260599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:34.273489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21121c82-f660-49b7-b420-d4d4c003c072 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:34.416471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:34.418643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:34.419182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:34.419833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/982420600a81450fb50fcfcca5cd0346/users/b9302cee377e46ef9f4b27d2a4404fb2/roles/b450215f6e9f41e0932f0f1a2d60b85e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:34.424573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=982420600a81450fb50fcfcca5cd0346, user_id=b9302cee377e46ef9f4b27d2a4404fb2, role_id=b450215f6e9f41e0932f0f1a2d60b85e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:34.430668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:34.448845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:34.464861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cebbb-1f4e-41df-8964-1f7e919a53be admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:34.467852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:34.468521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:34.468809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:34.469287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] PATH_INFO: `/v3/users/c93925d0b0a54d53ac16efcde7837807` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:34.471345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93925d0b0a54d53ac16efcde7837807)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:34.477557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:34.539902 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3586/7155] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:34 2022] PUT /identity/v3/projects/982420600a81450fb50fcfcca5cd0346/users/b9302cee377e46ef9f4b27d2a4404fb2/roles/b450215f6e9f41e0932f0f1a2d60b85e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:34.547098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:34.565191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:34.729168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2235f-adcd-4c33-b0c8-b3d560a95f35 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:34.767967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:34.772548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:34.773074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:34.773488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] PATH_INFO: `/v3/users/8cc36d6b991f42e9a67154c79ef034d6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:34.779383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc36d6b991f42e9a67154c79ef034d6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:34.783660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:34.811002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93925d0b0a54d53ac16efcde7837807'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.815123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93925d0b0a54d53ac16efcde7837807'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.856606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:34.946309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93925d0b0a54d53ac16efcde7837807'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.967868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93925d0b0a54d53ac16efcde7837807'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:34.971268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93925d0b0a54d53ac16efcde7837807'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:35.036474 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3570/7156] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:34 2022] DELETE /identity/v3/users/c93925d0b0a54d53ac16efcde7837807 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:35.038197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:35.043677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:35.107955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc36d6b991f42e9a67154c79ef034d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:35.149267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc36d6b991f42e9a67154c79ef034d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:35.158327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc36d6b991f42e9a67154c79ef034d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:35.159108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc36d6b991f42e9a67154c79ef034d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:35.159967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f0af12bc-d662-4341-8428-7c54bb2adec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc36d6b991f42e9a67154c79ef034d6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:35.218715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30199f95-4e31-40ce-a8fd-f2f4957b1328 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:35.230348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac45f-42b9-4dd8-b8ea-0b8a737dee49 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:35.232023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac45f-42b9-4dd8-b8ea-0b8a737dee49 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:35.232798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac45f-42b9-4dd8-b8ea-0b8a737dee49 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:35.239334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac45f-42b9-4dd8-b8ea-0b8a737dee49 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:35.239334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac45f-42b9-4dd8-b8ea-0b8a737dee49 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:35.239927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac45f-42b9-4dd8-b8ea-0b8a737dee49 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:35.277800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3587/7157] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:34 2022] DELETE /identity/v3/users/8cc36d6b991f42e9a67154c79ef034d6 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:35.286895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:35.287571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:35.288278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:35.327396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3571/7158] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:35 2022] GET /identity/v3/users => generated 7778 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:35.330684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191d8e-82c9-49fa-a5ff-6838e2811e6a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:35.331487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191d8e-82c9-49fa-a5ff-6838e2811e6a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:35.332145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:35.332400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191d8e-82c9-49fa-a5ff-6838e2811e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:35.335619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:35.420744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-84191d8e-82c9-49fa-a5ff-6838e2811e6a None None] MFA Rules not processed for user `b9302cee377e46ef9f4b27d2a4404fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:35.424817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-84191d8e-82c9-49fa-a5ff-6838e2811e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:35.466754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:35.587903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:35.627489 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3588/7159] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:35.653074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:35.654090 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3572/7160] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:35.658122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:35.658760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:35.659261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:35.659713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:35.687933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] MFA Rules not processed for user `b9302cee377e46ef9f4b27d2a4404fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:35.689792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:35.710352 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3573/7161] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:35.716993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:35.723358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c987bb1-7860-44ed-bece-aa2aa7936a20 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:35.732181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:35.733183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:35.733734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:35.734685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:35.736235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:create_trust()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:35.738697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:35.902305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e47536-8703-4934-8d16-91c5af7fa966 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:35.908875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:35.914199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:35.914199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:35.914199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:35.936542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:35.938793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:35.976505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3589/7162] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:28:36.026124 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3574/7163] 10.222.0.78 () {60 vars in 1174 bytes} [Sun Aug 28 20:28:35 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:36.028323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.050174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d70a96-188c-4592-9d0d-79780f0fd62c service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.070608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.071647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.071981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.072373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.092737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:get_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.094302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.127537 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3590/7164] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:36 2022] GET /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31 => generated 859 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:36.129640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.159569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b11f4-13b7-4cf8-9f94-256004bac216 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.168193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.170490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.171405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.172087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.183225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.186949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.220357 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3575/7165] 10.222.0.78 () {58 vars in 1269 bytes} [Sun Aug 28 20:28:36 2022] GET /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles => generated 371 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:36.224396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.244487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2409-6338-46f8-beab-11d053a5ddc6 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.284639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.285341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.285759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.286352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/6c07d15b26e74cb5af0fd653708c43a6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.308990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31, role_id=6c07d15b26e74cb5af0fd653708c43a6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.313394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.349638 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3591/7166] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:28:36 2022] GET /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/6c07d15b26e74cb5af0fd653708c43a6 => generated 244 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:36.358229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.383044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3568a-d7d1-4908-9682-fe41142b3d58 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.390071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.391759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.392777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.394439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/6c07d15b26e74cb5af0fd653708c43a6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.412505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31, role_id=6c07d15b26e74cb5af0fd653708c43a6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.414698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.436664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.439656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:36.456401 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3576/7167] 10.222.0.78 () {58 vars in 1369 bytes} [Sun Aug 28 20:28:36 2022] HEAD /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/6c07d15b26e74cb5af0fd653708c43a6 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 20:28:36.465952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.495117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:36.505471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a190e8-410d-4d15-afce-7700eaabbdbf tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.517373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206aadf-6079-4250-85da-c50aa000eaca tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.534577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.542309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.546421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.551013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.551874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.552539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] PATH_INFO: `/v3/projects/68f289a90b4f4b19bf6beef0a930d79a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.553900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.555803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/b450215f6e9f41e0932f0f1a2d60b85e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.557193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f289a90b4f4b19bf6beef0a930d79a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.563113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.576971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31, role_id=b450215f6e9f41e0932f0f1a2d60b85e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.579408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Could not find role: b450215f6e9f41e0932f0f1a2d60b85e.: keystone.exception.RoleNotFound: Could not find role: b450215f6e9f41e0932f0f1a2d60b85e. Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:28:36.621701 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b450215f6e9f41e0932f0f1a2d60b85e. Aug 28 20:28:36.623043 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:36.627745 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3577/7168] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:28:36 2022] GET /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/b450215f6e9f41e0932f0f1a2d60b85e => generated 110 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:36.633088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.657155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf87e-8939-4c21-8bb9-45368bf2ce30 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.665611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.666753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.667737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.668218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/b450215f6e9f41e0932f0f1a2d60b85e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.677251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31, role_id=b450215f6e9f41e0932f0f1a2d60b85e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.679344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Could not find role: b450215f6e9f41e0932f0f1a2d60b85e.: keystone.exception.RoleNotFound: Could not find role: b450215f6e9f41e0932f0f1a2d60b85e. Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:28:36.712826 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b450215f6e9f41e0932f0f1a2d60b85e. Aug 28 20:28:36.714030 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:36.714328 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3578/7169] 10.222.0.78 () {58 vars in 1369 bytes} [Sun Aug 28 20:28:36 2022] HEAD /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31/roles/b450215f6e9f41e0932f0f1a2d60b85e => generated 0 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 20:28:36.733316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:36.754412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd54a-40aa-4510-9306-2dd6f8c9e485 tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:36.784526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:36.788458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:36.790335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:36.794573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:36.825780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f289a90b4f4b19bf6beef0a930d79a', 'request_id': 'req-c51ae8db-269b-4ddd-9566-c8f3c676d70f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:36.828969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:36.829236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorizing `identity:delete_trust(trust_id=a6b4a52eb0764fa5b31b8317dcb04f31)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:36.838201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f289a90b4f4b19bf6beef0a930d79a', 'request_id': 'req-c51ae8db-269b-4ddd-9566-c8f3c676d70f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:36.839203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:36.849121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f289a90b4f4b19bf6beef0a930d79a', 'request_id': 'req-c51ae8db-269b-4ddd-9566-c8f3c676d70f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.196522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] The token cache is being invalidate because project 68f289a90b4f4b19bf6beef0a930d79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:37.197237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.197469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c51ae8db-269b-4ddd-9566-c8f3c676d70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.199064 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3592/7170] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:36 2022] DELETE /identity/v3/projects/68f289a90b4f4b19bf6beef0a930d79a => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:37.204392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453172-34dc-41ea-a56d-3556dec11cf4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.204678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453172-34dc-41ea-a56d-3556dec11cf4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.204954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453172-34dc-41ea-a56d-3556dec11cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.226788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f0453172-34dc-41ea-a56d-3556dec11cf4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:37.228048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f0453172-34dc-41ea-a56d-3556dec11cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:37.322145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a6b4a52eb0764fa5b31b8317dcb04f31', 'request_id': 'req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.326801 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3593/7171] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:37.337136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.338023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.338705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.382959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:37.385834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:37.402450 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3594/7172] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:37.403833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:37.409033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:37.434278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0510-acc4-4bbd-813c-8c0a94562739 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:37.449792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:37.451043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.451435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.451828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] PATH_INFO: `/v3/projects/65e5ed2e0142427f81a89318c850bb7e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.453455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e5ed2e0142427f81a89318c850bb7e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:37.455990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:37.514898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a6b4a52eb0764fa5b31b8317dcb04f31', 'request_id': 'req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.515642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a6b4a52eb0764fa5b31b8317dcb04f31', 'request_id': 'req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.534137 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3579/7173] 10.222.0.78 () {58 vars in 1254 bytes} [Sun Aug 28 20:28:36 2022] DELETE /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:37.538816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:37.538816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:37.556585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e115-cd5e-47fe-b831-2ad9b45de8aa tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:37.560027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:37.560668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.560991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.561271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.561979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:37.562289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:37.563890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:37.578464 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3580/7174] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:37.579322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:37.583909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:37.680422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846888c9-7a2f-4d13-8c04-536009cc24de admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:37.692294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e5ed2e0142427f81a89318c850bb7e', 'request_id': 'req-6f8451a3-d2fc-477f-9358-064b1c014d73'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.701901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e5ed2e0142427f81a89318c850bb7e', 'request_id': 'req-6f8451a3-d2fc-477f-9358-064b1c014d73'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.710498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e5ed2e0142427f81a89318c850bb7e', 'request_id': 'req-6f8451a3-d2fc-477f-9358-064b1c014d73'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.756004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9302cee377e46ef9f4b27d2a4404fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982420600a81450fb50fcfcca5cd0346', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1092570857', 'tempest-DelegatedRole-2062108234'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:37.760766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.760766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.760766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] PATH_INFO: `/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Could not find trust: a6b4a52eb0764fa5b31b8317dcb04f31.: keystone.exception.TrustNotFound: Could not find trust: a6b4a52eb0764fa5b31b8317dcb04f31. Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 20:28:37.769408 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a6b4a52eb0764fa5b31b8317dcb04f31. Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:37.771178 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3581/7175] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:37 2022] GET /identity/v3/OS-TRUST/trusts/a6b4a52eb0764fa5b31b8317dcb04f31 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:37.772434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:37.823113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] The token cache is being invalidate because project 65e5ed2e0142427f81a89318c850bb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:37.823543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.825444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:37.828055 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3595/7176] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:37 2022] DELETE /identity/v3/projects/65e5ed2e0142427f81a89318c850bb7e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:37.828781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:37.843520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:37.881101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c1844-277a-4483-a6e3-0e9a9079104a tempest-TrustsV3TestJSON-233680069 tempest-user-895324364] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:37.888040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6bb1d-f3a4-4940-ac04-d0373b139ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:37.888756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bb1d-f3a4-4940-ac04-d0373b139ddb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.889045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bb1d-f3a4-4940-ac04-d0373b139ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.889329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bb1d-f3a4-4940-ac04-d0373b139ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.890173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6bb1d-f3a4-4940-ac04-d0373b139ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:37.892100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6bb1d-f3a4-4940-ac04-d0373b139ddb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:37.934645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:37.964519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8451a3-d2fc-477f-9358-064b1c014d73 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:37.971577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:37.972848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:37.973345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:37.973960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/b450215f6e9f41e0932f0f1a2d60b85e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:37.975772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b450215f6e9f41e0932f0f1a2d60b85e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:37.978100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.010487 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3582/7177] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:37 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:38.022257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394724-4750-46c7-8914-6e48689bd612 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.022665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394724-4750-46c7-8914-6e48689bd612 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.023876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394724-4750-46c7-8914-6e48689bd612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.057078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-75394724-4750-46c7-8914-6e48689bd612 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:38.060050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-75394724-4750-46c7-8914-6e48689bd612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:38.169099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role b450215f6e9f41e0932f0f1a2d60b85e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:38.169808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:38.172035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:38.176076 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3596/7178] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:37 2022] DELETE /identity/v3/roles/b450215f6e9f41e0932f0f1a2d60b85e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:38.177113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.179503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:38.199032 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3583/7179] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:38.201196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75394724-4750-46c7-8914-6e48689bd612 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.203925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-75394724-4750-46c7-8914-6e48689bd612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:38.297054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba582-dda8-420b-a931-78056b9490e9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:38.314782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e39217-00c9-4afe-af15-18a0ffeba811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:38.315502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39217-00c9-4afe-af15-18a0ffeba811 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.315891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39217-00c9-4afe-af15-18a0ffeba811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.318192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39217-00c9-4afe-af15-18a0ffeba811 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.320063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e39217-00c9-4afe-af15-18a0ffeba811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:38.323740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e39217-00c9-4afe-af15-18a0ffeba811 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.328564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75394724-4750-46c7-8914-6e48689bd612 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:38.418638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:38.419409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.419709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.420002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/6c07d15b26e74cb5af0fd653708c43a6` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.421666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c07d15b26e74cb5af0fd653708c43a6)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:38.423713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.444633 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3597/7180] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:38 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:38.446035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.446416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.446755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.479968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:38.481391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:38.490868 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3598/7181] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:38.491479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.509179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dee0c-80a5-42ab-908c-a749ffdf2196 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:38.518548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:38.520272 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.521300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.522511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.524522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:38.529301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.559023 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3599/7182] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:38 2022] GET /identity/v3/roles => generated 1655 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:38.561246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.587127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7fa90-91ff-41fe-8ccc-19b88e63d58d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:38.593868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:38.594600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.594893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.595651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.597230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:38.597230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:38.604068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.628259 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3600/7183] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:38.628679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.645056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a1fd3-fa0f-463e-89ea-10c6be643ae5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:38.653011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:38.654460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.654813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.655127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.656233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:38.658909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.672675 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3601/7184] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:38 2022] GET /identity/v3/roles => generated 1655 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:38.674155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.693546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476616-74bd-4d85-ba17-e4981435c4dc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:38.699051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:38.700099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:38.700467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:38.701027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:38.702150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:38.706230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:38.763144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 6c07d15b26e74cb5af0fd653708c43a6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:38.763814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:38.765515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:38.774819 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3584/7185] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:38 2022] DELETE /identity/v3/roles/6c07d15b26e74cb5af0fd653708c43a6 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:38.774819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.779142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:38.855135 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3602/7186] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:38 2022] POST /identity/v3/projects => generated 399 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:38.855135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:38.855135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:38.925424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c23d0a-ff04-44a3-9a0e-c258d4d3149d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:39.012405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5085e9-8a10-4fc3-a53f-d1ae9dde4ac8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:39.024381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:39.026058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.026682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.027290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users/b9302cee377e46ef9f4b27d2a4404fb2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.030241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9302cee377e46ef9f4b27d2a4404fb2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:39.034530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:39.062369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:39.063064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.063406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.063924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] PATH_INFO: `/v3/projects/ce3f72a7715541fc98fb1b80c424fa6e/users/c91cbd244e094d4aaed475433c63b73c/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.084587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3f72a7715541fc98fb1b80c424fa6e, user_id=c91cbd244e094d4aaed475433c63b73c, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:39.087620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:39.094048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:39.160831 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3585/7187] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:38 2022] PUT /identity/v3/projects/ce3f72a7715541fc98fb1b80c424fa6e/users/c91cbd244e094d4aaed475433c63b73c/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:39.164038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:39.186102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:39.248418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9302cee377e46ef9f4b27d2a4404fb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:39.264604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9302cee377e46ef9f4b27d2a4404fb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:39.277081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9302cee377e46ef9f4b27d2a4404fb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:39.278631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9302cee377e46ef9f4b27d2a4404fb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:39.279685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-6f026681-a2f3-4c16-aec5-d24c7e54e177 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9302cee377e46ef9f4b27d2a4404fb2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:39.290823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557c8a4-b584-47ea-81e9-ae21c6533431 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:39.300983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:39.302058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.302477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.302944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.304685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:39.306807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:39.368599 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3603/7188] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:38 2022] DELETE /identity/v3/users/b9302cee377e46ef9f4b27d2a4404fb2 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:39.372546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.373310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.374277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.418364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] MFA Rules not processed for user `c91cbd244e094d4aaed475433c63b73c`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:39.420091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:39.456476 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3586/7189] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:39 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:39.457478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:39.467830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:39.530601 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3604/7190] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:39.531880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:39.534639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:39.613491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee03d1-474b-4b24-ad6e-6725de4926ef admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:39.643497 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5604b6f-7402-408a-bd2b-b0fd956877b8 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:39.669464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:39.669464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.669464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.670016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.670759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:39.673096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:39.777511 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3605/7191] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:39.777511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:39.777511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:39.811976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:39.814581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.815534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.816158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/982420600a81450fb50fcfcca5cd0346` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.820039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=982420600a81450fb50fcfcca5cd0346)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:39.824042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:39.944650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b14be-0bfb-43bf-b5e8-b6be148b1f14 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:39.955334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:39.956676 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:39.958440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:39.959108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:39.978216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:39.981768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:40.001159 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3606/7192] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:40.002802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:40.021623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f465e0-0a32-4966-854d-ae24e5fe5c68 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:40.030117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:40.030117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:40.030117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:40.030117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:40.030580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:40.031997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:40.052265 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3607/7193] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:40.059053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:40.065942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:40.071116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daec66-45d9-481b-a89d-d994a5c5c059 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:40.157978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:40.158804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:40.159159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:40.159549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] PATH_INFO: `/v3/projects/01c0164468cb452c8b269c6e6050821c/users/63a31a8f33e540aeba3e88b6ab510520/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:40.180537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c0164468cb452c8b269c6e6050821c, user_id=63a31a8f33e540aeba3e88b6ab510520, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:40.184345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:40.402783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982420600a81450fb50fcfcca5cd0346', 'request_id': 'req-fa45c04a-b570-4f81-9d43-f750f33e9123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:40.409663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982420600a81450fb50fcfcca5cd0346', 'request_id': 'req-fa45c04a-b570-4f81-9d43-f750f33e9123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:40.423934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982420600a81450fb50fcfcca5cd0346', 'request_id': 'req-fa45c04a-b570-4f81-9d43-f750f33e9123'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:40.518990 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3608/7194] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:40 2022] PUT /identity/v3/projects/01c0164468cb452c8b269c6e6050821c/users/63a31a8f33e540aeba3e88b6ab510520/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:40.520524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:40.527310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:40.560796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] The token cache is being invalidate because project 982420600a81450fb50fcfcca5cd0346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:40.563196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:40.564536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fa45c04a-b570-4f81-9d43-f750f33e9123 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:40.575429 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3587/7195] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:39 2022] DELETE /identity/v3/projects/982420600a81450fb50fcfcca5cd0346 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:40.577893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:40.578584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:40.579112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:40.614863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1ae30-3546-4773-af6e-a371482f3998 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:40.621698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:40.624041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] MFA Rules not processed for user `63a31a8f33e540aeba3e88b6ab510520`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:40.628882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:40.628882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:40.628882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:40.629251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:40.629349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] PATH_INFO: `/v3/users/c91cbd244e094d4aaed475433c63b73c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:40.629349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91cbd244e094d4aaed475433c63b73c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:40.629349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:40.736797 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3588/7196] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:40.747251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:40.754354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:40.889413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ed2f7-1d72-40f9-ad39-d13bf246a7e2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:40.900612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:40.901650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:40.902153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:40.902634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:40.903981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:40.908131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:41.053273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91cbd244e094d4aaed475433c63b73c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:41.058898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:41.079539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91cbd244e094d4aaed475433c63b73c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:41.095066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91cbd244e094d4aaed475433c63b73c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:41.095860 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3589/7197] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:40 2022] POST /identity/v3/projects => generated 329 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:41.096851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91cbd244e094d4aaed475433c63b73c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:41.097843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:41.098328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91cbd244e094d4aaed475433c63b73c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:41.102910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:41.217787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476f68a-0f9f-42fe-bc06-e31bb54db20a tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:41.228784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:41.229700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:41.230559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:41.231207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:41.244460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:41.278857 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3609/7198] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:40 2022] DELETE /identity/v3/users/c91cbd244e094d4aaed475433c63b73c => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:41.279748 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:41.281937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:41.381218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:41.384023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add43f54-8572-434f-b09b-1e3cd166fe73 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:41.407287 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3590/7199] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:41.412095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:41.413364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:41.413920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:41.417670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d832cb-73aa-4664-bb6d-cf9b97d72c65 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:41.422750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:41.423720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:41.424113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:41.425924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:41.426825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:41.429364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:41.464978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:41.467867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:41.553842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:41.561692 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3610/7200] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:41 2022] POST /identity/v3/users => generated 410 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:41.568343 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:41.613638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938044e-a986-4888-96e0-3e14636d6a96 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:41.629146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:41.629790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:41.630140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:41.630584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:41.631633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:41.635950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:41.679426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:41.723584 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3591/7201] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:41.736606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:41.746350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:41.795664 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3611/7202] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:41 2022] POST /identity/v3/roles => generated 244 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:41.796990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:41.826264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92747230-d069-4355-8fa3-55841d13f29f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:41.847593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:41.849807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:41.850344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:41.850823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:41.855644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:41.860191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:41.939545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9919e-569a-4a7f-88d9-88248ff1f372 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:41.987588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:41.994766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:41.994766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:41.994766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:41.995396 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3612/7203] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:41 2022] POST /identity/v3/roles => generated 247 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:41.996761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:42.035718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:42.040687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c2752-bd0d-41bc-a7d7-f28321afd28d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:42.061570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:42.063074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:42.066191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:42.071507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/cb8de8568f564fcaafdd48ec790b3d26/users/1bbdc876dbae4401b9213dbb226ef4af/roles/cddf4065c3154fdd8df83f081a08004e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:42.098883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:42.105390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:42.150240 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3592/7204] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:42.159506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cb8de8568f564fcaafdd48ec790b3d26, user_id=1bbdc876dbae4401b9213dbb226ef4af, role_id=cddf4065c3154fdd8df83f081a08004e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:42.171683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:42.282672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:42.284303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:42.299387 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3613/7205] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:41 2022] PUT /identity/v3/projects/cb8de8568f564fcaafdd48ec790b3d26/users/1bbdc876dbae4401b9213dbb226ef4af/roles/cddf4065c3154fdd8df83f081a08004e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:42.300744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:42.330627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37cc52-390b-480f-a27d-943bec4c5f4a service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:42.500478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a99419-c3be-4d84-8829-5a0b8b514475 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:42.504308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a99419-c3be-4d84-8829-5a0b8b514475 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:42.504626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a99419-c3be-4d84-8829-5a0b8b514475 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:42.504924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a99419-c3be-4d84-8829-5a0b8b514475 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/cb8de8568f564fcaafdd48ec790b3d26/users/1bbdc876dbae4401b9213dbb226ef4af/roles/96a7e0b171cb4fe58d0f423c3046f6c7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:42.510899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a99419-c3be-4d84-8829-5a0b8b514475 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cb8de8568f564fcaafdd48ec790b3d26, user_id=1bbdc876dbae4401b9213dbb226ef4af, role_id=96a7e0b171cb4fe58d0f423c3046f6c7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:42.516026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a99419-c3be-4d84-8829-5a0b8b514475 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:42.639864 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3593/7206] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:42 2022] PUT /identity/v3/projects/cb8de8568f564fcaafdd48ec790b3d26/users/1bbdc876dbae4401b9213dbb226ef4af/roles/96a7e0b171cb4fe58d0f423c3046f6c7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:42.647165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:42.680951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ffc06-b473-410e-9966-8995f017ef30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:42.875570 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb3f72-c598-48eb-9550-167c2f4723e5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:42.877406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3f72-c598-48eb-9550-167c2f4723e5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:42.878889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3f72-c598-48eb-9550-167c2f4723e5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:42.880043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3f72-c598-48eb-9550-167c2f4723e5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:42.882301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb3f72-c598-48eb-9550-167c2f4723e5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:42.891839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb3f72-c598-48eb-9550-167c2f4723e5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:42.944438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3614/7207] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:42 2022] GET /identity/v3/users => generated 8066 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:42.952159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:42.953010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:42.953339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:43.104267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] MFA Rules not processed for user `1bbdc876dbae4401b9213dbb226ef4af`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:43.108628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:43.258558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:43.274122 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3594/7208] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:43.288709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:43.289205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:43.289595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:43.376346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] MFA Rules not processed for user `1bbdc876dbae4401b9213dbb226ef4af`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:43.383276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:43.421056 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3615/7209] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:43.425306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:43.453630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa1561-f530-4a4f-9a02-eb5750ca2c23 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:43.476581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bbdc876dbae4401b9213dbb226ef4af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb8de8568f564fcaafdd48ec790b3d26', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1333653672', 'tempest-DelegatedRole-1739624930'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:43.478272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:43.493785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:43.494281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:43.495076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] RBAC: Authorizing `identity:create_trust()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:43.500724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 28 20:28:43.908839 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 28 20:28:43.910021 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 28 20:28:43.912648 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 28 20:28:43.912648 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 28 20:28:43.912648 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 28 20:28:43.912648 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 28 20:28:43.912648 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 20:28:43.912648 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:43.915409 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3595/7210] 10.222.0.78 () {60 vars in 1174 bytes} [Sun Aug 28 20:28:43 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 497 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 20:28:43.916680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:43.939003 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb446-9b81-44d4-836b-4ef8f1a0ee01 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:43.945444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:43.946162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:43.946449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:43.946726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/96a7e0b171cb4fe58d0f423c3046f6c7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:43.949278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=96a7e0b171cb4fe58d0f423c3046f6c7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:43.951190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:44.075180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:44.077232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:44.212800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 96a7e0b171cb4fe58d0f423c3046f6c7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:44.213248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.218508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.235236 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3616/7211] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:43 2022] DELETE /identity/v3/roles/96a7e0b171cb4fe58d0f423c3046f6c7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:44.240739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:44.244888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:44.290688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa71c57-01fe-4af9-9e81-82e41b3ccff2 tempest-TrustsV3TestJSON-1969993333 tempest-user-61681334] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:44.360841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:44.506136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451f8d9-6277-41a3-97c6-651eae5655dc tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:44.514565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:44.515429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:44.518978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:44.518978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] PATH_INFO: `/v3/projects/ce3f72a7715541fc98fb1b80c424fa6e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:44.523802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3f72a7715541fc98fb1b80c424fa6e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:44.526478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:44.535728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:44.536721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:44.538142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:44.538586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/cddf4065c3154fdd8df83f081a08004e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:44.545918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cddf4065c3154fdd8df83f081a08004e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:44.547975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:44.777465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3f72a7715541fc98fb1b80c424fa6e', 'request_id': 'req-45dc7615-41aa-4b30-b31f-fefa5d437fd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.785627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3f72a7715541fc98fb1b80c424fa6e', 'request_id': 'req-45dc7615-41aa-4b30-b31f-fefa5d437fd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.794761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3f72a7715541fc98fb1b80c424fa6e', 'request_id': 'req-45dc7615-41aa-4b30-b31f-fefa5d437fd2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.883031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role cddf4065c3154fdd8df83f081a08004e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:44.883388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.886184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.891377 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3617/7212] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:44 2022] DELETE /identity/v3/roles/cddf4065c3154fdd8df83f081a08004e => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:44.896456 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:44.901426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:44.929772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:44.953990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] The token cache is being invalidate because project ce3f72a7715541fc98fb1b80c424fa6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:44.954303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.956042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45dc7615-41aa-4b30-b31f-fefa5d437fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:44.965512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3596/7213] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:44 2022] DELETE /identity/v3/projects/ce3f72a7715541fc98fb1b80c424fa6e => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:44.970822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b031-120e-43de-a422-e3eeb2bf0763 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:44.971176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b031-120e-43de-a422-e3eeb2bf0763 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:44.971523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b031-120e-43de-a422-e3eeb2bf0763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.016089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d671b031-120e-43de-a422-e3eeb2bf0763 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:45.017446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d671b031-120e-43de-a422-e3eeb2bf0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:45.081527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed627-e3e5-42d7-97a9-4d8bba311224 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:45.091496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:45.091935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:45.092243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:45.092536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users/1bbdc876dbae4401b9213dbb226ef4af` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.096275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1bbdc876dbae4401b9213dbb226ef4af)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:45.096835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:45.172402 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3597/7214] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:45.175260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:45.175646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:45.176399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.203071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:45.204744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:45.214606 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3598/7215] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:45.219633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:45.231735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afa6ce-0aba-4e36-94cd-a25ebea57553 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:45.237736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:45.238786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:45.239169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:45.239684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.240500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:45.240908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:45.243754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:45.262235 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3599/7216] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:45.263759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:45.276926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9f12-fdbd-430c-bc5d-fda99725d854 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:45.283510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:45.284807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:45.285264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:45.285742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.286735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:45.289962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:45.319283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbdc876dbae4401b9213dbb226ef4af'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.354575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbdc876dbae4401b9213dbb226ef4af'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.407019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbdc876dbae4401b9213dbb226ef4af'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.408963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbdc876dbae4401b9213dbb226ef4af'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.410086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbdc876dbae4401b9213dbb226ef4af'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.465223 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3600/7217] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:45 2022] POST /identity/v3/projects => generated 359 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:45.466255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:45.479973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:45.504012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:45.557459 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3618/7218] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:44 2022] DELETE /identity/v3/users/1bbdc876dbae4401b9213dbb226ef4af => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:45.561353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:45.565796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:45.614088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9515f-23c8-4433-bbf6-5cdeee90206f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:45.712212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9802b4-8cb3-48f3-9fdc-71eed97aa542 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:45.717822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:45.718645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:45.719026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:45.719678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/cb8de8568f564fcaafdd48ec790b3d26` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.721138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb8de8568f564fcaafdd48ec790b3d26)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:45.723315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:45.800961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:45.801765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:45.805125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:45.805125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:45.805125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:45.808090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:45.869085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:45.887798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8de8568f564fcaafdd48ec790b3d26', 'request_id': 'req-03b0fe9f-869c-4298-8df4-8011de6a8d30'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.911388 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3601/7219] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:45 2022] POST /identity/v3/users => generated 280 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:45.918475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:45.923926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8de8568f564fcaafdd48ec790b3d26', 'request_id': 'req-03b0fe9f-869c-4298-8df4-8011de6a8d30'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.932905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8de8568f564fcaafdd48ec790b3d26', 'request_id': 'req-03b0fe9f-869c-4298-8df4-8011de6a8d30'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:45.939608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769bcbd-ab65-4a29-9233-42fbb9fab631 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.038294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.038425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] The token cache is being invalidate because project cb8de8568f564fcaafdd48ec790b3d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:46.038523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.038605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:46.038732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.038732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.038732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.039772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:46.044034 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3619/7220] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:45 2022] DELETE /identity/v3/projects/cb8de8568f564fcaafdd48ec790b3d26 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:46.044766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.052054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.060601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:46.078660 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3602/7221] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:46.083812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.090879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:46.117712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2586392-8b28-431c-8e29-8fdc09afd5ee admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.138727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.139540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.139919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.140291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.141277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.143427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.186123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3603/7222] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:46.190996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.219153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f84b-8fbb-4dbb-bb0f-e9f2226ac7cc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.222099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0fe9f-869c-4298-8df4-8011de6a8d30 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.231389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87198e0-2cbd-442d-ba1e-414cf9ee74e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.232565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87198e0-2cbd-442d-ba1e-414cf9ee74e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.233592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87198e0-2cbd-442d-ba1e-414cf9ee74e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.234507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.235065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87198e0-2cbd-442d-ba1e-414cf9ee74e1 admin admin] PATH_INFO: `/v3/projects/840106fb1f2c4e4ebfc7f80b3f81ad1f/users/d253a4ce7dcd4400b98c0cbdf82bdcdd/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.235745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.236926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.237469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.239621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.241681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.258867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87198e0-2cbd-442d-ba1e-414cf9ee74e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840106fb1f2c4e4ebfc7f80b3f81ad1f, user_id=d253a4ce7dcd4400b98c0cbdf82bdcdd, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.262719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87198e0-2cbd-442d-ba1e-414cf9ee74e1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.358911 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3620/7224] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:46 2022] POST /identity/v3/projects => generated 328 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:46.361945 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3604/7224] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:46 2022] PUT /identity/v3/projects/840106fb1f2c4e4ebfc7f80b3f81ad1f/users/d253a4ce7dcd4400b98c0cbdf82bdcdd/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:46.366176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.368249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.368676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.369399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.397337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:46.434409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] MFA Rules not processed for user `d253a4ce7dcd4400b98c0cbdf82bdcdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:46.436542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:46.535058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86df751-074b-4d6e-8635-e3d289f541c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.543734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.544924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.545321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.545735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.547179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.550460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.552108 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3605/7225] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:46.648711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.697263 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3621/7226] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:46 2022] POST /identity/v3/users => generated 416 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:46.700834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.713802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff8f6-65d6-49d1-bd9d-61280bcea8aa tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.721078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.721598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.721943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.722228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.722917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.724625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.811289 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3622/7227] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:46 2022] POST /identity/v3/roles => generated 244 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:46.816774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:46.840710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aee64-a4af-41ed-bfac-569f282cbdeb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.854576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3b843-1167-4ef4-86ed-55c7408b3f17 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:46.856862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.857716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.860109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.860578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.863161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.867127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:46.867988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:46.868482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:46.869335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:46.871223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] PATH_INFO: `/v3/users/d253a4ce7dcd4400b98c0cbdf82bdcdd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:46.874229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d253a4ce7dcd4400b98c0cbdf82bdcdd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:46.878585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:47.047373 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3623/7228] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:46 2022] POST /identity/v3/roles => generated 246 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:47.054774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:47.069501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5b51-8567-421e-b054-4f3fab9f55b7 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:47.074738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:47.075422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:47.075767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:47.076073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/1f80811c13314e5093ee7a407a42728b/users/1becc6921c83480fbae506a288a89f22/roles/f54e26dc4c4f43a99bf65f83b2c402bb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:47.080920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:47.106514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1f80811c13314e5093ee7a407a42728b, user_id=1becc6921c83480fbae506a288a89f22, role_id=f54e26dc4c4f43a99bf65f83b2c402bb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:47.111874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:47.143369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd253a4ce7dcd4400b98c0cbdf82bdcdd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:47.145091 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd253a4ce7dcd4400b98c0cbdf82bdcdd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:47.285905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd253a4ce7dcd4400b98c0cbdf82bdcdd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:47.299243 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3624/7229] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:47 2022] PUT /identity/v3/projects/1f80811c13314e5093ee7a407a42728b/users/1becc6921c83480fbae506a288a89f22/roles/f54e26dc4c4f43a99bf65f83b2c402bb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:47.315011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:47.317671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd253a4ce7dcd4400b98c0cbdf82bdcdd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:47.319034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-90117e37-7bdd-46ff-b358-91da97498bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd253a4ce7dcd4400b98c0cbdf82bdcdd'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:47.355677 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3606/7230] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:46 2022] DELETE /identity/v3/users/d253a4ce7dcd4400b98c0cbdf82bdcdd => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:47.359541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:47.359941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:47.360909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:47.391087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:47.392530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:47.410858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:47.502119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73983-e28c-4e66-b592-30c16aeaa070 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:47.585583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3607/7231] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:47.591389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:47.596650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:47.697139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15e23e-2368-4fa8-ab4b-59801152f74c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:47.701399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:47.702072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:47.702361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:47.702643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:47.717472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:47.719219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:47.735203 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3608/7232] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:28:47.736972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3b307-e0f2-4357-ab47-77d6f67cf92f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:47.739448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b307-e0f2-4357-ab47-77d6f67cf92f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:47.740205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b307-e0f2-4357-ab47-77d6f67cf92f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:47.740205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b307-e0f2-4357-ab47-77d6f67cf92f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/1f80811c13314e5093ee7a407a42728b/users/1becc6921c83480fbae506a288a89f22/roles/828cd474f0014a6db52fce8c57e556f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:47.743933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b307-e0f2-4357-ab47-77d6f67cf92f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1f80811c13314e5093ee7a407a42728b, user_id=1becc6921c83480fbae506a288a89f22, role_id=828cd474f0014a6db52fce8c57e556f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:47.747494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b307-e0f2-4357-ab47-77d6f67cf92f tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:47.849609 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3625/7233] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:47 2022] PUT /identity/v3/projects/1f80811c13314e5093ee7a407a42728b/users/1becc6921c83480fbae506a288a89f22/roles/828cd474f0014a6db52fce8c57e556f7 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:47.851258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:47.853136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:47.893543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd12c8-581a-4bbf-8c74-0ba0b9c9caed service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:47.998832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed03c-c30b-4ddd-a946-93b2dcd1f943 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:48.001441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed03c-c30b-4ddd-a946-93b2dcd1f943 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.001828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed03c-c30b-4ddd-a946-93b2dcd1f943 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.005840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed03c-c30b-4ddd-a946-93b2dcd1f943 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.009161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed03c-c30b-4ddd-a946-93b2dcd1f943 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:48.009304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed03c-c30b-4ddd-a946-93b2dcd1f943 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:48.048354 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3609/7234] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:47 2022] GET /identity/v3/users => generated 8072 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:48.053648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.054213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.057031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.120957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] MFA Rules not processed for user `1becc6921c83480fbae506a288a89f22`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:48.122565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:48.245532 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3626/7235] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:48 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:48.255843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.256645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.256914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.294333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] MFA Rules not processed for user `1becc6921c83480fbae506a288a89f22`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:48.296043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:48.314879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:48.316230 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3610/7236] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:48 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:48.327213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455a405-3a13-484b-b54f-c56d51c46008 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:48.343591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:48.344223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.344513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.344794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.345666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:create_trust()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:48.346890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:48.362522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:48.550636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:48.554457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:48.640937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3627/7237] 10.222.0.78 () {60 vars in 1174 bytes} [Sun Aug 28 20:28:48 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:48.642710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:48.693390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbdc49-da7a-4944-a5d9-b4b7e390f4e2 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:48.706359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:48.707032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.707329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.707626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.739392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:48.744127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:get_trust(trust_id=6c583da48c754876953d215f76ff1ebe)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:48.745652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:48.797940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3628/7238] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:48 2022] GET /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe => generated 834 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:48.799424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:48.819211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc681b0a-99cc-4fe0-be8e-723a265d3fb0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:48.829981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:48.831719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.832630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.833342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] PATH_INFO: `/v3/projects/840106fb1f2c4e4ebfc7f80b3f81ad1f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.837244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=840106fb1f2c4e4ebfc7f80b3f81ad1f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:48.840427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:48.851583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec655e5-ec2e-40d0-95f3-a78e3b0d2cf9 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:48.869780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:48.870908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.871418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.872069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.886790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6c583da48c754876953d215f76ff1ebe)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:48.888573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:48.909588 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3629/7239] 10.222.0.78 () {58 vars in 1269 bytes} [Sun Aug 28 20:28:48 2022] GET /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles => generated 371 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:48.914066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:48.928336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0bd6-a2ba-4e21-b835-b3b480bb981d tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:48.939495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:48.940171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:48.940441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:48.940771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/f54e26dc4c4f43a99bf65f83b2c402bb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:48.960380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6c583da48c754876953d215f76ff1ebe, role_id=f54e26dc4c4f43a99bf65f83b2c402bb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:48.963355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:48.985099 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3630/7240] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:28:48 2022] GET /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/f54e26dc4c4f43a99bf65f83b2c402bb => generated 244 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:48.986903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.027157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1220-bf9c-4a1a-8440-5132d07a655b tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.042426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840106fb1f2c4e4ebfc7f80b3f81ad1f', 'request_id': 'req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.060767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840106fb1f2c4e4ebfc7f80b3f81ad1f', 'request_id': 'req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.080457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840106fb1f2c4e4ebfc7f80b3f81ad1f', 'request_id': 'req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.159713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.161914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.163209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.163816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/f54e26dc4c4f43a99bf65f83b2c402bb` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.173218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6c583da48c754876953d215f76ff1ebe, role_id=f54e26dc4c4f43a99bf65f83b2c402bb)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.175627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.185963 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3631/7241] 10.222.0.78 () {58 vars in 1369 bytes} [Sun Aug 28 20:28:48 2022] HEAD /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/f54e26dc4c4f43a99bf65f83b2c402bb => generated 0 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 20:28:49.191046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.208691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f32b-6e51-4dc1-a333-06b3b3c74a8c tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.215529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.216731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.217255 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.217773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/828cd474f0014a6db52fce8c57e556f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.225560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] The token cache is being invalidate because project 840106fb1f2c4e4ebfc7f80b3f81ad1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:49.226024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.227204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-31bf284c-e2f8-4ff6-bf85-814e733dd9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.229951 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3611/7242] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:48 2022] DELETE /identity/v3/projects/840106fb1f2c4e4ebfc7f80b3f81ad1f => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:49.230366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6c583da48c754876953d215f76ff1ebe, role_id=828cd474f0014a6db52fce8c57e556f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.232360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.236612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.237020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.237583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Could not find role: 828cd474f0014a6db52fce8c57e556f7.: keystone.exception.RoleNotFound: Could not find role: 828cd474f0014a6db52fce8c57e556f7. Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:28:49.289264 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 828cd474f0014a6db52fce8c57e556f7. Aug 28 20:28:49.290719 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:28:49.291818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:49.293293 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3632/7243] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:28:49 2022] GET /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/828cd474f0014a6db52fce8c57e556f7 => generated 110 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:49.297302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:49.299643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.306142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:49.326436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa63f-421b-4f54-ac34-9df6fa6a88cc tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.332846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.335185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `HEAD` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.337949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.337949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/828cd474f0014a6db52fce8c57e556f7` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.368448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6c583da48c754876953d215f76ff1ebe, role_id=828cd474f0014a6db52fce8c57e556f7)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.371112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-e0f5abbd-ad26-4205-9052-8f3791fe8dee tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Could not find role: 828cd474f0014a6db52fce8c57e556f7.: keystone.exception.RoleNotFound: Could not find role: 828cd474f0014a6db52fce8c57e556f7. Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:28:49.428963 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 828cd474f0014a6db52fce8c57e556f7. Aug 28 20:28:49.430477 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:28:49.430571 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3612/7244] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:49.432407 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3633/7245] 10.222.0.78 () {58 vars in 1369 bytes} [Sun Aug 28 20:28:49 2022] HEAD /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe/roles/828cd474f0014a6db52fce8c57e556f7 => generated 0 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 20:28:49.437647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.438530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.438996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.439605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.450183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:49.455095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af69c1-2a55-4f93-8498-d2ec2e910679 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.459864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.460719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.461016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.461302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.462773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:49.463981 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:49.468387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorizing `identity:delete_trust(trust_id=6c583da48c754876953d215f76ff1ebe)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.469915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.472565 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3634/7246] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:49.477108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.487250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0ae1d-8e1f-4546-a274-72de2eb3af0d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.492811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.493320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.493672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.493927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.494596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:28:49.494901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.496521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.516245 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3635/7247] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:49.517267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.529158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28e82-c632-4e31-9799-cb90cc123aa4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.534405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.535032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.540049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.540049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.540049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.540049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.654820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6c583da48c754876953d215f76ff1ebe', 'request_id': 'req-2bbf69e3-38da-4156-b80f-1c929a5a1c22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.661808 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3636/7248] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:49 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:49.663204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.797323 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027397a-dd39-4692-8f20-bcba97015a6e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.811828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.813495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.813649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6c583da48c754876953d215f76ff1ebe', 'request_id': 'req-2bbf69e3-38da-4156-b80f-1c929a5a1c22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.814318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.815052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.815802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6c583da48c754876953d215f76ff1ebe', 'request_id': 'req-2bbf69e3-38da-4156-b80f-1c929a5a1c22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:49.815963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.819623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.841451 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3613/7249] 10.222.0.78 () {58 vars in 1254 bytes} [Sun Aug 28 20:28:49 2022] DELETE /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:49.841451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.842998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:49.859702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf69e3-38da-4156-b80f-1c929a5a1c22 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.984715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:50.042475 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3637/7250] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:49 2022] POST /identity/v3/users => generated 287 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:50.048794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:50.051459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1becc6921c83480fbae506a288a89f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f80811c13314e5093ee7a407a42728b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-534557951', 'tempest-DelegatedRole-2103263892'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:50.055090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.056071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.066969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] PATH_INFO: `/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.083367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Could not find trust: 6c583da48c754876953d215f76ff1ebe.: keystone.exception.TrustNotFound: Could not find trust: 6c583da48c754876953d215f76ff1ebe. Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 20:28:50.095753 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6c583da48c754876953d215f76ff1ebe. Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:50.096890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3614/7251] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:49 2022] GET /identity/v3/OS-TRUST/trusts/6c583da48c754876953d215f76ff1ebe => generated 111 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:50.102638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:50.112226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:50.144905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d096c87-d3f8-4829-a99f-d0ae3c9fa149 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:50.177706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:50.179302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.179302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.179600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.180084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:50.194936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:50.222569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3638/7252] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:50 2022] GET /identity/v3/roles => generated 1892 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:50.223540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:50.250555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902425c-c829-4f6c-becb-6edb956a31f9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:50.263446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:50.264074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.264353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.264631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.265350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:50.267076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:50.276588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731326c-51b5-45cc-8e7b-ecb8b5c542b6 tempest-TrustsV3TestJSON-600969865 tempest-user-1549694765] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:50.314277 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3639/7253] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:50 2022] GET /identity/v3/roles => generated 1892 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:50.319233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:50.321193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:50.321898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.322270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.322499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/828cd474f0014a6db52fce8c57e556f7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.324991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=828cd474f0014a6db52fce8c57e556f7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:50.326670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:50.352012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c8153-2881-40ba-b886-b9aa5f84a6f4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:50.362566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8af07-c5a9-4982-8a8b-c5f86f1bc817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:50.365493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8af07-c5a9-4982-8a8b-c5f86f1bc817 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.365493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8af07-c5a9-4982-8a8b-c5f86f1bc817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.365493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8af07-c5a9-4982-8a8b-c5f86f1bc817 admin admin] PATH_INFO: `/v3/projects/f7848865b40f4ec4853693813aa2fe30/users/0e12fb373e9841738a3fe04598d3e4c5/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.382383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8af07-c5a9-4982-8a8b-c5f86f1bc817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7848865b40f4ec4853693813aa2fe30, user_id=0e12fb373e9841738a3fe04598d3e4c5, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:50.385421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8af07-c5a9-4982-8a8b-c5f86f1bc817 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:50.630451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 828cd474f0014a6db52fce8c57e556f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:50.631533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:50.632612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:50.644294 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3615/7254] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:50 2022] DELETE /identity/v3/roles/828cd474f0014a6db52fce8c57e556f7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:50.644416 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3640/7255] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:50 2022] PUT /identity/v3/projects/f7848865b40f4ec4853693813aa2fe30/users/0e12fb373e9841738a3fe04598d3e4c5/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:50.644594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:50.645315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:50.657198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.657198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.657198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.717124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] MFA Rules not processed for user `0e12fb373e9841738a3fe04598d3e4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:50.718589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:50.815458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eafae-d9af-468f-94b3-18d70ac68519 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:50.842170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:50.842881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:50.843312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:50.843448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/f54e26dc4c4f43a99bf65f83b2c402bb` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:50.852411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f54e26dc4c4f43a99bf65f83b2c402bb)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:50.854118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:50.870336 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:50.887271 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3641/7256] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:50.891793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:50.894747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:51.032857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b75cf-a937-4a1b-8539-6cc757de73c4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:51.040089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:51.040693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:51.040978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:51.041250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:51.041944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:51.044000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:51.094980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role f54e26dc4c4f43a99bf65f83b2c402bb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:51.095305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.096675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.099199 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3616/7257] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:50 2022] DELETE /identity/v3/roles/f54e26dc4c4f43a99bf65f83b2c402bb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:51.104093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:51.105544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:51.121473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:51.194197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118c4e-202a-46b9-a2a9-beba47057b2d tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:51.208128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:51.210274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:51.210764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:51.211666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users/1becc6921c83480fbae506a288a89f22` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:51.213719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1becc6921c83480fbae506a288a89f22)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:51.215966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:51.216983 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3642/7258] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:50 2022] POST /identity/v3/projects => generated 373 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:51.221515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:51.226642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:51.360265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791fcc-7a7d-4e47-a389-701822aeacda admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:51.375623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:51.376265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:51.376566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:51.376935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:51.378738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:51.382447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:51.445612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1becc6921c83480fbae506a288a89f22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.446485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1becc6921c83480fbae506a288a89f22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.532147 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3643/7259] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:51 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:51.538153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:51.556373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667c352-878e-4906-8bcd-e7f28763027a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:51.561364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1becc6921c83480fbae506a288a89f22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.566554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:51.567569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:51.568051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:51.569026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:51.570199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:51.573295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:51.574064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1becc6921c83480fbae506a288a89f22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.575881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1becc6921c83480fbae506a288a89f22'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:51.602217 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3644/7260] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:28:51.605265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:51.623580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:51.651286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd42be2-3d91-49bf-a5d4-b948ed32fa2b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:51.654035 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3617/7261] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:51 2022] DELETE /identity/v3/users/1becc6921c83480fbae506a288a89f22 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:51.655064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:51.656504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:51.744074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f7830-e9d8-410a-b24c-79645a2af3fb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:51.749625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:51.751296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:51.751696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:51.752049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/1f80811c13314e5093ee7a407a42728b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:51.753437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f80811c13314e5093ee7a407a42728b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:51.755499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:51.770017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:51.771964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:51.772403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:51.773485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] PATH_INFO: `/v3/projects/d3f64eab0860425b96a4785df901f191/users/d69273d938d44e36b4c14e1b31e0efa8/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:51.776596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:51.794079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f64eab0860425b96a4785df901f191, user_id=d69273d938d44e36b4c14e1b31e0efa8, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:51.796851 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:51.925287 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3645/7262] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:51 2022] PUT /identity/v3/projects/d3f64eab0860425b96a4785df901f191/users/d69273d938d44e36b4c14e1b31e0efa8/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:51.929303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:51.930039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:52.003393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65610335-0e6a-44fd-acf9-c07a4e771791 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:52.079706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f80811c13314e5093ee7a407a42728b', 'request_id': 'req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:52.081966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:52.082749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.083094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.083439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.084219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:52.086862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:52.097916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f80811c13314e5093ee7a407a42728b', 'request_id': 'req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:52.108847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f80811c13314e5093ee7a407a42728b', 'request_id': 'req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:52.127082 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3646/7263] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:28:52.127082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:52.136437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e36a-f77f-4d88-a6e1-74b89a4c2d3c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:52.142222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dda30-02fd-48ae-8312-5e1cc974174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:52.150409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dda30-02fd-48ae-8312-5e1cc974174d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.150818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dda30-02fd-48ae-8312-5e1cc974174d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.151244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dda30-02fd-48ae-8312-5e1cc974174d admin admin] PATH_INFO: `/v3/projects/d3f64eab0860425b96a4785df901f191/users/d69273d938d44e36b4c14e1b31e0efa8/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.153604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dda30-02fd-48ae-8312-5e1cc974174d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f64eab0860425b96a4785df901f191, user_id=d69273d938d44e36b4c14e1b31e0efa8, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:52.157507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dda30-02fd-48ae-8312-5e1cc974174d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:52.172929 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3647/7264] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:52 2022] PUT /identity/v3/projects/d3f64eab0860425b96a4785df901f191/users/d69273d938d44e36b4c14e1b31e0efa8/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:52.186287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.186836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.187410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.203145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] The token cache is being invalidate because project 1f80811c13314e5093ee7a407a42728b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:52.203961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:52.204995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:52.207963 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3618/7265] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:51 2022] DELETE /identity/v3/projects/1f80811c13314e5093ee7a407a42728b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:52.215487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:52.217552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:52.242523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] MFA Rules not processed for user `d69273d938d44e36b4c14e1b31e0efa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:52.243793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:52.357811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef431-d5dc-40c4-8c9d-dc4f9f7c6f78 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:52.390352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:52.400358 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3648/7266] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:52.404631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:52.423802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8635-8f9b-489c-bba2-88e072de5990 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:52.447196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:52.448927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.449277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.449560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.452412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:52.457672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:52.484955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:52.486973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.498412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.499017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.500551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:52.502921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:52.662884 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3619/7267] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:52 2022] POST /identity/v3/projects => generated 329 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:52.665962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:52.694820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3649/7268] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:28:52 2022] POST /identity/v3/projects => generated 351 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:52.699870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:52.755223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:52.774997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46905533-63d9-4914-8bcf-513a12127d4b tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:52.843409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfaf40-9046-4afe-890e-d8afe75a7858 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:52.860874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:52.861623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.861933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.862223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.862884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:52.865683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:52.875454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:52.880867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:52.880867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:52.880867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:52.880867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:52.881784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:52.976353 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3650/7269] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:28:52 2022] POST /identity/v3/projects => generated 349 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:52.981452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.010358 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3620/7270] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:28:52 2022] POST /identity/v3/users => generated 416 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:53.014059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.027706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ab9c0-8a9f-410b-b755-7c48edc5bcfb tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.077908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4888-b539-48e3-9257-5d7c6c059a11 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.084803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.085764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.086271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.086708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/users/0e12fb373e9841738a3fe04598d3e4c5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.088229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:get_user(user_id=0e12fb373e9841738a3fe04598d3e4c5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.090758 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.093098 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3651/7271] 10.222.0.78 () {58 vars in 1221 bytes} [Sun Aug 28 20:28:52 2022] GET /identity/v3/users/0e12fb373e9841738a3fe04598d3e4c5 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:53.097987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.110169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db589-54b5-4c6d-a76b-7762349b6425 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.111131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.111954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.112453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.112734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.113427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.116003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.117579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.119182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.119182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.119182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.119839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.121783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.189413 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3621/7272] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/roles => generated 244 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:53.194935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.207809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e31c82-e484-4332-8f65-bdbfa46f4d06 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.214574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.215273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.215562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.215911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.223037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.223037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.270952 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3652/7273] 10.222.0.78 () {60 vars in 1162 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/credentials => generated 429 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:53.280150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.287197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6097-b8db-4136-87df-13294ed1dff6 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.293996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.299618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.299618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.299618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials/3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.299618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.300131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.303597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.305431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.350592 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3622/7274] 10.222.0.78 () {60 vars in 1143 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/roles => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:53.354805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.366938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8df18-c304-4c10-827f-4e7693169031 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.377045 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3653/7275] 10.222.0.78 () {60 vars in 1358 bytes} [Sun Aug 28 20:28:53 2022] PATCH /identity/v3/credentials/3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9 => generated 436 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:53.378462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.380715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.381735 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.382147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.382521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/122de0ac6e764794b2d26aa3ee7842ef/users/cc46571ecf294d9a83c97845cdd843b4/roles/89e79cbdc49f456ca6b8750bb5eaff51` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.395082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8509e4-3585-4e92-884d-4408634bd491 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.401941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.402606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.402901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.403166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials/3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.405817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.406401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=122de0ac6e764794b2d26aa3ee7842ef, user_id=cc46571ecf294d9a83c97845cdd843b4, role_id=89e79cbdc49f456ca6b8750bb5eaff51)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.407908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.410354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.414336 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3654/7276] 10.222.0.78 () {58 vars in 1335 bytes} [Sun Aug 28 20:28:53 2022] GET /identity/v3/credentials/3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9 => generated 436 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:53.415687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.427328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaf276-eeb2-480a-bcb1-b853f99f94ac tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.434697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.435363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.435662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.435922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials/3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.438058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.439863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.483555 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3623/7277] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:53 2022] PUT /identity/v3/projects/122de0ac6e764794b2d26aa3ee7842ef/users/cc46571ecf294d9a83c97845cdd843b4/roles/89e79cbdc49f456ca6b8750bb5eaff51 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:53.487647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.547700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:53.573926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a671e3-82a6-4fef-b723-0a1769862a04 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.574157 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3655/7278] 10.222.0.78 () {58 vars in 1338 bytes} [Sun Aug 28 20:28:53 2022] DELETE /identity/v3/credentials/3def77e8345daa67a5ff24f49d275fe17ded837f32d7fbbf6f387f627d339ec9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:53.576303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.587802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe60eb-11cb-4f8d-84cf-4cb3437a0c97 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.590267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.591081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.591372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.591651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/122de0ac6e764794b2d26aa3ee7842ef/users/cc46571ecf294d9a83c97845cdd843b4/roles/1c772a0256b8410d93c71a58de1629de` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.595846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=122de0ac6e764794b2d26aa3ee7842ef, user_id=cc46571ecf294d9a83c97845cdd843b4, role_id=1c772a0256b8410d93c71a58de1629de)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.598662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.612759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:53.662999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.663241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.663450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.663734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.664407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.666386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.717599 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3624/7279] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:28:53 2022] PUT /identity/v3/projects/122de0ac6e764794b2d26aa3ee7842ef/users/cc46571ecf294d9a83c97845cdd843b4/roles/1c772a0256b8410d93c71a58de1629de => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:53.722534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.803353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21d4e-704d-4bdc-90b0-342f98f63aa3 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.811383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5f78-0132-4e0e-a2ae-d8a6c691a420 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.812118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5f78-0132-4e0e-a2ae-d8a6c691a420 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.812465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5f78-0132-4e0e-a2ae-d8a6c691a420 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.812747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5f78-0132-4e0e-a2ae-d8a6c691a420 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.813489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5f78-0132-4e0e-a2ae-d8a6c691a420 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:53.815469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5f78-0132-4e0e-a2ae-d8a6c691a420 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:53.847897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3625/7280] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:28:53 2022] GET /identity/v3/users => generated 8634 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:28:53.853556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aeffb-8835-496c-932b-fdce35f758f7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.853870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aeffb-8835-496c-932b-fdce35f758f7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.854203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aeffb-8835-496c-932b-fdce35f758f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:53.864438 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3656/7281] 10.222.0.78 () {60 vars in 1162 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/credentials => generated 431 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:53.906890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8c7aeffb-8835-496c-932b-fdce35f758f7 None None] MFA Rules not processed for user `cc46571ecf294d9a83c97845cdd843b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:53.906890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c7aeffb-8835-496c-932b-fdce35f758f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:53.910567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:53.924806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237bab-186e-46b5-a1df-4a6bbaa968c8 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:53.991118 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3626/7282] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:28:53.997971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:53.998608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:53.998890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:53.999166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.001142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.001416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.001690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.002178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.004017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.025208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] MFA Rules not processed for user `cc46571ecf294d9a83c97845cdd843b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:54.027367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:54.040294 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3627/7283] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:54.045225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.058159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be97d6-00e4-478d-a360-39d569ce48cd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.065132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.065655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.065972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.066322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.067174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:create_trust()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.068481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.113372 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3657/7284] 10.222.0.78 () {60 vars in 1162 bytes} [Sun Aug 28 20:28:53 2022] POST /identity/v3/credentials => generated 430 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:28:54.119240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.134955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6746e94-da48-48ca-9709-d681d2af0356 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.142608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.143339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.144480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.144889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.145910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.148912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.160332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.162908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.165650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.170868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.174439 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3658/7285] 10.222.0.78 () {58 vars in 1140 bytes} [Sun Aug 28 20:28:54 2022] GET /identity/v3/credentials => generated 946 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:54.176821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.200254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:54.206265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5c4fd-9ff9-4e20-95c7-34b37d28f628 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.213421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.214296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.214606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.215076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials/1afcbcc47e4db86dfb1ba186e754cf0ab116f502e0b4db6bac19f47c5d0be834` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.217273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=1afcbcc47e4db86dfb1ba186e754cf0ab116f502e0b4db6bac19f47c5d0be834)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.219092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.339968 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3628/7286] 10.222.0.78 () {60 vars in 1174 bytes} [Sun Aug 28 20:28:54 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:28:54.345244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.356200 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3659/7287] 10.222.0.78 () {58 vars in 1338 bytes} [Sun Aug 28 20:28:54 2022] DELETE /identity/v3/credentials/1afcbcc47e4db86dfb1ba186e754cf0ab116f502e0b4db6bac19f47c5d0be834 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:54.357719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf0823-53f1-4643-a128-7d4673b062de tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.362248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.364315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.365105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.365489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.365829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.375759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bac3b-39c2-4983-bd0c-3bc14f393a0b tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.378702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:get_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.379859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.388983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.389644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.390047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.394434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/credentials/052742cd72b9e6ae9b15661996e7655c1a73ccbd94654c3704a6b43b9f6ea5a0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.394434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=052742cd72b9e6ae9b15661996e7655c1a73ccbd94654c3704a6b43b9f6ea5a0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.394434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.404678 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3629/7288] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:54 2022] GET /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8 => generated 835 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:54.410949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.432851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f26f5-92b6-4123-b519-126d8bd4cb45 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.440015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.441450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.442062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.442640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.458757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.461611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.476545 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3630/7289] 10.222.0.78 () {58 vars in 1269 bytes} [Sun Aug 28 20:28:54 2022] GET /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles => generated 371 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:28:54.482244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.496731 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3660/7290] 10.222.0.78 () {58 vars in 1338 bytes} [Sun Aug 28 20:28:54 2022] DELETE /identity/v3/credentials/052742cd72b9e6ae9b15661996e7655c1a73ccbd94654c3704a6b43b9f6ea5a0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:54.500540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f285c-8f36-466f-a0b6-d692fa8f3f14 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.507183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.510655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.511775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.512252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.512803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/89e79cbdc49f456ca6b8750bb5eaff51` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.524754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8, role_id=89e79cbdc49f456ca6b8750bb5eaff51)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.525700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b143a-47a0-4b63-b77c-ddb95e345e18 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.527560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.534212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.536706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.537694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.538010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/projects/14e5d98a27dc4d419510afadd09d6547` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.542230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14e5d98a27dc4d419510afadd09d6547)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.548562 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3631/7291] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:28:54 2022] GET /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/89e79cbdc49f456ca6b8750bb5eaff51 => generated 244 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:28:54.548777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.553746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.592048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b666b-c8ce-4ce5-9528-deeadf54989f tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.622588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.623788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.624311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.624743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/89e79cbdc49f456ca6b8750bb5eaff51` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.652076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8, role_id=89e79cbdc49f456ca6b8750bb5eaff51)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.654141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.668805 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3632/7292] 10.222.0.78 () {58 vars in 1369 bytes} [Sun Aug 28 20:28:54 2022] HEAD /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/89e79cbdc49f456ca6b8750bb5eaff51 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 20:28:54.675023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.691579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7081338-b897-4dbd-a08d-837833536564 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.710645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.712907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.713820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.720851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/1c772a0256b8410d93c71a58de1629de` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.731117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8, role_id=1c772a0256b8410d93c71a58de1629de)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.733070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Could not find role: 1c772a0256b8410d93c71a58de1629de.: keystone.exception.RoleNotFound: Could not find role: 1c772a0256b8410d93c71a58de1629de. Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:28:54.749438 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1c772a0256b8410d93c71a58de1629de. Aug 28 20:28:54.758744 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:54.758744 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3633/7293] 10.222.0.78 () {58 vars in 1368 bytes} [Sun Aug 28 20:28:54 2022] GET /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/1c772a0256b8410d93c71a58de1629de => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 20:28:54.761003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.782698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f01f90-013b-43d7-b4a9-11d9caae5668 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.791261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:54.791261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `HEAD` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:54.791261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:54.791933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/1c772a0256b8410d93c71a58de1629de` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:54.800556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8, role_id=1c772a0256b8410d93c71a58de1629de)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:54.802825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Could not find role: 1c772a0256b8410d93c71a58de1629de.: keystone.exception.RoleNotFound: Could not find role: 1c772a0256b8410d93c71a58de1629de. Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 20:28:54.815674 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1c772a0256b8410d93c71a58de1629de. Aug 28 20:28:54.826244 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:54.826244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3634/7294] 10.222.0.78 () {58 vars in 1369 bytes} [Sun Aug 28 20:28:54 2022] HEAD /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8/roles/1c772a0256b8410d93c71a58de1629de => generated 0 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:54.826244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.832399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e5d98a27dc4d419510afadd09d6547', 'request_id': 'req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:54.841443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e5d98a27dc4d419510afadd09d6547', 'request_id': 'req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:54.857100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b751f9f-cd91-4e7b-abfd-77fc5a59c472 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:54.861568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e5d98a27dc4d419510afadd09d6547', 'request_id': 'req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:54.877307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:54.977977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] The token cache is being invalidate because project 14e5d98a27dc4d419510afadd09d6547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:54.978253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:54.982143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:54.984297 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3661/7295] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:54 2022] DELETE /identity/v3/projects/14e5d98a27dc4d419510afadd09d6547 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:54.989242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:54.994702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:54.996108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:55.005695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:55.006137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:55.006601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:55.042221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorizing `identity:delete_trust(trust_id=fba5461b9fd74a3296954944bcd3e2d8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:55.044286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:55.151348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b3c2-25f9-4e5b-8e5e-a2be3f735129 tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:55.158498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69273d938d44e36b4c14e1b31e0efa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3f64eab0860425b96a4785df901f191', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:55.160022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:55.160549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:55.161062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] PATH_INFO: `/v3/projects/15ad04b6c2f742b695cb68104e167b11` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:55.163556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15ad04b6c2f742b695cb68104e167b11)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:55.167485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:55.199608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'fba5461b9fd74a3296954944bcd3e2d8', 'request_id': 'req-de3db7a7-fbd9-4e65-92b8-a91447ce2258'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.285312 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fba5461b9fd74a3296954944bcd3e2d8', 'request_id': 'req-de3db7a7-fbd9-4e65-92b8-a91447ce2258'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.288248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fba5461b9fd74a3296954944bcd3e2d8', 'request_id': 'req-de3db7a7-fbd9-4e65-92b8-a91447ce2258'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.332221 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3635/7296] 10.222.0.78 () {58 vars in 1254 bytes} [Sun Aug 28 20:28:54 2022] DELETE /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:55.336944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:55.341247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:55.384355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ad04b6c2f742b695cb68104e167b11', 'request_id': 'req-8d5dd35b-a863-4e0d-a827-62ad51317f4a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.397224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ad04b6c2f742b695cb68104e167b11', 'request_id': 'req-8d5dd35b-a863-4e0d-a827-62ad51317f4a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.401746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3db7a7-fbd9-4e65-92b8-a91447ce2258 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:55.413082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ad04b6c2f742b695cb68104e167b11', 'request_id': 'req-8d5dd35b-a863-4e0d-a827-62ad51317f4a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.420768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:55.538079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc46571ecf294d9a83c97845cdd843b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122de0ac6e764794b2d26aa3ee7842ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1867212648', 'tempest-NotDelegatedRole-409467771'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:55.539908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:55.540232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:55.540604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] PATH_INFO: `/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:55.547989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] The token cache is being invalidate because project 15ad04b6c2f742b695cb68104e167b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:55.549081 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.560574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:55.570194 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3662/7297] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:54 2022] DELETE /identity/v3/projects/15ad04b6c2f742b695cb68104e167b11 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:55.578379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Could not find trust: fba5461b9fd74a3296954944bcd3e2d8.: keystone.exception.TrustNotFound: Could not find trust: fba5461b9fd74a3296954944bcd3e2d8. Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 20:28:55.578910 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: fba5461b9fd74a3296954944bcd3e2d8. Aug 28 20:28:55.580723 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:28:55.585292 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:55.587923 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3636/7298] 10.222.0.78 () {58 vars in 1251 bytes} [Sun Aug 28 20:28:55 2022] GET /identity/v3/OS-TRUST/trusts/fba5461b9fd74a3296954944bcd3e2d8 => generated 111 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:28:55.594930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:55.603870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:55.753694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dd35b-a863-4e0d-a827-62ad51317f4a tempest-CredentialsTestJSON-851631799 tempest-CredentialsTestJSON-851631799-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:55.770136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:55.776086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:55.802473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:55.802473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] PATH_INFO: `/v3/users/0e12fb373e9841738a3fe04598d3e4c5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:55.808403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e12fb373e9841738a3fe04598d3e4c5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:55.815247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:55.842918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edf8c-92db-4089-88b0-9738e1dce8b1 tempest-TrustsV3TestJSON-1058803418 tempest-user-1513503400] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:55.852492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:55.853421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:55.853833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:55.854510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/1c772a0256b8410d93c71a58de1629de` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:55.861888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1c772a0256b8410d93c71a58de1629de)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:55.877257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:55.943808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:56.217960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 1c772a0256b8410d93c71a58de1629de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:56.221906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.226337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.231050 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3637/7299] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:55 2022] DELETE /identity/v3/roles/1c772a0256b8410d93c71a58de1629de => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:56.237612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:56.242442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:56.244226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e12fb373e9841738a3fe04598d3e4c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.294731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e12fb373e9841738a3fe04598d3e4c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.336100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e12fb373e9841738a3fe04598d3e4c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.338183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e12fb373e9841738a3fe04598d3e4c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.340411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-89be4c18-7df8-4ba7-a80f-0b1712759dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e12fb373e9841738a3fe04598d3e4c5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.484633 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3663/7300] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:55 2022] DELETE /identity/v3/users/0e12fb373e9841738a3fe04598d3e4c5 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:56.494897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:56.509297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:56.509297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:56.509946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0707-6d27-490b-909d-0813ead57ced tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:56.553889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:28:56.555654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:56.561839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:56.636608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:56.637988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:56.638631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:56.639276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/roles/89e79cbdc49f456ca6b8750bb5eaff51` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:56.643825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=89e79cbdc49f456ca6b8750bb5eaff51)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:56.647113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:56.744317 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3664/7301] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:28:56.758708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:56.760920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:56.909494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invalidating the token cache because role 89e79cbdc49f456ca6b8750bb5eaff51 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:56.910719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.914040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:56.935296 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3638/7302] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:56 2022] DELETE /identity/v3/roles/89e79cbdc49f456ca6b8750bb5eaff51 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:56.941508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:56.944583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:57.024443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd3010-331c-4cb9-820b-15fa26b7867b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:57.294331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:57.295112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:57.295402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:57.295680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:57.300076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:57.320232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12805679-c31b-4a38-8714-fba4908a59d8 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:57.346162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:57.352573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:57.354117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:57.354308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:57.356303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/users/cc46571ecf294d9a83c97845cdd843b4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:57.358610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cc46571ecf294d9a83c97845cdd843b4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:57.367131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:57.530236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:57.532026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:57.546001 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3665/7303] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:57.647789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc46571ecf294d9a83c97845cdd843b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:57.648625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc46571ecf294d9a83c97845cdd843b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:57.762909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc46571ecf294d9a83c97845cdd843b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:57.788696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc46571ecf294d9a83c97845cdd843b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:57.791328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc46571ecf294d9a83c97845cdd843b4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:57.842292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3639/7304] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:56 2022] DELETE /identity/v3/users/cc46571ecf294d9a83c97845cdd843b4 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:57.848420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:57.869406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8c490-4205-4fbd-8f9c-fc1f371693c0 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:58.002073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2316395e88441c8722a60fb38bde27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f3bd454174c4682b5325447b317a82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:58.003193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:58.003751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:58.004278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] PATH_INFO: `/v3/projects/122de0ac6e764794b2d26aa3ee7842ef` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:58.006559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=122de0ac6e764794b2d26aa3ee7842ef)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:58.009473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:58.214240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:58.215952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:58.234281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:58.329894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f928-45de-4586-9734-2348e4ac86c5 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:58.357051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122de0ac6e764794b2d26aa3ee7842ef', 'request_id': 'req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.371864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122de0ac6e764794b2d26aa3ee7842ef', 'request_id': 'req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.396552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122de0ac6e764794b2d26aa3ee7842ef', 'request_id': 'req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.514889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] The token cache is being invalidate because project 122de0ac6e764794b2d26aa3ee7842ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:58.515462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.516593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.519834 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3666/7305] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:57 2022] DELETE /identity/v3/projects/122de0ac6e764794b2d26aa3ee7842ef => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:28:58.530121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:58.532178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:58.532393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:58.538392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:58.540702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:58.540702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] PATH_INFO: `/v3/projects/f7848865b40f4ec4853693813aa2fe30` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:58.543944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7848865b40f4ec4853693813aa2fe30)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:58.548448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:58.571367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc8f6e-6f0f-4c0c-898b-2945fa11b0f9 tempest-TrustsV3TestJSON-391049254 tempest-TrustsV3TestJSON-391049254-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:58.583492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:58.585002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:58.585744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:58.586745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] PATH_INFO: `/v3/users/a612dd11726d4934b1f41b6e02380b7a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:58.588374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a612dd11726d4934b1f41b6e02380b7a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:58.591848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:58.747832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7848865b40f4ec4853693813aa2fe30', 'request_id': 'req-7792d116-d632-40ad-b033-d939c29d3aa9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.759717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7848865b40f4ec4853693813aa2fe30', 'request_id': 'req-7792d116-d632-40ad-b033-d939c29d3aa9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.777490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7848865b40f4ec4853693813aa2fe30', 'request_id': 'req-7792d116-d632-40ad-b033-d939c29d3aa9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.935773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] The token cache is being invalidate because project f7848865b40f4ec4853693813aa2fe30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:28:58.935773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.935773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:58.935773 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3640/7306] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:28:58 2022] DELETE /identity/v3/projects/f7848865b40f4ec4853693813aa2fe30 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:58.935773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:58.936340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:59.084105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:59.124491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d116-d632-40ad-b033-d939c29d3aa9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:59.131325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:59.132018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:59.132495 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:59.132781 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] PATH_INFO: `/v3/users/d69273d938d44e36b4c14e1b31e0efa8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:59.134253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69273d938d44e36b4c14e1b31e0efa8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:59.136775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:59.199501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:59.233119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a612dd11726d4934b1f41b6e02380b7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.273432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a612dd11726d4934b1f41b6e02380b7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.292262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a612dd11726d4934b1f41b6e02380b7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.293464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a612dd11726d4934b1f41b6e02380b7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.294184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a612dd11726d4934b1f41b6e02380b7a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.473734 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3667/7307] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:58 2022] DELETE /identity/v3/users/a612dd11726d4934b1f41b6e02380b7a => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:59.476019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:59.477799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:59.614516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69273d938d44e36b4c14e1b31e0efa8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.615680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69273d938d44e36b4c14e1b31e0efa8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.618811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910d605-cc80-4b77-a158-96ce0b559eea admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:59.628639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:59.629780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:59.630291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:59.632111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] PATH_INFO: `/v3/users/63a31a8f33e540aeba3e88b6ab510520` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:59.634531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a31a8f33e540aeba3e88b6ab510520)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:59.636880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:59.703984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69273d938d44e36b4c14e1b31e0efa8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.728718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69273d938d44e36b4c14e1b31e0efa8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.734950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69273d938d44e36b4c14e1b31e0efa8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:28:59.777129 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3641/7308] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:58 2022] DELETE /identity/v3/users/d69273d938d44e36b4c14e1b31e0efa8 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:28:59.780122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:59.789349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:59.960461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360498cf-5a12-4159-81f2-1763c3bcc371 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:59.969519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:59.970740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:59.971300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:59.971905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] PATH_INFO: `/v3/users/46645ce79a674b29bc7b0805f553726f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:59.974224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=46645ce79a674b29bc7b0805f553726f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:59.978270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:00.012459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a31a8f33e540aeba3e88b6ab510520'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.034160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a31a8f33e540aeba3e88b6ab510520'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.041612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a31a8f33e540aeba3e88b6ab510520'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.043075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a31a8f33e540aeba3e88b6ab510520'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.044186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e61dec5b-3b2d-4f5d-9636-6ef589caae8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a31a8f33e540aeba3e88b6ab510520'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.141589 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3668/7309] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:59 2022] DELETE /identity/v3/users/63a31a8f33e540aeba3e88b6ab510520 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:00.145125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239c64f-56ec-4410-a1d8-d964ca94130b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.146026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239c64f-56ec-4410-a1d8-d964ca94130b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.146505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239c64f-56ec-4410-a1d8-d964ca94130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.190763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c239c64f-56ec-4410-a1d8-d964ca94130b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:00.193931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c239c64f-56ec-4410-a1d8-d964ca94130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.277220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46645ce79a674b29bc7b0805f553726f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.277978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46645ce79a674b29bc7b0805f553726f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.314978 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3669/7310] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:00.314978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.314978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.314978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.348484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:00.350241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.366239 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3670/7311] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:00.367720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:00.369524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.379207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46645ce79a674b29bc7b0805f553726f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.401654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46645ce79a674b29bc7b0805f553726f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.402905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46645ce79a674b29bc7b0805f553726f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.439556 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3642/7312] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:28:59 2022] DELETE /identity/v3/users/46645ce79a674b29bc7b0805f553726f => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:00.441357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:00.443422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.478566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed47b-afd6-4430-ae84-1f037d574c6b None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:00.564710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4832f-8d52-42bf-9783-a55d0949dcdd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:00.567141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:00.568397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.568686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.585054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.585681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:00.585681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.585681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.585681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.586114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.586216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.705334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:00.708992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:00.709441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:00.710898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830f67b-11ff-4bac-9f46-e79075561ebb service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:00.724793 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3643/7313] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:00.726685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.726967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.727430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.729836 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3671/7314] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:00.731900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:00.734454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.752915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d40ec-81c5-4fc2-a7ca-0fdee69842e9 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:00.753129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:00.754090 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.760980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:00.761927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.763103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.763392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] PATH_INFO: `/v3/projects/d3f64eab0860425b96a4785df901f191` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.764706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f64eab0860425b96a4785df901f191)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:00.767092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:00.774095 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3644/7315] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:00.792857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:00.797323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:00.836409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88bb46-a946-4292-a03d-b27fb9c7af74 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:00.858201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae80e74-429f-4189-aa34-f9d03e66c14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:00.858201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae80e74-429f-4189-aa34-f9d03e66c14d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:00.858201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae80e74-429f-4189-aa34-f9d03e66c14d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:00.858201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae80e74-429f-4189-aa34-f9d03e66c14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:00.869893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae80e74-429f-4189-aa34-f9d03e66c14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:00.869893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae80e74-429f-4189-aa34-f9d03e66c14d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:00.886392 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3645/7316] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:00.910938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f64eab0860425b96a4785df901f191', 'request_id': 'req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.945678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f64eab0860425b96a4785df901f191', 'request_id': 'req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:00.978953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f64eab0860425b96a4785df901f191', 'request_id': 'req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.075217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] The token cache is being invalidate because project d3f64eab0860425b96a4785df901f191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:01.075523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.076397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.078164 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3672/7317] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:00 2022] DELETE /identity/v3/projects/d3f64eab0860425b96a4785df901f191 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:01.086991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d2af-57bd-4cf9-999e-fdb522a20c82 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.087455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d2af-57bd-4cf9-999e-fdb522a20c82 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.087583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d2af-57bd-4cf9-999e-fdb522a20c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.121835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-eb35d2af-57bd-4cf9-999e-fdb522a20c82 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:01.124760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eb35d2af-57bd-4cf9-999e-fdb522a20c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:01.175099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:01.258860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:01.264422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:01.275587 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3646/7318] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:01.287871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.294396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.294940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.328733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:01.330830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:01.332796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b40b6-eef3-4770-beb8-aa3111ad3e8e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:01.347998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:01.349083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.349932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.369384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] PATH_INFO: `/v3/projects/693ced18e2794bd5abe2110d87ba128f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.370328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] RBAC: Authorizing `identity:delete_project(project_id=693ced18e2794bd5abe2110d87ba128f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:01.372339 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3647/7319] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:01.374259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:01.377302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:01.401431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9575f-70b3-4a33-b200-ca43619931ed None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:01.409821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:01.410570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.412734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.413423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.414636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:01.415174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:01.417714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:01.449929 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3648/7320] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:01.453153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:01.465038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05826a91-e977-4079-b82e-7742948023d6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:01.470617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:01.475516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.475516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.475516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.475516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:01.475516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:01.639002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693ced18e2794bd5abe2110d87ba128f', 'request_id': 'req-2b70c4ba-2a63-484a-a3fb-4a50423d041b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.665035 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3649/7321] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:01 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:01.667157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:01.670244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693ced18e2794bd5abe2110d87ba128f', 'request_id': 'req-2b70c4ba-2a63-484a-a3fb-4a50423d041b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.672216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:01.690599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693ced18e2794bd5abe2110d87ba128f', 'request_id': 'req-2b70c4ba-2a63-484a-a3fb-4a50423d041b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.790275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b368-01c3-4244-9bae-d4ec47c51792 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:01.799063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:01.799063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.799063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.799063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] PATH_INFO: `/v3/projects/fb8547b8e8064d818f0d97e0de09767b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.800035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8547b8e8064d818f0d97e0de09767b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:01.802192 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:01.826320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] The token cache is being invalidate because project 693ced18e2794bd5abe2110d87ba128f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:01.826970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.828065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.831246 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3673/7322] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:01 2022] DELETE /identity/v3/projects/693ced18e2794bd5abe2110d87ba128f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:01.832897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:01.835911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:01.927870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70c4ba-2a63-484a-a3fb-4a50423d041b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:01.939430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:01.940072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:01.940613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:01.940771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:01.941563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:01.944824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:01.975588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8547b8e8064d818f0d97e0de09767b', 'request_id': 'req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.981544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8547b8e8064d818f0d97e0de09767b', 'request_id': 'req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:01.988724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8547b8e8064d818f0d97e0de09767b', 'request_id': 'req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.086600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3674/7323] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:01 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:02.086600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:02.094475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.099355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] The token cache is being invalidate because project fb8547b8e8064d818f0d97e0de09767b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:02.099779 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.100744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.103044 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3650/7324] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:01 2022] DELETE /identity/v3/projects/fb8547b8e8064d818f0d97e0de09767b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:02.107494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:02.107494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.122705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b3c05-5dff-4099-ac84-04770c940221 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:02.212048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:02.227084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0dc8-1922-40d3-9217-32bbf1f580a9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:02.234600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:02.235896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.240896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.240896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] PATH_INFO: `/v3/users/52d9d892f5cb4bc0b12ed0eead1123fa` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.240896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d9d892f5cb4bc0b12ed0eead1123fa)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:02.240896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:02.246926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:02.247904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.248304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.248683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] PATH_INFO: `/v3/projects/01c0164468cb452c8b269c6e6050821c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.250287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c0164468cb452c8b269c6e6050821c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:02.252685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:02.530335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c0164468cb452c8b269c6e6050821c', 'request_id': 'req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.532843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d9d892f5cb4bc0b12ed0eead1123fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.533481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d9d892f5cb4bc0b12ed0eead1123fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.538559 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c0164468cb452c8b269c6e6050821c', 'request_id': 'req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.545460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c0164468cb452c8b269c6e6050821c', 'request_id': 'req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.643296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d9d892f5cb4bc0b12ed0eead1123fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.652135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d9d892f5cb4bc0b12ed0eead1123fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.653066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d9d892f5cb4bc0b12ed0eead1123fa'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.672864 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3651/7325] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:02 2022] DELETE /identity/v3/users/52d9d892f5cb4bc0b12ed0eead1123fa => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:02.673690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:02.678260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.726477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] The token cache is being invalidate because project 01c0164468cb452c8b269c6e6050821c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:02.726686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.727296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:02.728922 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3675/7326] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:02 2022] DELETE /identity/v3/projects/01c0164468cb452c8b269c6e6050821c => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:02.730037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:02.731701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.765878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636907-c265-4d1e-b762-0f30378fe0ad admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:02.771378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7cd8-5002-4d6e-8448-a9c3477fc599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:02.772099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7cd8-5002-4d6e-8448-a9c3477fc599 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.772457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7cd8-5002-4d6e-8448-a9c3477fc599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.772983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7cd8-5002-4d6e-8448-a9c3477fc599 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.773817 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7cd8-5002-4d6e-8448-a9c3477fc599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:02.775602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7cd8-5002-4d6e-8448-a9c3477fc599 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:02.788186 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3652/7327] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:02.791141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.791650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.792083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.814372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b58e1-9d95-4333-b033-9d5ded28b1f0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:02.815508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:02.816750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.819992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:02.820867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.821185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.832761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] PATH_INFO: `/v3/users/0a2316395e88441c8722a60fb38bde27` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.832761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2316395e88441c8722a60fb38bde27)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:02.832761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:02.833553 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3653/7328] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:02.833553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:02.833553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.840896 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeed7e8-b485-4a37-b051-ab45a923ac3d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:02.846177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b18c2-b52f-4a41-8865-e831524b4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:02.846796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b18c2-b52f-4a41-8865-e831524b4069 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.847933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b18c2-b52f-4a41-8865-e831524b4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.847933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b18c2-b52f-4a41-8865-e831524b4069 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.848254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b18c2-b52f-4a41-8865-e831524b4069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:02.851902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b18c2-b52f-4a41-8865-e831524b4069 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:02.863257 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3654/7329] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:02.868377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.868672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.869188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.889045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:02.890319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:02.899794 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3655/7330] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:02.900778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:02.911016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93d1d1-c462-4b92-902b-44f632f744c2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:02.916524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:02.919092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:02.919092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:02.919092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] PATH_INFO: `/v3/projects/d2b95d370bd34bd79e79ebeedfafe420/users/c3c610c5f19745d88b3c8725dbb0168d/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:02.934602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b95d370bd34bd79e79ebeedfafe420, user_id=c3c610c5f19745d88b3c8725dbb0168d, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:02.937352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:02.979505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:03.103462 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3656/7331] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:02 2022] PUT /identity/v3/projects/d2b95d370bd34bd79e79ebeedfafe420/users/c3c610c5f19745d88b3c8725dbb0168d/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:03.103462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.161046 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2316395e88441c8722a60fb38bde27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.173885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2316395e88441c8722a60fb38bde27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.174741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599b69-c124-4c49-89af-8c8e968befe9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.180749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.186659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.186659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.186659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.187024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2316395e88441c8722a60fb38bde27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.187133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:03.187133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.187317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2316395e88441c8722a60fb38bde27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.187317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2316395e88441c8722a60fb38bde27'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.187510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f139f8e-793d-4539-a073-092b776ca7ed admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.199573 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3657/7332] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:03.200885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.201176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.201456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.231977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] MFA Rules not processed for user `c3c610c5f19745d88b3c8725dbb0168d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:03.233542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.311149 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3676/7333] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:02 2022] DELETE /identity/v3/users/0a2316395e88441c8722a60fb38bde27 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:03.313773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.315346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.320537 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3658/7334] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:03.321628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.323831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.396556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf402-7468-4f90-b4c8-42da7613ac62 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.401865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e07aea-4c41-4d88-897c-78b6e1fa68eb None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.405300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.406372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.407528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.408062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.408985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.413615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.461267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.462100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.462484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.462881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.464900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.478860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.480502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.492976 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3659/7335] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:03.494019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.496178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.514606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d94a-a6b3-4580-acdd-34606672e1f6 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.518752 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3677/7336] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:03 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:03.518752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.519443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.583586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.584304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.584640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.584942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] PATH_INFO: `/v3/projects/157fb9442d1d44748f04d2183046fd3c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.586740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157fb9442d1d44748f04d2183046fd3c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.590041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.620431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20696b-ed7e-4a70-a35b-097436531956 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.630120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.630797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.635611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.635611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.635611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.635611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.713172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157fb9442d1d44748f04d2183046fd3c', 'request_id': 'req-45034def-cbb2-466b-b729-3897a040b8a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.720168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157fb9442d1d44748f04d2183046fd3c', 'request_id': 'req-45034def-cbb2-466b-b729-3897a040b8a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.736379 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3678/7337] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:03 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:03.737601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.739593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157fb9442d1d44748f04d2183046fd3c', 'request_id': 'req-45034def-cbb2-466b-b729-3897a040b8a2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.815877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd9e23-69f9-4883-a0ab-752ce0694002 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.823199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a366842-d465-4037-83f1-e415442cf157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.823751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a366842-d465-4037-83f1-e415442cf157 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.824119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a366842-d465-4037-83f1-e415442cf157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.824302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a366842-d465-4037-83f1-e415442cf157 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.825635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a366842-d465-4037-83f1-e415442cf157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.827691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a366842-d465-4037-83f1-e415442cf157 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.876485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] The token cache is being invalidate because project 157fb9442d1d44748f04d2183046fd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:03.877115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.877663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:03.879358 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3660/7338] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:03 2022] DELETE /identity/v3/projects/157fb9442d1d44748f04d2183046fd3c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:03.880572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.882168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.902680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:03.921836 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3679/7339] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:03 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:03.925253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.926658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.927047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.952290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:03.953527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.962581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45034def-cbb2-466b-b729-3897a040b8a2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.964711 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3680/7340] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:03.966074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:03.967884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:03.976857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.977484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.978023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.978601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.979575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.982343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:03.985944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e4a0a-7aa7-483c-83d4-2e37f9dd4d93 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:03.992167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:03.992965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:03.993356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:03.993732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] PATH_INFO: `/v3/projects/0f3bd454174c4682b5325447b317a82d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:03.996034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3bd454174c4682b5325447b317a82d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:03.998404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:04.131788 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3661/7341] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:03 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:04.131788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.133624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:04.147944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248a142-0590-413c-a637-f251bce2e6c7 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:04.154372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb1875-90ef-404c-b55d-af3d2b786686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:04.155119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb1875-90ef-404c-b55d-af3d2b786686 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:04.155475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb1875-90ef-404c-b55d-af3d2b786686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:04.155821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb1875-90ef-404c-b55d-af3d2b786686 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:04.157025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb1875-90ef-404c-b55d-af3d2b786686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:04.158263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb1875-90ef-404c-b55d-af3d2b786686 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:04.172584 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3662/7342] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:04.172584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:04.172584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:04.172584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:04.197831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:04.198100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3bd454174c4682b5325447b317a82d', 'request_id': 'req-d8a1e34a-d998-4432-a028-1d44eb8407a2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:04.198743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:04.205670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:04.209384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3bd454174c4682b5325447b317a82d', 'request_id': 'req-d8a1e34a-d998-4432-a028-1d44eb8407a2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:04.220966 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3bd454174c4682b5325447b317a82d', 'request_id': 'req-d8a1e34a-d998-4432-a028-1d44eb8407a2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:04.276396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3663/7343] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:04.277230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.287287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af44f-00d1-47a5-b71d-9faa00918053 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:04.292676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:04.293426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:04.293743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:04.294084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:04.294807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:04.296744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:04.309500 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3664/7344] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:04.310401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.321889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08e5c-87d6-41bc-9a00-68d4cbd1a95a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:04.326830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:04.327443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:04.327727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:04.327995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:04.328638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:04.330272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:04.342506 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3665/7345] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:04.343377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.355492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2780f25-cb8a-42bc-a264-08039a7c425c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:04.361123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:04.361744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:04.362123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:04.362362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:04.363021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:04.363493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:04.365094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:04.378235 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3666/7346] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:04.379166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.391479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9db87-e74e-484a-8900-693fc58b7e67 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:04.396894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:04.397574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:04.397872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:04.398205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] PATH_INFO: `/v3/projects/d4784ecc398843de8d950677c82313e5/users/4a95c9a2dbe7451d90167760ddbb064c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:04.415298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4784ecc398843de8d950677c82313e5, user_id=4a95c9a2dbe7451d90167760ddbb064c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:04.418079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:04.963598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] The token cache is being invalidate because project 0f3bd454174c4682b5325447b317a82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:04.964170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:04.964437 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3667/7347] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:04 2022] PUT /identity/v3/projects/d4784ecc398843de8d950677c82313e5/users/4a95c9a2dbe7451d90167760ddbb064c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:04.965045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:04.967177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.967696 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3681/7348] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:03 2022] DELETE /identity/v3/projects/0f3bd454174c4682b5325447b317a82d => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:04.967847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:04.972755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:04.975097 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.013574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e34a-d998-4432-a028-1d44eb8407a2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.040650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8da6d0-cb07-4944-817c-9492d85b7372 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.045609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.046700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.046986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.047269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] PATH_INFO: `/v3/projects/93b5e75aa65546349bfc3d95468ad2a4/users/54542f1a89e34df5bdb8dc8ed4ad3b88/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.064385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b5e75aa65546349bfc3d95468ad2a4, user_id=54542f1a89e34df5bdb8dc8ed4ad3b88, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.070173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.077375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e7b2-dc39-4278-b30f-aa047d448692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.078018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e7b2-dc39-4278-b30f-aa047d448692 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.078307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e7b2-dc39-4278-b30f-aa047d448692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.078584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e7b2-dc39-4278-b30f-aa047d448692 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.079228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e7b2-dc39-4278-b30f-aa047d448692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.081225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e7b2-dc39-4278-b30f-aa047d448692 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.269775 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3668/7349] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:04 2022] PUT /identity/v3/projects/93b5e75aa65546349bfc3d95468ad2a4/users/54542f1a89e34df5bdb8dc8ed4ad3b88/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:05.269775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.270702 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3682/7350] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:04 2022] POST /identity/v3/projects => generated 375 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:05.270702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391d5fd-82c9-4399-91d0-c5d11d9700cb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.270702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391d5fd-82c9-4399-91d0-c5d11d9700cb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.271504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391d5fd-82c9-4399-91d0-c5d11d9700cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.272848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.294116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=14,keystone:SELECT=81,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:05.296464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b391d5fd-82c9-4399-91d0-c5d11d9700cb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:05.298208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b391d5fd-82c9-4399-91d0-c5d11d9700cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.360876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02790d-38e1-4ea0-8d33-d769c0aadb3c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.379880 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3683/7351] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:05.381447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff651e47-2944-4524-9405-971035690e09 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.381736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff651e47-2944-4524-9405-971035690e09 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.382052 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff651e47-2944-4524-9405-971035690e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.407403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ff651e47-2944-4524-9405-971035690e09 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:05.408784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff651e47-2944-4524-9405-971035690e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.424758 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3684/7352] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:05.425827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff651e47-2944-4524-9405-971035690e09 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.436889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff651e47-2944-4524-9405-971035690e09 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.439473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddf0e2-9112-4bb6-8f2e-cfe527704038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.440349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf0e2-9112-4bb6-8f2e-cfe527704038 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.440639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf0e2-9112-4bb6-8f2e-cfe527704038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.445763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf0e2-9112-4bb6-8f2e-cfe527704038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.445763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddf0e2-9112-4bb6-8f2e-cfe527704038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.446030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.446149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddf0e2-9112-4bb6-8f2e-cfe527704038 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.446248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.446248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.446248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.446248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.446920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.459891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3669/7353] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:05.459891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.459891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.459891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.480455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:05.481715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.493591 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3670/7354] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:05.493591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.493591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.559247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40552c9-5e11-4b47-a3de-7a753a34d7dc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.563102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.563707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.563987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.564259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.574919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.576393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.580520 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3685/7355] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:05.581500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.589284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3671/7356] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:05.590260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.594640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3adc-d29a-4761-8a89-0930de9b8cd7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.601448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565c24-7bba-4183-9f45-5d50e955aef2 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.601717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.602831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.603247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.603515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] PATH_INFO: `/v3/projects/d4784ecc398843de8d950677c82313e5/users/4a95c9a2dbe7451d90167760ddbb064c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.605767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4784ecc398843de8d950677c82313e5, user_id=4a95c9a2dbe7451d90167760ddbb064c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.606529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.607299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.607580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.607905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.608578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:05.609477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.609613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.610560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.629426 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3672/7357] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:05.629426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.630946 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3686/7358] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:05 2022] PUT /identity/v3/projects/d4784ecc398843de8d950677c82313e5/users/4a95c9a2dbe7451d90167760ddbb064c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:05.631799 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.641412 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc875-37a2-4403-a5a8-47ff34ffa0ea admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.707588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f439d-d509-4c4c-acc3-acbbdc353662 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.715635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.715914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147897d-8ad6-4473-b946-f153e6733cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.716434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.716568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147897d-8ad6-4473-b946-f153e6733cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.716724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.716863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147897d-8ad6-4473-b946-f153e6733cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.717004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.717117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147897d-8ad6-4473-b946-f153e6733cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.717660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.717786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147897d-8ad6-4473-b946-f153e6733cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.719328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147897d-8ad6-4473-b946-f153e6733cb7 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.719883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:05.743863 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3673/7359] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:05.745551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.745973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.746357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.788249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] MFA Rules not processed for user `4a95c9a2dbe7451d90167760ddbb064c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:05.790304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:05.833145 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3687/7360] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:05.834755 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.892512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3674/7361] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:05.898769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:05.912628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2d15-18f7-4adf-8a14-d12518b14ccd None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.977694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ac83-ef7b-4a83-bb5d-a7c0f6d22a7d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:05.983728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:05.986520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:05.987154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:05.987806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:05.989071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:05.995648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.019486 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3688/7362] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:06.021053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.040351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.040981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.041270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.041674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.042787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.044882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.123734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5968f-341a-42b2-bbd2-d4a93ea3b002 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.128864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.129520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.129804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.130862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.131532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.141666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.141799 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3675/7363] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:05 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:06.141799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.153184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a20fd-7ee1-4a92-8f54-76eff9cb17e1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.158118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce264-6711-48a8-99ff-1049b336064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.158803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce264-6711-48a8-99ff-1049b336064f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.159075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce264-6711-48a8-99ff-1049b336064f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.159355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce264-6711-48a8-99ff-1049b336064f admin admin] PATH_INFO: `/v3/projects/a53d2813633c4dcab0210a81ff20f549/users/cdf6b4ecef824696bc39abf6ce08e205/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.176545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce264-6711-48a8-99ff-1049b336064f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53d2813633c4dcab0210a81ff20f549, user_id=cdf6b4ecef824696bc39abf6ce08e205, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.179852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce264-6711-48a8-99ff-1049b336064f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.268480 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3689/7365] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:06 2022] POST /identity/v3/services => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:06.268709 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3676/7365] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:06 2022] PUT /identity/v3/projects/a53d2813633c4dcab0210a81ff20f549/users/cdf6b4ecef824696bc39abf6ce08e205/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:06.268846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.270020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.270579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.270899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.293657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:06.294918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:06.309246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a7c8-5895-4a78-ba53-65ab732b9e08 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.394551 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3677/7366] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:06 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:06.397377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.499765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.500398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.500952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.501380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.502156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.503995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.522088 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3690/7367] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:06.522088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.523396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916af0c-23e5-4802-9999-2cf7cfcd7891 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.534001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.535326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.535903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.536278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.537690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.539798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: On instance['enabled']: Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: On instance['enabled']: Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: 'False' Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise error Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'False' Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.548830 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:29:06.550974 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'False' Aug 28 20:29:06.552455 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.554395 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3678/7368] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:29:06 2022] POST /identity/v3/endpoints => generated 283 bytes in 159 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:29:06.557278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.576465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a10a1-9712-4868-b0b0-771e92f78f88 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.579259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.579984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.580362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.580737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.581532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.584600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.604048 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3679/7369] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:06.604048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.621807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b3ff4-f322-4529-9c06-7fcb57ca7414 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.625105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:06.632665 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.638906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.638906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.638906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.639338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e30cec-9970-463f-bb02-ff5db2f13e90 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.639449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.639449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.641575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.642352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.642714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.643607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: On instance['enabled']: Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: On instance['enabled']: Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: 'True' Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise error Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'True' Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.646869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:29:06.648879 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'True' Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3680/7370] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:29:06 2022] POST /identity/v3/endpoints => generated 281 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:29:06.650869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.671405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.674789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.679298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defe661-9c59-4fd4-b964-84faa936d195 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.688917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6099970-e473-46b2-99ce-8e031ce67f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.689639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6099970-e473-46b2-99ce-8e031ce67f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.689916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6099970-e473-46b2-99ce-8e031ce67f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.690222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6099970-e473-46b2-99ce-8e031ce67f3e admin admin] PATH_INFO: `/v3/projects/480c40f875c44ba68c4c4f9170038f59/users/e51a315a350346c8b24042e34c0b544b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.697011 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3691/7371] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:06 2022] GET /identity/v3/auth/tokens => generated 3373 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:06.698542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:06.712392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6099970-e473-46b2-99ce-8e031ce67f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=480c40f875c44ba68c4c4f9170038f59, user_id=e51a315a350346c8b24042e34c0b544b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.712653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde96a-cf1f-4335-8c47-ebeeff7c8cb5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:06.716020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6099970-e473-46b2-99ce-8e031ce67f3e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.718926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:06.725231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.725231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.725231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.725231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:06.725231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:06.803106 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1659527619. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:29:06.803106 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:29:06.803106 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:29:06.809785 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3681/7372] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:06 2022] PUT /identity/v3/projects/480c40f875c44ba68c4c4f9170038f59/users/e51a315a350346c8b24042e34c0b544b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:06.900623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:06.917257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:06.917556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:06.918269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:06.956316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] MFA Rules not processed for user `e51a315a350346c8b24042e34c0b544b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:06.957727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:06.969744 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3692/7373] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:29:06 2022] POST /identity/v3/endpoints => generated 360 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:06.973660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.012971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945b51-6be3-4291-8ea2-a9d89827566f tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.080521 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3682/7374] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:06 2022] POST /identity/v3/auth/tokens => generated 3564 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:07.082354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.092700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78055c-4d6b-4df1-bdeb-f176c82eecab None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.100918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.101986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.102668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.103178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/regions/tempest-region-1659527619` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.104018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1659527619)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.105490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.112474 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3693/7375] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:29:06 2022] GET /identity/v3/regions/tempest-region-1659527619 => generated 180 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:29:07.116995 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.126328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7babf-60b4-4b66-a7e1-dbc647c97347 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.140318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.140536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.140751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.141041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.141734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:create_application_credential(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.143084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.144863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.145886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.150440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.150440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints/e9ebb5fe5ec14ff980c9509fd3248082` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.155635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e9ebb5fe5ec14ff980c9509fd3248082)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.157954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: On instance['enabled']: Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: On instance['enabled']: Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: 'False' Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise error Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application 'False' Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.168178 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:29:07.170765 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application 'False' Aug 28 20:29:07.172341 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.173352 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3694/7376] 10.222.0.78 () {60 vars in 1255 bytes} [Sun Aug 28 20:29:07 2022] PATCH /identity/v3/endpoints/e9ebb5fe5ec14ff980c9509fd3248082 => generated 283 bytes in 60 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:29:07.174644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.192297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f17696-c998-4ef2-b803-55c6dd971dd6 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.199105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.199883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.201985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.201985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints/e9ebb5fe5ec14ff980c9509fd3248082` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.201985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e9ebb5fe5ec14ff980c9509fd3248082)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.203889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.267621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e9ebb5fe5ec14ff980c9509fd3248082', 'request_id': 'req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:07.289466 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3695/7377] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:29:07 2022] DELETE /identity/v3/endpoints/e9ebb5fe5ec14ff980c9509fd3248082 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:07.291772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.326638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa47aa-3a86-45e3-8b4d-6bda5452e8a4 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.340071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.340750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.343426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.345840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/regions/tempest-region-1659527619` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.347488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1659527619)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.348376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.472264 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3683/7378] 10.222.0.78 () {60 vars in 1315 bytes} [Sun Aug 28 20:29:07 2022] POST /identity/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials => generated 920 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:07.478116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.492601 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3696/7379] 10.222.0.78 () {58 vars in 1209 bytes} [Sun Aug 28 20:29:07 2022] DELETE /identity/v3/regions/tempest-region-1659527619 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:07.499667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.525742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c503-3d29-49e1-9d78-778e841e9817 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.538147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1dbf-4d15-4296-8c2c-608f82c9f930 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.545454 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.546837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.547339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.548101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.549508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.553487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.577059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.582516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.583075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.584086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules/166d9b7e3a2747f6b43f859480bd4c8e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.585951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:delete_access_rule(user_id=e51a315a350346c8b24042e34c0b544b, access_rule_id=166d9b7e3a2747f6b43f859480bd4c8e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.587756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.662614 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-476611319. To ensure interoperability, identifiers should be a valid uuid. Aug 28 20:29:07.662614 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 20:29:07.662614 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application session.delete(ref) Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application next(self.gen) Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application yield resource Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application next(self.gen) Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 20:29:07.669240 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise self.value Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application session.commit() Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.session.flush() Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 20:29:07.671906 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application compat.raise_( Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self._synchronize( Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise AssertionError( Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 28 20:29:07.677028 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:29:07.678444 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3684/7380] 10.222.0.78 () {58 vars in 1362 bytes} [Sun Aug 28 20:29:07 2022] DELETE /identity/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules/166d9b7e3a2747f6b43f859480bd4c8e => generated 89 bytes in 200 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:29:07.679947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.693345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63121c-6b65-4375-bc91-046b33e942e8 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.716649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.717365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.717897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.718342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials/a4f8a8f02ad347fe9a35f6edbd8be95f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.739601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e51a315a350346c8b24042e34c0b544b, application_credential_id=a4f8a8f02ad347fe9a35f6edbd8be95f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.741508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.797926 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3697/7381] 10.222.0.78 () {60 vars in 1156 bytes} [Sun Aug 28 20:29:07 2022] POST /identity/v3/endpoints => generated 359 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:07.801244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.832330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302c62-e2eb-411c-9620-92608c0c8769 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.839861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.841222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.841587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.842492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/regions/tempest-region-476611319` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.843215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-476611319)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.852090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.858996 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3698/7382] 10.222.0.78 () {58 vars in 1203 bytes} [Sun Aug 28 20:29:07 2022] GET /identity/v3/regions/tempest-region-476611319 => generated 178 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:07.862496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.886100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17620-66d6-41c0-ac38-c5780cf2daf2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.893877 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3685/7383] 10.222.0.78 () {58 vars in 1395 bytes} [Sun Aug 28 20:29:07 2022] DELETE /identity/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials/a4f8a8f02ad347fe9a35f6edbd8be95f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:07.896464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.899012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.900256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.900800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.901091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints/c3861d2a78a04525a1a3c8edcc29e875` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.909688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=c3861d2a78a04525a1a3c8edcc29e875)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.912592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.921904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c4dc-649a-445b-b3b6-ea803f1f83ac tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: On instance['enabled']: Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: On instance['enabled']: Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: 'True' Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise error Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application 'True' Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.924766 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:29:07.930037 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application 'True' Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3699/7384] 10.222.0.78 () {60 vars in 1255 bytes} [Sun Aug 28 20:29:07 2022] PATCH /identity/v3/endpoints/c3861d2a78a04525a1a3c8edcc29e875 => generated 281 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:29:07.933840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:07.965215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.967070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.967413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.970202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a3756-46f2-4adc-9e21-3e895c87f559 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:07.970632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.973276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:list_access_rules(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.978348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.988031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:07.988873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:07.989169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:07.989451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/endpoints/c3861d2a78a04525a1a3c8edcc29e875` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:07.993235 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3686/7385] 10.222.0.78 () {58 vars in 1260 bytes} [Sun Aug 28 20:29:07 2022] GET /identity/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules => generated 369 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:07.993381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c3861d2a78a04525a1a3c8edcc29e875)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:07.993381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:07.994971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.014456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c499-d602-431b-b2fd-560895a63af3 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.019213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.019887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.020509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.021423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules/166d9b7e3a2747f6b43f859480bd4c8e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.022784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:delete_access_rule(user_id=e51a315a350346c8b24042e34c0b544b, access_rule_id=166d9b7e3a2747f6b43f859480bd4c8e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.024625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.138765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c3861d2a78a04525a1a3c8edcc29e875', 'request_id': 'req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:08.151060 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3687/7386] 10.222.0.78 () {58 vars in 1362 bytes} [Sun Aug 28 20:29:07 2022] DELETE /identity/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules/166d9b7e3a2747f6b43f859480bd4c8e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:08.155511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.165057 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3700/7387] 10.222.0.78 () {58 vars in 1236 bytes} [Sun Aug 28 20:29:07 2022] DELETE /identity/v3/endpoints/c3861d2a78a04525a1a3c8edcc29e875 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:08.166877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.171236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3962f-0ea4-43d0-99aa-5e0a0b59e033 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.174160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:08.196147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.197442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.197801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.198364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.200118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:list_access_rules(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.200769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba38c-2446-4d2a-a1f5-2d43882bd8f2 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.201980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.207354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.208287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.208786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.209247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/regions/tempest-region-476611319` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.209974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-476611319)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.213550 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3688/7388] 10.222.0.78 () {58 vars in 1260 bytes} [Sun Aug 28 20:29:08 2022] GET /identity/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules => generated 158 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:29:08.213909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.214827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.228084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f908f-863a-4a98-b855-6d758131b91f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.233101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.234002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.234304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.234578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.235488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:create_application_credential(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.237627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.344417 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3701/7389] 10.222.0.78 () {58 vars in 1206 bytes} [Sun Aug 28 20:29:08 2022] DELETE /identity/v3/regions/tempest-region-476611319 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:08.351338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.379615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18cb65-e3dd-4652-b55c-f45a6dbaff8b tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.386888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a95c9a2dbe7451d90167760ddbb064c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4784ecc398843de8d950677c82313e5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.387691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.388076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.388492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] PATH_INFO: `/v3/services/bb736a3e611a47069871b8dbc096753d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.390509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bb736a3e611a47069871b8dbc096753d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.393773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.478364 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3689/7390] 10.222.0.78 () {60 vars in 1315 bytes} [Sun Aug 28 20:29:08 2022] POST /identity/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials => generated 920 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:08.482476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.495259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b8bc4-4940-405e-a00a-5c76ec10e38f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.502580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:08.542997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.545290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.545580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.545891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.552922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:list_access_rules(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.555154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.573435 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3690/7391] 10.222.0.78 () {58 vars in 1260 bytes} [Sun Aug 28 20:29:08 2022] GET /identity/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules => generated 369 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:29:08.587513 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3702/7392] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:08 2022] DELETE /identity/v3/services/bb736a3e611a47069871b8dbc096753d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:08.590154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.591716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:08.643033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866ddb2-f1ed-4f57-8eae-a2ac89e9465f tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.702875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:08.723414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.725974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.726266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.726590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.732219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:create_application_credential(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.735463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:08.746838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8007e6-ae04-443a-aa50-b0893f330079 tempest-EndpointsNegativeTestJSON-361930480 tempest-EndpointsNegativeTestJSON-361930480-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:08.766256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:08.767015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:08.767281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:08.767591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] PATH_INFO: `/v3/users/c3c610c5f19745d88b3c8725dbb0168d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:08.768983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c610c5f19745d88b3c8725dbb0168d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:08.771331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:09.051037 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3691/7393] 10.222.0.78 () {60 vars in 1315 bytes} [Sun Aug 28 20:29:08 2022] POST /identity/v3/users/e51a315a350346c8b24042e34c0b544b/application_credentials => generated 920 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:09.052376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:09.061946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c610c5f19745d88b3c8725dbb0168d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.073489 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fea71-5e00-4183-89db-bcbdc6c5bd69 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:09.090451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51a315a350346c8b24042e34c0b544b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480c40f875c44ba68c4c4f9170038f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:09.091224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:09.091418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:09.091693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules/a148a88f45a74d60b0db646fddeac18b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:09.093112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorizing `identity:get_access_rule(user_id=e51a315a350346c8b24042e34c0b544b, access_rule_id=a148a88f45a74d60b0db646fddeac18b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:09.094957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:09.115569 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3692/7394] 10.222.0.78 () {58 vars in 1359 bytes} [Sun Aug 28 20:29:09 2022] GET /identity/v3/users/e51a315a350346c8b24042e34c0b544b/access_rules/a148a88f45a74d60b0db646fddeac18b => generated 229 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:09.128834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:09.147236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c610c5f19745d88b3c8725dbb0168d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.172180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68189-ea5b-460c-8640-3028d5099ab6 tempest-AccessRulesV3Test-1184517854 tempest-AccessRulesV3Test-1184517854-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:09.179102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c610c5f19745d88b3c8725dbb0168d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.183801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c610c5f19745d88b3c8725dbb0168d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.187849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9bfdc264-880d-4ada-a821-4fe5d757a902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c610c5f19745d88b3c8725dbb0168d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.202340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:09.212723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:09.213093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:09.214619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] PATH_INFO: `/v3/users/e51a315a350346c8b24042e34c0b544b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:09.222794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51a315a350346c8b24042e34c0b544b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:09.225423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:09.307845 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3703/7395] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:08 2022] DELETE /identity/v3/users/c3c610c5f19745d88b3c8725dbb0168d => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:09.318395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:09.318702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:09.318983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:09.343953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:09.345120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:09.532596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51a315a350346c8b24042e34c0b544b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.534225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51a315a350346c8b24042e34c0b544b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.592000 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3704/7396] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:09.617372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:09.618984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:09.639338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51a315a350346c8b24042e34c0b544b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.658473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51a315a350346c8b24042e34c0b544b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.660515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51a315a350346c8b24042e34c0b544b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:09.795525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69b189-a85e-4fdc-bb36-71c555b67e80 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:09.814907 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:09.815653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:09.816129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:09.816462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:09.838060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:09.865035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:09.865035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1779d-eeef-4ccf-b74e-e8b6d7720c11 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:09.888791 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3705/7397] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:09.950541 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3693/7398] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:09 2022] DELETE /identity/v3/users/e51a315a350346c8b24042e34c0b544b => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:09.953429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:09.954555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:09.955077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:10.009173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:10.013401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:10.211805 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3706/7399] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:10.328951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:10.330033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:10.352515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:10.463596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbeeca-a6b1-4790-bc19-1a4a3643a69b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:10.470949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:10.471589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:10.471876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:10.472674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:10.520479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:10.528755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:10.553712 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3694/7400] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:10.929134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:11.256531 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:11.258205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:11.291152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d9b81-6834-44c8-8895-dd23c6526508 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:11.312479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:11.313774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:11.314087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:11.314430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] PATH_INFO: `/v3/projects/d2b95d370bd34bd79e79ebeedfafe420` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:11.315742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b95d370bd34bd79e79ebeedfafe420)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:11.317766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:11.515725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b95d370bd34bd79e79ebeedfafe420', 'request_id': 'req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:11.537094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b95d370bd34bd79e79ebeedfafe420', 'request_id': 'req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:11.551554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b95d370bd34bd79e79ebeedfafe420', 'request_id': 'req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:11.667330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] The token cache is being invalidate because project d2b95d370bd34bd79e79ebeedfafe420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:11.667639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:11.670390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:11.675554 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3707/7401] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:11 2022] DELETE /identity/v3/projects/d2b95d370bd34bd79e79ebeedfafe420 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:11.680269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:11.693738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118a4b-2a32-45c3-9d57-5b0309ef472d service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:11.864561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:11.866112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:11.891603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:11.892341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:11.892539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:11.894788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] PATH_INFO: `/v3/users/4a95c9a2dbe7451d90167760ddbb064c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:11.898093 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a95c9a2dbe7451d90167760ddbb064c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:11.907843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:12.081789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe1db-c7c0-4b53-83c5-9eea2c2487ba admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:12.087209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:12.087879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:12.088362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:12.088820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] PATH_INFO: `/v3/projects/480c40f875c44ba68c4c4f9170038f59` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:12.090768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480c40f875c44ba68c4c4f9170038f59)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:12.092899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:12.222508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a95c9a2dbe7451d90167760ddbb064c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.224197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a95c9a2dbe7451d90167760ddbb064c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.269252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480c40f875c44ba68c4c4f9170038f59', 'request_id': 'req-105c616e-f14e-4481-9641-1f5e8b5bd441'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.280067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480c40f875c44ba68c4c4f9170038f59', 'request_id': 'req-105c616e-f14e-4481-9641-1f5e8b5bd441'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.290031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480c40f875c44ba68c4c4f9170038f59', 'request_id': 'req-105c616e-f14e-4481-9641-1f5e8b5bd441'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.376357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a95c9a2dbe7451d90167760ddbb064c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.387939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a95c9a2dbe7451d90167760ddbb064c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.389543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b02910cb-62ab-405c-9166-b182e726dea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a95c9a2dbe7451d90167760ddbb064c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.404926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:12.426667 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3695/7402] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:11 2022] DELETE /identity/v3/users/4a95c9a2dbe7451d90167760ddbb064c => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:12.474637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] The token cache is being invalidate because project 480c40f875c44ba68c4c4f9170038f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:12.474942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.490597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-105c616e-f14e-4481-9641-1f5e8b5bd441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:12.495193 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3708/7403] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:11 2022] DELETE /identity/v3/projects/480c40f875c44ba68c4c4f9170038f59 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:12.502133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:12.502715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:12.503170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:12.551129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:12.553390 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:12.688453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:12.699594 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3696/7404] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:12.711778 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:12.712368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:12.712856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:12.769910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:12.771999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:12.799632 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3709/7405] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:12.804924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:12.833359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b6b9-a4c2-4a11-91f7-f2cffbfb99ac None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:12.850473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:12.854594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:12.859880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:12.859880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:12.859880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:12.859880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:12.867686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:12.932315 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3697/7406] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:12.937067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:12.938465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:12.956416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba6741-8f40-4ff8-a714-ef25d8a7160c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:12.969415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:12.971838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:12.972128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:12.972408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:12.973086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:12.981926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:13.169905 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3710/7407] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:12 2022] POST /identity/v3/projects => generated 395 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:13.171056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:13.183899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c68d-951e-4054-9d08-e0dcaff2e65b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:13.282812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:13.283483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:13.285430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:13.286726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:13.288753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:13.291894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:13.424973 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3698/7408] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:13 2022] POST /identity/v3/users => generated 304 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:13.428887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:13.439672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:13.445026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3c4a-b3ed-4d86-a9ef-0e103d1f3e5c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:13.452892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:13.452892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:13.452892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:13.452892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:13.453558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:13.456702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:13.477290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:13.484397 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3711/7409] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:13.490334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ccc24-2e42-4117-b983-6dc9a94bcc30 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:13.496161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:13.496839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:13.497112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:13.497387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] PATH_INFO: `/v3/projects/9f7decfc43a2400eb7083bae5c6c7e1b/users/795af1b82c704c3db566cc952ee4f2cd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:13.519309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7decfc43a2400eb7083bae5c6c7e1b, user_id=795af1b82c704c3db566cc952ee4f2cd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:13.525718 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:13.659026 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3699/7410] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:13 2022] PUT /identity/v3/projects/9f7decfc43a2400eb7083bae5c6c7e1b/users/795af1b82c704c3db566cc952ee4f2cd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:13.663542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:13.675521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e219d-9246-4476-821c-e6666658c803 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:13.750901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c11da-137e-4680-a104-62f9c82b30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:13.752002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c11da-137e-4680-a104-62f9c82b30dc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:13.752447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c11da-137e-4680-a104-62f9c82b30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:13.752891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c11da-137e-4680-a104-62f9c82b30dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:13.753771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c11da-137e-4680-a104-62f9c82b30dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:13.756232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c11da-137e-4680-a104-62f9c82b30dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:13.774271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:13.785755 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3712/7411] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:13.789462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae972b35-274c-4e72-9ec5-324febfd9dba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:13.797400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:13.798784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:13.799265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:13.799724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] PATH_INFO: `/v3/projects/9f7decfc43a2400eb7083bae5c6c7e1b/users/795af1b82c704c3db566cc952ee4f2cd/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:13.805903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:13.807816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7decfc43a2400eb7083bae5c6c7e1b, user_id=795af1b82c704c3db566cc952ee4f2cd, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:13.812348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:13.842959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:13.843661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:13.844244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:13.847435 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3700/7412] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:13 2022] PUT /identity/v3/projects/9f7decfc43a2400eb7083bae5c6c7e1b/users/795af1b82c704c3db566cc952ee4f2cd/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:13.882535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] MFA Rules not processed for user `795af1b82c704c3db566cc952ee4f2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:13.884276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:13.978297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:13.981253 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3713/7413] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:14.060214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881367-7238-4587-9b0a-bdbfd341cba9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:14.066396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:14.067428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.067928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.068608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.069746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:14.072170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:14.206641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3701/7414] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:13 2022] POST /identity/v3/projects => generated 397 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:14.212716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:14.237544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bba30d-fcb6-41fb-9c37-b3829e0f3e43 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:14.330668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:14.332696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:14.441565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:14.442252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.444395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.444937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.447344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:14.456672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:14.523673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:14.570919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b74f-e9b5-4032-b25e-2459aa3b81eb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:14.600844 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3714/7415] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:14 2022] POST /identity/v3/users => generated 299 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:14.602283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:14.610188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:14.610991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.611370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.611714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] PATH_INFO: `/v3/projects/d4784ecc398843de8d950677c82313e5` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.615862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4784ecc398843de8d950677c82313e5)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:14.624297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:14.639083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b119e-e510-4fdb-8b3c-46b80c62d7cf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:14.649903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:14.650536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.650816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.651087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.651739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:14.653356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:14.676219 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3715/7416] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:14.681039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:14.708435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09428435-49ad-4ae4-b213-a4d3ca6c7ad2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:14.731901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:14.733740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.734849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.735611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.737367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:14.741920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:14.784008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3716/7417] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:14.787831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:14.804125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4784ecc398843de8d950677c82313e5', 'request_id': 'req-8a77e82d-1eca-4fab-8783-8e51d8f69042'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:14.810098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5167e90-7902-451d-8daa-830f1fca3abf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:14.824825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4784ecc398843de8d950677c82313e5', 'request_id': 'req-8a77e82d-1eca-4fab-8783-8e51d8f69042'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:14.844335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4784ecc398843de8d950677c82313e5', 'request_id': 'req-8a77e82d-1eca-4fab-8783-8e51d8f69042'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:14.955350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b90d-d0e2-4a1b-b90e-33c4b414fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:14.959973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b90d-d0e2-4a1b-b90e-33c4b414fa2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.960973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b90d-d0e2-4a1b-b90e-33c4b414fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.962573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] The token cache is being invalidate because project d4784ecc398843de8d950677c82313e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:14.962866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b90d-d0e2-4a1b-b90e-33c4b414fa2c admin admin] PATH_INFO: `/v3/projects/8a1b18fa16d54d11b065bce8beeb6007/users/57d4c3a1edc24263a9bca64d5b30549b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.963648 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:14.967587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8a77e82d-1eca-4fab-8783-8e51d8f69042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:14.976761 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3702/7418] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:14 2022] DELETE /identity/v3/projects/d4784ecc398843de8d950677c82313e5 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:14.980986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32967-e7dc-4190-a718-28975cb29a2d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:14.982208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32967-e7dc-4190-a718-28975cb29a2d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:14.983017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32967-e7dc-4190-a718-28975cb29a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:14.996039 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84b90d-d0e2-4a1b-b90e-33c4b414fa2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1b18fa16d54d11b065bce8beeb6007, user_id=57d4c3a1edc24263a9bca64d5b30549b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.001181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84b90d-d0e2-4a1b-b90e-33c4b414fa2c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.024807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-62e32967-e7dc-4190-a718-28975cb29a2d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:15.026663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-62e32967-e7dc-4190-a718-28975cb29a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:15.039794 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3703/7419] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:15.048174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.048774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.049436 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.082826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:15.086089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:15.103636 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3704/7420] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:15.106433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.112393 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3717/7421] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:14 2022] PUT /identity/v3/projects/8a1b18fa16d54d11b065bce8beeb6007/users/57d4c3a1edc24263a9bca64d5b30549b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:15.125019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f77f-9d29-4ed6-bfcb-ef5a47ea1b8f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.127871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.128440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.128938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.162014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] MFA Rules not processed for user `57d4c3a1edc24263a9bca64d5b30549b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:15.163670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:15.211879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:15.216465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.218280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.220122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.220418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.222414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:15.222588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.224790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.247266 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3705/7422] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:15.251485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.259354 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3718/7423] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:15.265476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2a2e-cba9-44e8-ac16-ed58c0b8c18a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.267259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.269103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:15.271784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.272420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.272706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.272982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.275323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.280305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.391230 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3706/7424] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:15 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:15.396931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.442072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41beafd-9e97-4663-8117-8882e4b1698a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.535801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99106da-ed7f-4cb4-84fc-b3ba72260f11 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.544128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.544689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.544965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.545232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.553504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:15.557244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.557680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.560140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.560422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.562229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.565977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.662982 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3707/7425] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:15 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:15.667534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.712557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce31d-756b-43a7-90fe-90506e803dc6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.738685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.741199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.742933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.743807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.745754 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.750778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.771309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.773104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.782096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3708/7426] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:15.785264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.804452 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3719/7427] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:15 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:15.818069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35b5dc-8c3d-4d38-82f0-6be462dd880f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.849300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f93e-4409-46a0-9a91-38a3b2ad7434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.850908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f93e-4409-46a0-9a91-38a3b2ad7434 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.851386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f93e-4409-46a0-9a91-38a3b2ad7434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.851830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f93e-4409-46a0-9a91-38a3b2ad7434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.852693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f93e-4409-46a0-9a91-38a3b2ad7434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.855359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f93e-4409-46a0-9a91-38a3b2ad7434 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:15.879498 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3709/7428] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:15.885226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:15.911242 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0451e-8bcf-4444-9e10-7a92691c4f01 service glance] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:15.921203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:15.922331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:15.923004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:15.923545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] PATH_INFO: `/v3/projects/39a15a70fd33470c889944c061ee2cfd/users/65c9d400488b46ceb70d4f1cc33a276a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:15.956698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a15a70fd33470c889944c061ee2cfd, user_id=65c9d400488b46ceb70d4f1cc33a276a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:15.963293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:16.096141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3720/7429] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:15 2022] PUT /identity/v3/projects/39a15a70fd33470c889944c061ee2cfd/users/65c9d400488b46ceb70d4f1cc33a276a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:16.106659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868561-b588-474c-86f6-cc6e3be5c7fd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:16.106947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868561-b588-474c-86f6-cc6e3be5c7fd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:16.107410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868561-b588-474c-86f6-cc6e3be5c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:16.165032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9d868561-b588-474c-86f6-cc6e3be5c7fd None None] MFA Rules not processed for user `65c9d400488b46ceb70d4f1cc33a276a`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:16.166833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9d868561-b588-474c-86f6-cc6e3be5c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:16.325979 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3710/7430] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:16.326632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:16.499166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595ba3c-3862-4549-9cd0-e1761ff3da1a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:16.508876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:16.510821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:16.511406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:16.511903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:16.512829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:16.516612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:16.616814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:16.617464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:16.617835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:16.636456 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3721/7431] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:16 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:16.641067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:16.690024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] MFA Rules not processed for user `54542f1a89e34df5bdb8dc8ed4ad3b88`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:16.691308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:16.735315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:16.848007 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3711/7432] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:16.861065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:16.863936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:16.877712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ef61-1fcc-49e0-95a7-bdc0189c3ea8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:16.885720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef975f-a026-46b4-b532-2f3e36620d65 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:16.893439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:16.894208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:16.895319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:16.895962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:16.905530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:16.906472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:16.906922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:16.909736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:16.909927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:16.909927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:16.910147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:16.912088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:17.131742 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3722/7433] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:16 2022] POST /identity/v3/users => generated 294 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:17.134256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:17.136550 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3712/7434] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:16 2022] POST /identity/v3/projects => generated 373 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:17.141449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:17.195991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:17.199341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61b7e-7d27-460c-97f2-2c89377a8597 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:17.358743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:17.359376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:17.360187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:17.360187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:17.375923 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:17.377999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:17.379590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a001-7dde-47d8-bae7-1538f5d05dcc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:17.389219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:17.389897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:17.390181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:17.390457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:17.391179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:17.393278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:17.397958 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3723/7435] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:17.406227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:17.434286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35039-79bd-434c-b554-7e1d1ee554c4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:17.445419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:17.446647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:17.447123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:17.448381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] PATH_INFO: `/v3/projects/8f86076bd93b41738d6d5d38ab0bfa75/users/b98c7bbc05de4f728bdcc87ad17c3f8c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:17.480729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86076bd93b41738d6d5d38ab0bfa75, user_id=b98c7bbc05de4f728bdcc87ad17c3f8c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:17.490780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:17.526948 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3713/7436] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:17 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:17.528179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:17.534212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:17.639503 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3724/7437] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:17 2022] PUT /identity/v3/projects/8f86076bd93b41738d6d5d38ab0bfa75/users/b98c7bbc05de4f728bdcc87ad17c3f8c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:17.653882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:17.763388 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc07ec-555d-42cf-8c0a-47e150259478 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:17.788399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2639b9-8582-4a3e-b816-7aa030cd5007 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:17.796668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:17.797400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:17.797686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:17.799658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:17.800500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:17.803043 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:17.821549 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3725/7438] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:17.822589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:17.831066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:17.870948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b00f-42fa-4a8d-a7ab-c34772b75374 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:17.890251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:17.890865 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:17.891146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:17.891436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] PATH_INFO: `/v3/users/795af1b82c704c3db566cc952ee4f2cd` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:17.898002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795af1b82c704c3db566cc952ee4f2cd)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:17.898799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:17.902555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:17.903057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:17.903290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:17.903523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:17.909315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.059426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:18.084366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:18.086698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:18.129229 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3714/7439] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:18.130223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:18.149101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7cb1d-6716-433f-a24f-cdf466b6a51f service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:18.158783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:18.159721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.160915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.161884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.164684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:18.168250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:18.173588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795af1b82c704c3db566cc952ee4f2cd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:18.198190 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3715/7440] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:18.199681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:18.222513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795af1b82c704c3db566cc952ee4f2cd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:18.235311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982dbed-f2c6-4e1b-9228-d1324c2406cc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:18.249121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795af1b82c704c3db566cc952ee4f2cd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:18.255077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795af1b82c704c3db566cc952ee4f2cd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:18.255255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:18.255382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795af1b82c704c3db566cc952ee4f2cd'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:18.255488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.255488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.255488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] PATH_INFO: `/v3/projects/d5451ab01eb04f6eac76034e20fb8060/users/0a7ad261869649978c45053aa84c6146/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.277257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5451ab01eb04f6eac76034e20fb8060, user_id=0a7ad261869649978c45053aa84c6146, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:18.280625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:18.345691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:18.389557 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3726/7441] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:17 2022] DELETE /identity/v3/users/795af1b82c704c3db566cc952ee4f2cd => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:18.393055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:18.394160 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3716/7442] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:18 2022] PUT /identity/v3/projects/d5451ab01eb04f6eac76034e20fb8060/users/0a7ad261869649978c45053aa84c6146/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:18.394504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.397623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:18.399273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.488948 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a0853-b4d1-4183-8fc5-b668de305db9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:18.495666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172efc6-6bf0-4f47-84d8-67f1071d230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:18.496610 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172efc6-6bf0-4f47-84d8-67f1071d230e admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.496946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172efc6-6bf0-4f47-84d8-67f1071d230e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.497239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172efc6-6bf0-4f47-84d8-67f1071d230e admin admin] PATH_INFO: `/v3/projects/8f86076bd93b41738d6d5d38ab0bfa75/users/b98c7bbc05de4f728bdcc87ad17c3f8c/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.499576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172efc6-6bf0-4f47-84d8-67f1071d230e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86076bd93b41738d6d5d38ab0bfa75, user_id=b98c7bbc05de4f728bdcc87ad17c3f8c, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:18.500858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360112a-48ac-4aff-8804-32e541dca44e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:18.503308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172efc6-6bf0-4f47-84d8-67f1071d230e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:18.530995 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3727/7443] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:18 2022] PUT /identity/v3/projects/8f86076bd93b41738d6d5d38ab0bfa75/users/b98c7bbc05de4f728bdcc87ad17c3f8c/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:18.540256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.540541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.540888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.564211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:18.565590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.612566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:18.612566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.612566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.612566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.613419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.662315 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3728/7444] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:18.666364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:18.668186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.689226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e1ad8-43a2-4c41-ae1a-91d56f250ba5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:18.695422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e86147-3fd4-40d2-b211-59893c9cd69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:18.698489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e86147-3fd4-40d2-b211-59893c9cd69a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.698489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e86147-3fd4-40d2-b211-59893c9cd69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.698489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e86147-3fd4-40d2-b211-59893c9cd69a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.698489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e86147-3fd4-40d2-b211-59893c9cd69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:18.700154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e86147-3fd4-40d2-b211-59893c9cd69a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:18.712142 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3729/7445] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:18.713717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.714215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.714692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.766634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] MFA Rules not processed for user `cdf6b4ecef824696bc39abf6ce08e205`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:18.768618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:18.771311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:18.821541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:18.823420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252bb5b-6c58-469f-9083-e2e67f4b145a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:18.860375 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3717/7446] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:18.861841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4104-746e-4775-a5be-db926f92b021 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:18.862170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4104-746e-4775-a5be-db926f92b021 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:18.862455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4104-746e-4775-a5be-db926f92b021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:18.905916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-437b4104-746e-4775-a5be-db926f92b021 None None] MFA Rules not processed for user `b98c7bbc05de4f728bdcc87ad17c3f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:18.914795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-437b4104-746e-4775-a5be-db926f92b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:19.027756 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3718/7447] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:19.028962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4104-746e-4775-a5be-db926f92b021 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:19.031867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-437b4104-746e-4775-a5be-db926f92b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:19.075817 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3730/7448] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:19.076875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:19.147956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8eeac-38bc-485e-bd62-e1c6803bb88d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:19.172987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:19.174311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:19.175503 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:19.175841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] PATH_INFO: `/v3/projects/d5451ab01eb04f6eac76034e20fb8060/users/0a7ad261869649978c45053aa84c6146/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:19.183514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5451ab01eb04f6eac76034e20fb8060, user_id=0a7ad261869649978c45053aa84c6146, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:19.187378 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:19.227049 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3731/7449] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:19 2022] PUT /identity/v3/projects/d5451ab01eb04f6eac76034e20fb8060/users/0a7ad261869649978c45053aa84c6146/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:19.227049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:19.227452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4104-746e-4775-a5be-db926f92b021 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:19.363521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:19.364530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:19.366393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:19.367679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:19.383417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85491e64-c17d-4ff3-bdbf-367b7c0eedf3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:19.391225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:19.391225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:19.391621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:19.391988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:19.392730 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:19.397348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:19.496642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:19.499630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:19.514676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3719/7450] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:19.517384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:19.519039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:19.538040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbdce3-ca01-46ab-bd56-0e960088691d service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:19.546049 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:19.546821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:19.547173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:19.547518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:19.548456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:19.550677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:19.602768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:19.614602 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3732/7451] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:19 2022] POST /identity/v3/projects => generated 334 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:19.619301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:19.681397 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3720/7452] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:19 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:19.682347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:19.790749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537e86e-d1ae-4b32-ad42-cb1d2bf2a0d9 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:19.846336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce203768-e1b6-461b-8d52-7a8920e9275d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:19.852807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:19.853627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:19.854101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:19.854421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:19.855297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:19.859403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:19.892987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:19.893754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:19.894127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:19.894415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:19.896213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:19.898252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.157256 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3721/7453] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:19 2022] POST /identity/v3/users => generated 293 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:20.161364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.166301 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3733/7454] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:29:19 2022] POST /identity/v3/projects => generated 333 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:20.170254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.180135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686f0af-7288-49e5-b25a-f4660a03f852 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:20.262545 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:20.265567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:20.265964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:20.266229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:20.266922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:20.268573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.301407 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3722/7455] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:29:20.306224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.309178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4f1c2-776d-42c3-882a-81dd04ec530c tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:20.328457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0e261-d725-4a94-900a-47125cf1825a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:20.336016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:20.338746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:20.339809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:20.342999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:20.344430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:20.345016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:20.345168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:20.345384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:20.345664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] PATH_INFO: `/v3/projects/091421ca3de74beb9a4fbaab2c89d7a2/users/a43c48ccb84c497e9987eb4bc236e656/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:20.355485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.398974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091421ca3de74beb9a4fbaab2c89d7a2, user_id=a43c48ccb84c497e9987eb4bc236e656, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:20.401800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.428061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:20.651928 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3723/7456] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:20 2022] PUT /identity/v3/projects/091421ca3de74beb9a4fbaab2c89d7a2/users/a43c48ccb84c497e9987eb4bc236e656/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:20.656279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.667107 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3734/7457] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:20 2022] POST /identity/v3/projects => generated 358 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:20.668943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.804732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01af34-ee69-42c0-b022-929495291956 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:20.854273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbd90f-fd89-410c-b198-fea3e63c9879 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:20.870355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:20.871026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:20.871777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:20.871777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:20.872230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:20.876328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.894021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:20.936646 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3735/7458] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:29:20 2022] GET /identity/v3/projects => generated 7966 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:20.939321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.943943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:20.957296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939be57-2906-461f-842b-20181c191051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:20.961811 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939be57-2906-461f-842b-20181c191051 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:20.962164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939be57-2906-461f-842b-20181c191051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:20.962451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939be57-2906-461f-842b-20181c191051 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:20.963211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939be57-2906-461f-842b-20181c191051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:20.967621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939be57-2906-461f-842b-20181c191051 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.976263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7ea5d-9b3f-4833-8ed5-04938a188974 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:20.982719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:20.983070 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3724/7459] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:20.993369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:20.993548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939be57-2906-461f-842b-20181c191051 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:20.993656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:20.993656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] PATH_INFO: `/v3/projects/9f7decfc43a2400eb7083bae5c6c7e1b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:20.993656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7decfc43a2400eb7083bae5c6c7e1b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:20.993656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:20.996116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939be57-2906-461f-842b-20181c191051 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:21.002275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:21.003456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:21.003942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:21.004418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:21.005348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:21.005947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:21.008209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:21.038868 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3725/7460] 10.222.0.78 () {58 vars in 1158 bytes} [Sun Aug 28 20:29:20 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:21.038868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:21.045524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d46ad-74fe-4897-bd88-a4193bfbc264 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:21.052706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:21.053397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:21.053681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:21.054158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] PATH_INFO: `/v3/projects/091421ca3de74beb9a4fbaab2c89d7a2/users/a43c48ccb84c497e9987eb4bc236e656/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:21.056268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091421ca3de74beb9a4fbaab2c89d7a2, user_id=a43c48ccb84c497e9987eb4bc236e656, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:21.059703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:21.076050 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3726/7461] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:21 2022] PUT /identity/v3/projects/091421ca3de74beb9a4fbaab2c89d7a2/users/a43c48ccb84c497e9987eb4bc236e656/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:21.077059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:21.183457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7decfc43a2400eb7083bae5c6c7e1b', 'request_id': 'req-b0ea9592-f80e-40bf-82dc-ca93089d55ca'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.217076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfea7f-974f-4996-9c38-5fe0baa997b4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:21.219338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7decfc43a2400eb7083bae5c6c7e1b', 'request_id': 'req-b0ea9592-f80e-40bf-82dc-ca93089d55ca'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.239842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7decfc43a2400eb7083bae5c6c7e1b', 'request_id': 'req-b0ea9592-f80e-40bf-82dc-ca93089d55ca'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.354259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:21.355232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:21.355692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:21.356078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:21.356958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Adding query filter params (parent_id=adeca07505c8456296cd92b723d80736) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:21.357404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:21.362713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:21.399117 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3727/7462] 10.222.0.78 () {58 vars in 1216 bytes} [Sun Aug 28 20:29:21 2022] GET /identity/v3/projects?parent_id=adeca07505c8456296cd92b723d80736 => generated 498 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:21.413662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] The token cache is being invalidate because project 9f7decfc43a2400eb7083bae5c6c7e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:21.416600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:21.428892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.431699 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.436187 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3736/7463] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:20 2022] DELETE /identity/v3/projects/9f7decfc43a2400eb7083bae5c6c7e1b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:21.441086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:21.456916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:21.457141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c6f0a-18e5-4511-8e32-ea20650bb5be tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:21.483536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:21.486849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:21.490071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:21.490891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects/4a4b30f86fc9439a94a1c5446ba38cc8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:21.501217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a4b30f86fc9439a94a1c5446ba38cc8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:21.512627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:21.614821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea9592-f80e-40bf-82dc-ca93089d55ca admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:21.623782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:21.624870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:21.625325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:21.625920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] PATH_INFO: `/v3/users/57d4c3a1edc24263a9bca64d5b30549b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:21.627826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d4c3a1edc24263a9bca64d5b30549b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:21.632332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:21.750869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4b30f86fc9439a94a1c5446ba38cc8', 'request_id': 'req-5872fa73-a199-42d1-b7f6-fde3d2d82356'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.758916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4b30f86fc9439a94a1c5446ba38cc8', 'request_id': 'req-5872fa73-a199-42d1-b7f6-fde3d2d82356'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.770078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4b30f86fc9439a94a1c5446ba38cc8', 'request_id': 'req-5872fa73-a199-42d1-b7f6-fde3d2d82356'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.941807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] The token cache is being invalidate because project 4a4b30f86fc9439a94a1c5446ba38cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:21.946598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.947661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:21.949497 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3728/7464] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:21 2022] DELETE /identity/v3/projects/4a4b30f86fc9439a94a1c5446ba38cc8 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:21.954976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:21.962915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:22.010653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d4c3a1edc24263a9bca64d5b30549b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.045521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d4c3a1edc24263a9bca64d5b30549b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.056131 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d4c3a1edc24263a9bca64d5b30549b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.056952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d4c3a1edc24263a9bca64d5b30549b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.057762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d4c3a1edc24263a9bca64d5b30549b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.072621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:22.161597 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3737/7465] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:21 2022] DELETE /identity/v3/users/57d4c3a1edc24263a9bca64d5b30549b => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:22.244872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872fa73-a199-42d1-b7f6-fde3d2d82356 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:22.324002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:22.324669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:22.324956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:22.325233 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects/adeca07505c8456296cd92b723d80736` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:22.326590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=adeca07505c8456296cd92b723d80736)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:22.328469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:22.599737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adeca07505c8456296cd92b723d80736', 'request_id': 'req-2f552f02-7704-48fb-a249-37de51790db2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.631005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adeca07505c8456296cd92b723d80736', 'request_id': 'req-2f552f02-7704-48fb-a249-37de51790db2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.651602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adeca07505c8456296cd92b723d80736', 'request_id': 'req-2f552f02-7704-48fb-a249-37de51790db2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.780125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] The token cache is being invalidate because project adeca07505c8456296cd92b723d80736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:22.780125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.780125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:22.789620 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3729/7466] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:21 2022] DELETE /identity/v3/projects/adeca07505c8456296cd92b723d80736 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:22.796363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:22.799965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:22.854909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc730e9-8764-4151-9eaf-1b8223704ce7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:23.086690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98c7bbc05de4f728bdcc87ad17c3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86076bd93b41738d6d5d38ab0bfa75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:23.087373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:23.087618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:23.090605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] PATH_INFO: `/v3/projects/94e88eda3e8f4245a2d48b29e0af9541` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:23.095487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94e88eda3e8f4245a2d48b29e0af9541)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:23.102774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:23.288408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e88eda3e8f4245a2d48b29e0af9541', 'request_id': 'req-bf520644-0124-4cd9-90f7-61ba40ed1572'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:23.300252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e88eda3e8f4245a2d48b29e0af9541', 'request_id': 'req-bf520644-0124-4cd9-90f7-61ba40ed1572'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:23.318118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e88eda3e8f4245a2d48b29e0af9541', 'request_id': 'req-bf520644-0124-4cd9-90f7-61ba40ed1572'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:23.417070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] The token cache is being invalidate because project 94e88eda3e8f4245a2d48b29e0af9541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:23.417381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:23.418294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bf520644-0124-4cd9-90f7-61ba40ed1572 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:23.424648 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3738/7467] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:22 2022] DELETE /identity/v3/projects/94e88eda3e8f4245a2d48b29e0af9541 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:23.425178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:23.427331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:23.499320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:23.570870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f552f02-7704-48fb-a249-37de51790db2 tempest-ListProjectsTestJSON-230749913 tempest-ListProjectsTestJSON-230749913-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:23.624936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:23.687616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:23.687616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:23.687616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:23.687616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] PATH_INFO: `/v3/users/65c9d400488b46ceb70d4f1cc33a276a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:23.690025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c9d400488b46ceb70d4f1cc33a276a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:23.695639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:24.001694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c9d400488b46ceb70d4f1cc33a276a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.002729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c9d400488b46ceb70d4f1cc33a276a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.116966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c9d400488b46ceb70d4f1cc33a276a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.136918 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c9d400488b46ceb70d4f1cc33a276a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.140708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c9d400488b46ceb70d4f1cc33a276a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.214441 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3730/7468] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:23 2022] DELETE /identity/v3/users/65c9d400488b46ceb70d4f1cc33a276a => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:24.219305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0057-a190-4879-8775-626250ad587e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:24.222486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0057-a190-4879-8775-626250ad587e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:24.222841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0057-a190-4879-8775-626250ad587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:24.267125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b2ea0057-a190-4879-8775-626250ad587e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:24.271567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b2ea0057-a190-4879-8775-626250ad587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:24.400022 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3739/7469] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:24.435008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:24.436692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:24.448040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea0057-a190-4879-8775-626250ad587e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:24.450678 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b2ea0057-a190-4879-8775-626250ad587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:24.487402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea0057-a190-4879-8775-626250ad587e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:24.494901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:24.495963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:24.495963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:24.496185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] PATH_INFO: `/v3/projects/8a1b18fa16d54d11b065bce8beeb6007` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:24.497473 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1b18fa16d54d11b065bce8beeb6007)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:24.499707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:24.650140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2452fd5-a333-45fa-818f-7ada502b2f98 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:24.655673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c6b50-8a75-414f-8b55-ed7de384754d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:24.656912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c6b50-8a75-414f-8b55-ed7de384754d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:24.662867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c6b50-8a75-414f-8b55-ed7de384754d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:24.663826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c6b50-8a75-414f-8b55-ed7de384754d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:24.677152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c6b50-8a75-414f-8b55-ed7de384754d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:24.684519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c6b50-8a75-414f-8b55-ed7de384754d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:24.698641 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3731/7470] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:24.808593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1b18fa16d54d11b065bce8beeb6007', 'request_id': 'req-4b589f90-56d2-410f-8e10-8a506120b09e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.872761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1b18fa16d54d11b065bce8beeb6007', 'request_id': 'req-4b589f90-56d2-410f-8e10-8a506120b09e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:24.900017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1b18fa16d54d11b065bce8beeb6007', 'request_id': 'req-4b589f90-56d2-410f-8e10-8a506120b09e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:25.054701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] The token cache is being invalidate because project 8a1b18fa16d54d11b065bce8beeb6007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:25.073337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:25.078881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4b589f90-56d2-410f-8e10-8a506120b09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:25.094320 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3740/7471] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:24 2022] DELETE /identity/v3/projects/8a1b18fa16d54d11b065bce8beeb6007 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:25.099585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:25.100166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:25.100720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:25.142133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:25.165167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:25.170803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:25.320845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:25.334383 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3732/7472] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:25.341583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:25.342115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:25.342658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:25.385978 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:25.388116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:25.413180 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3741/7473] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:25.414763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:25.430848 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deb10a-3cc3-4131-94bf-79ca69ad9cc5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:25.446302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:25.447833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:25.448419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:25.449184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:25.450273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:25.454019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:25.456348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:25.489983 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3733/7474] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:25.493289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:25.508703 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf44f5-e5b0-4e0c-bbcb-f2d2503a2d42 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:25.519208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:25.520913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:25.522223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:25.524639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:25.528602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:25.529940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:25.719158 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3742/7475] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:25 2022] POST /identity/v3/projects => generated 395 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:25.725174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:25.744930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd845ad-025d-4d0f-be32-6237cfd8f79f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:25.948864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:25.950873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:25.951417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:25.951936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:25.952976 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:25.955990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:25.992245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:26.108356 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3734/7476] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:25 2022] POST /identity/v3/users => generated 304 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:26.113047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:26.144119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf53ee-5081-4295-9909-a0777222e128 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:26.166466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:26.167247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:26.167679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:26.167962 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:26.168629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:26.170296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:26.206906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:26.214716 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3743/7477] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:26.228175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7969b1-157e-42ff-8cae-4674cf70f699 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:26.241037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:26.242040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:26.242851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:26.242851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] PATH_INFO: `/v3/projects/b2d148c6d40b48dc89c6e30e34d4e979/users/d1d1484c20e24f87944b12028075d8d8/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:26.288047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d148c6d40b48dc89c6e30e34d4e979, user_id=d1d1484c20e24f87944b12028075d8d8, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:26.290764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:26.380583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3735/7478] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:26 2022] PUT /identity/v3/projects/b2d148c6d40b48dc89c6e30e34d4e979/users/d1d1484c20e24f87944b12028075d8d8/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:26.384815 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:26.402106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458cd6a-0a69-49eb-a205-ce5505d6ed86 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:26.517231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2073f-12a9-47b3-9ea2-8efc819410a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:26.518229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2073f-12a9-47b3-9ea2-8efc819410a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:26.518672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2073f-12a9-47b3-9ea2-8efc819410a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:26.519201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2073f-12a9-47b3-9ea2-8efc819410a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:26.521334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2073f-12a9-47b3-9ea2-8efc819410a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:26.523349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2073f-12a9-47b3-9ea2-8efc819410a7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:26.542229 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3744/7479] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:26.548053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:26.552260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:26.564795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33b24-9c57-4f9b-b99f-f20e8cbd3a8e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:26.588017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:26.588017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:26.588017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:26.588017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] PATH_INFO: `/v3/projects/b2d148c6d40b48dc89c6e30e34d4e979/users/d1d1484c20e24f87944b12028075d8d8/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:26.588830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d148c6d40b48dc89c6e30e34d4e979, user_id=d1d1484c20e24f87944b12028075d8d8, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:26.591747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:26.616588 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3736/7480] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:26 2022] PUT /identity/v3/projects/b2d148c6d40b48dc89c6e30e34d4e979/users/d1d1484c20e24f87944b12028075d8d8/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:26.628789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:26.630219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:26.630679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:26.717268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] MFA Rules not processed for user `d1d1484c20e24f87944b12028075d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:26.720747 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:26.742023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:26.901385 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3745/7481] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:26.905641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:27.020664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efebcaa-ae70-4215-977c-f25243441571 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:27.028171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:27.029032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.029382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.030175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.030963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:27.033178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:27.170215 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3737/7482] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:26 2022] POST /identity/v3/projects => generated 399 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:27.174300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:27.236195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43326b-4139-42f4-98a5-1376350b9718 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:27.397057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:27.399884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:27.423281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:27.424084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.424421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.424702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.424960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:27.425461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:27.429383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:27.598977 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3746/7483] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:27 2022] POST /identity/v3/users => generated 300 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:27.604293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:27.625018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893d9bd-b434-42f8-9925-c97450295ec4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:27.639401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:27.640333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.640804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.641247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.643019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:27.646281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:27.664340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60948be5-b9c2-4797-a4fd-d24ad6d045a8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:27.666893 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3747/7484] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:27.672220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:27.684393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:27.685055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.685550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.686038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] PATH_INFO: `/v3/projects/39a15a70fd33470c889944c061ee2cfd` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.687754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3883df-9689-4029-b25f-2b16c389b734 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:27.689197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a15a70fd33470c889944c061ee2cfd)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:27.696482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:27.697442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.697982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.698478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.698640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:27.699950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:27.702090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:27.720534 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3748/7485] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:27.724675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:27.738556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c61eab-b7bc-4b71-a889-13fccd944ea9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:27.745139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97833a8-75fd-4bd4-a665-5acb8de4eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:27.746221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97833a8-75fd-4bd4-a665-5acb8de4eccf admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.747138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97833a8-75fd-4bd4-a665-5acb8de4eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.747604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97833a8-75fd-4bd4-a665-5acb8de4eccf admin admin] PATH_INFO: `/v3/projects/fc868200f14147e19c99a9d61aa56e10/users/bfcfaf8ab30f44cd9c38f019747493f8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.767018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97833a8-75fd-4bd4-a665-5acb8de4eccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc868200f14147e19c99a9d61aa56e10, user_id=bfcfaf8ab30f44cd9c38f019747493f8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:27.770318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97833a8-75fd-4bd4-a665-5acb8de4eccf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:27.860715 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3749/7486] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:27 2022] PUT /identity/v3/projects/fc868200f14147e19c99a9d61aa56e10/users/bfcfaf8ab30f44cd9c38f019747493f8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:27.872228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:27.872539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:27.872816 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:27.878587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a15a70fd33470c889944c061ee2cfd', 'request_id': 'req-a92de9f0-9b44-444d-bf5e-4a9634f2217e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:27.887363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a15a70fd33470c889944c061ee2cfd', 'request_id': 'req-a92de9f0-9b44-444d-bf5e-4a9634f2217e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:27.897045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a15a70fd33470c889944c061ee2cfd', 'request_id': 'req-a92de9f0-9b44-444d-bf5e-4a9634f2217e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:27.907421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] MFA Rules not processed for user `bfcfaf8ab30f44cd9c38f019747493f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:27.908701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:27.999231 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3750/7487] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:28.005845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] The token cache is being invalidate because project 39a15a70fd33470c889944c061ee2cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:28.007152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.008407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.009750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:28.011899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:28.016932 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3738/7488] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:27 2022] DELETE /identity/v3/projects/39a15a70fd33470c889944c061ee2cfd => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:28.018653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:28.021386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:28.099460 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f411-e3a2-4fd4-92f6-3add9d4e82f9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:28.105584 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:28.119888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:28.120470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:28.120752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:28.128048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:28.177565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92de9f0-9b44-444d-bf5e-4a9634f2217e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:28.192775 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:28.193650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:28.194126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:28.195141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] PATH_INFO: `/v3/users/b98c7bbc05de4f728bdcc87ad17c3f8c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:28.200190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98c7bbc05de4f728bdcc87ad17c3f8c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:28.204730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:28.359529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:28.371780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:28.373797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:28.399792 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3751/7489] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:28 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:28.482156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98c7bbc05de4f728bdcc87ad17c3f8c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.485024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98c7bbc05de4f728bdcc87ad17c3f8c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.584613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98c7bbc05de4f728bdcc87ad17c3f8c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.597044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98c7bbc05de4f728bdcc87ad17c3f8c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.600888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98c7bbc05de4f728bdcc87ad17c3f8c'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:28.656830 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3739/7490] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:28 2022] DELETE /identity/v3/users/b98c7bbc05de4f728bdcc87ad17c3f8c => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:28.690649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:29.618137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:29.649749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf2eb-c504-4435-ab99-5dc218e991e3 service glance] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:29.766319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:29.767902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:29.829058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:29.829726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:29.830042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:29.830319 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] PATH_INFO: `/v3/projects/8f86076bd93b41738d6d5d38ab0bfa75` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:29.838830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f86076bd93b41738d6d5d38ab0bfa75)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:29.841944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:30.021599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674a9e7-529c-4a23-a43e-5c7134d437e1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:30.053236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:30.055703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:30.055985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:30.056477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] PATH_INFO: `/v3/users/d1d1484c20e24f87944b12028075d8d8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:30.062885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d1484c20e24f87944b12028075d8d8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:30.068993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:30.076171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f86076bd93b41738d6d5d38ab0bfa75', 'request_id': 'req-ea476a21-098c-411e-a886-37bf6e237009'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.094908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f86076bd93b41738d6d5d38ab0bfa75', 'request_id': 'req-ea476a21-098c-411e-a886-37bf6e237009'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.113557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f86076bd93b41738d6d5d38ab0bfa75', 'request_id': 'req-ea476a21-098c-411e-a886-37bf6e237009'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.142061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:30.257300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] The token cache is being invalidate because project 8f86076bd93b41738d6d5d38ab0bfa75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:30.257903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.258813 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-ea476a21-098c-411e-a886-37bf6e237009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.264766 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3752/7491] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:29 2022] DELETE /identity/v3/projects/8f86076bd93b41738d6d5d38ab0bfa75 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:30.270325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fe5b-962f-4d63-adcb-e51f253a621f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:30.271177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fe5b-962f-4d63-adcb-e51f253a621f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:30.271627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fe5b-962f-4d63-adcb-e51f253a621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:30.308008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1389fe5b-962f-4d63-adcb-e51f253a621f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:30.310136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1389fe5b-962f-4d63-adcb-e51f253a621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:30.492970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d1484c20e24f87944b12028075d8d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.493607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d1484c20e24f87944b12028075d8d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.509822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3753/7492] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:30.518914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:30.519204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:30.519467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:30.530732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:30.584094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d1484c20e24f87944b12028075d8d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.595144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d1484c20e24f87944b12028075d8d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.595745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b834b882-ca0b-4786-a99b-dceb385ad2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d1484c20e24f87944b12028075d8d8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:30.603230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:30.610782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:30.640661 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3740/7493] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:29 2022] DELETE /identity/v3/users/d1d1484c20e24f87944b12028075d8d8 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:30.643180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:30.643543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:30.643838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:30.646344 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3754/7494] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:30.658896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:30.678445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f76b0-022e-4002-8c28-1d54fa944cd1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:30.726212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:30.727515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:30.864932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:30.868956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:30.875143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:30.875761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:30.885259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:30.885259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:30.885259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:30.930754 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3755/7495] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:30.931972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:30.947343 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3741/7496] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:30.969481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef77-d69e-4bcc-b75b-edac9cbbce14 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:30.992752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:30.994582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:30.995912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:30.996452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:30.998447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:31.002942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:31.015772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:31.017602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:31.131868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4bd0-701c-409e-810c-3a1e82a9804d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:31.138102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:31.139135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:31.139741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:31.140217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:31.157761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:31.160352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:31.173016 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3756/7497] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:30 2022] POST /identity/v3/projects => generated 397 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:31.176565 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3742/7498] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:31.178045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:31.197259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab6a8-57ca-4b1d-bfd0-c80506c04ef0 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:31.299843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:31.300699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:31.301062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:31.301306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:31.301994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:31.309554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:31.460912 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3743/7499] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:31 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:31.464628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:31.482902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9524f-a893-4785-bd0a-e0cf0b6170ad admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:31.496625 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:31.497600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:31.498083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:31.498680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:31.500441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:31.504110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:31.528787 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3757/7500] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:31.532880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:31.545267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc4ab2-c0de-452a-bda8-5331ad97501f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:31.557404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62513f98-54ff-4d13-93c7-a0bc23757ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:31.559431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62513f98-54ff-4d13-93c7-a0bc23757ddd admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:31.559736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62513f98-54ff-4d13-93c7-a0bc23757ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:31.560014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62513f98-54ff-4d13-93c7-a0bc23757ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:31.560701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62513f98-54ff-4d13-93c7-a0bc23757ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:31.566849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62513f98-54ff-4d13-93c7-a0bc23757ddd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:31.595508 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3744/7501] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:29:31.599639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:31.614935 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7772df-05b4-420c-a2ce-d817d8753183 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:31.638793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:31.639986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:31.641167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:31.642732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] PATH_INFO: `/v3/projects/8cecb211900443a38a7ac64551e9bba8/users/6ba16205afdf49afb2dfcb0d14ffcd4b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:31.685457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cecb211900443a38a7ac64551e9bba8, user_id=6ba16205afdf49afb2dfcb0d14ffcd4b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:31.695399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:31.815961 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3758/7502] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:31 2022] PUT /identity/v3/projects/8cecb211900443a38a7ac64551e9bba8/users/6ba16205afdf49afb2dfcb0d14ffcd4b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:31.826788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:31.827080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:31.831017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:31.897105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] MFA Rules not processed for user `6ba16205afdf49afb2dfcb0d14ffcd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:31.898423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:32.075990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3745/7503] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:32.079660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:32.188239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a89d2-671a-4811-86a2-a13ec6e8be5d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:32.198513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:32.201921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:32.207469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:32.208417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:32.212376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:32.218143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:32.366571 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3759/7504] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:32 2022] POST /identity/v3/projects => generated 397 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:32.369991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:32.396527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77842fff-dcb8-4a44-bd6d-0622f059f681 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:32.620522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:32.621719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:32.622149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:32.622535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:32.623421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:32.626610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:32.627510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:32.774237 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3746/7505] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:32 2022] POST /identity/v3/users => generated 305 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:32.775786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:32.790415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77fff-bcf4-4b92-8492-38da60f9af2a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:32.809424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:32.811027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:32.813436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:32.814004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:32.814943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:32.816615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:32.837900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:32.847128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:32.855452 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3760/7506] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:32.862149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344c9b-f211-4d2e-ace6-20a34877bd49 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:32.873480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:32.877660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:32.877660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:32.877660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] PATH_INFO: `/v3/projects/e1fd308185ff4014b5efd33c712fcc41/users/a353414f68bc42888010dbceb5e51cc9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:32.916445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fd308185ff4014b5efd33c712fcc41, user_id=a353414f68bc42888010dbceb5e51cc9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:32.925206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:33.042957 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3747/7507] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:32 2022] PUT /identity/v3/projects/e1fd308185ff4014b5efd33c712fcc41/users/a353414f68bc42888010dbceb5e51cc9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:33.047128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:33.061087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3ba46-6f59-4693-bd9b-7166d38c2f74 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:33.218461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:33.219519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:33.220019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:33.220900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:33.221814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:33.224455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:33.249717 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3761/7508] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:33.250769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:33.266984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f112a8-f93d-455f-9e32-cb80ed13fb8b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:33.277218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d27c6-d8fc-40e1-8c43-6ee05fe5a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:33.278005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d27c6-d8fc-40e1-8c43-6ee05fe5a7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:33.278293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d27c6-d8fc-40e1-8c43-6ee05fe5a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:33.278575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d27c6-d8fc-40e1-8c43-6ee05fe5a7f3 admin admin] PATH_INFO: `/v3/projects/e1fd308185ff4014b5efd33c712fcc41/users/a353414f68bc42888010dbceb5e51cc9/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:33.284137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d27c6-d8fc-40e1-8c43-6ee05fe5a7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fd308185ff4014b5efd33c712fcc41, user_id=a353414f68bc42888010dbceb5e51cc9, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:33.301513 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d27c6-d8fc-40e1-8c43-6ee05fe5a7f3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:33.329798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:33.332267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:33.343119 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3748/7509] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:33 2022] PUT /identity/v3/projects/e1fd308185ff4014b5efd33c712fcc41/users/a353414f68bc42888010dbceb5e51cc9/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:33.345335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:33.345664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:33.346113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:33.369063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ee907-c8ca-4f08-8af6-4d1fec62455e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:33.416184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] MFA Rules not processed for user `a353414f68bc42888010dbceb5e51cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:33.417222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:33.544362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:33.545069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:33.547011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:33.547342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] PATH_INFO: `/v3/projects/b2d148c6d40b48dc89c6e30e34d4e979` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:33.551873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d148c6d40b48dc89c6e30e34d4e979)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:33.553863 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:33.618441 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3749/7510] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:33.619212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:33.763523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d148c6d40b48dc89c6e30e34d4e979', 'request_id': 'req-95e618ec-26fb-468d-868b-2fbadb1cf9bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:33.777132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d148c6d40b48dc89c6e30e34d4e979', 'request_id': 'req-95e618ec-26fb-468d-868b-2fbadb1cf9bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:33.785611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97cd8a-7b27-436d-8668-ec62b46c91c0 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:33.789511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d148c6d40b48dc89c6e30e34d4e979', 'request_id': 'req-95e618ec-26fb-468d-868b-2fbadb1cf9bf'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:33.892846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba16205afdf49afb2dfcb0d14ffcd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cecb211900443a38a7ac64551e9bba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:33.896353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:33.899789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:33.900577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:33.901778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 28 20:29:33.913550 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 20:29:33.916090 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:33.916794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] The token cache is being invalidate because project b2d148c6d40b48dc89c6e30e34d4e979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:33.916794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:33.916794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:33.919224 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3750/7511] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:29:33 2022] POST /identity/v3/projects => generated 136 bytes in 301 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:29:33.920705 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3762/7512] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:33 2022] DELETE /identity/v3/projects/b2d148c6d40b48dc89c6e30e34d4e979 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:33.924562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:33.924743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:33.927089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:33.927861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:34.036432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:34.048362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73d28-55ac-42b7-82e6-7fa17e661df8 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.055107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a353414f68bc42888010dbceb5e51cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1fd308185ff4014b5efd33c712fcc41', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.056013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.056470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.056943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.057755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.061074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invalid input for field 'name': '' is too short Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: On instance['name']: Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: On instance['name']: Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: '' Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise error Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application '' Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.070544 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:29:34.072558 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application '' Aug 28 20:29:34.074004 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.077044 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3751/7513] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:29:33 2022] POST /identity/v3/projects => generated 283 bytes in 153 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:29:34.080965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:34.097763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bd92b-2777-42da-ba7c-5900600e4d3e tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.106524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e618ec-26fb-468d-868b-2fbadb1cf9bf admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.112245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a353414f68bc42888010dbceb5e51cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1fd308185ff4014b5efd33c712fcc41', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.115372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.115899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.117239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.120420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.122661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:34.138238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.141192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.142135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.148001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] PATH_INFO: `/v3/users/bfcfaf8ab30f44cd9c38f019747493f8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.150751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcfaf8ab30f44cd9c38f019747493f8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.154627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:34.156166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: On instance['name']: Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: On instance['name']: Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise error Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:29:34.171942 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:34.173675 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application On instance['name']: Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 20:29:34.175173 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.185045 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3752/7514] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:29:34 2022] POST /identity/v3/projects => generated 412 bytes in 104 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 20:29:34.190529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:34.232950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f8151-e8ab-4d03-af75-6581c997cfa5 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.247283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a353414f68bc42888010dbceb5e51cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1fd308185ff4014b5efd33c712fcc41', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.248006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.248694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.253204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] PATH_INFO: `/v3/projects/f2b636300faa4e5f82544b97e5df3d67` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.265928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2b636300faa4e5f82544b97e5df3d67)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.268217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Could not find project: f2b636300faa4e5f82544b97e5df3d67.: keystone.exception.ProjectNotFound: Could not find project: f2b636300faa4e5f82544b97e5df3d67. Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 20:29:34.288062 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f2b636300faa4e5f82544b97e5df3d67. Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.293750 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3753/7515] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:34 2022] DELETE /identity/v3/projects/f2b636300faa4e5f82544b97e5df3d67 => generated 113 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:29:34.298273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:34.302473 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:34.345343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e19a7-6a37-4200-8a9f-d04bf63bc9af tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.353576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba16205afdf49afb2dfcb0d14ffcd4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cecb211900443a38a7ac64551e9bba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.354553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.355067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.355498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.357554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 28 20:29:34.374978 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self._list_projects() Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:29:34.378994 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3754/7516] 10.222.0.78 () {58 vars in 1131 bytes} [Sun Aug 28 20:29:34 2022] GET /identity/v3/projects => generated 135 bytes in 80 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 28 20:29:34.385380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:34.411608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248593-bce7-42d0-a8ab-d33f2767e476 tempest-ProjectsNegativeStaticTestJSON-1710501193 tempest-ProjectsNegativeStaticTestJSON-1710501193-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.429977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c400a-553b-4210-b0b1-b13681257501 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a353414f68bc42888010dbceb5e51cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1fd308185ff4014b5efd33c712fcc41', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.430721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c400a-553b-4210-b0b1-b13681257501 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.434748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c400a-553b-4210-b0b1-b13681257501 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.436098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c400a-553b-4210-b0b1-b13681257501 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.438692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c400a-553b-4210-b0b1-b13681257501 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.442599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c400a-553b-4210-b0b1-b13681257501 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:34.467836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcfaf8ab30f44cd9c38f019747493f8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:34.499637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcfaf8ab30f44cd9c38f019747493f8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:34.514290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcfaf8ab30f44cd9c38f019747493f8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:34.515164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcfaf8ab30f44cd9c38f019747493f8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:34.515856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcfaf8ab30f44cd9c38f019747493f8'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:34.598797 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3755/7517] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:34 2022] POST /identity/v3/projects => generated 356 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:34.598797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.604196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.604196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.626226 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3763/7518] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:33 2022] DELETE /identity/v3/users/bfcfaf8ab30f44cd9c38f019747493f8 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:34.628866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:34.634673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:34.697906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] MFA Rules not processed for user `0a7ad261869649978c45053aa84c6146`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:34.701810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:34.876226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:34.902806 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3756/7519] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:34.915427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c954ef-255a-480b-957c-508903161627 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:34.921104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:34.924497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:34.935561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:34.943065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a353414f68bc42888010dbceb5e51cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1fd308185ff4014b5efd33c712fcc41', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:34.945139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:34.947366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:34.952889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:34.954119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:34.960768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:35.066839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.sql.core [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-64510049' for key 'project.ixu_project_name_domain_id'") Aug 28 20:29:35.066839 n-d-854121-7 devstack@keystone.service[82299]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 20:29:35.066839 n-d-854121-7 devstack@keystone.service[82299]: [parameters: {'id': '93b1de82ede547eeb78aad52ad078874', 'name': 'tempest-project-dup-64510049', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 20:29:35.066839 n-d-854121-7 devstack@keystone.service[82299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-64510049, project id 93b1de82ede547eeb78aad52ad078874.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-64510049, project id 93b1de82ede547eeb78aad52ad078874. Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 20:29:35.078733 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-64510049' for key 'project.ixu_project_name_domain_id'") Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 20:29:35.079804 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application yield resource Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application next(self.gen) Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise self.value Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 20:29:35.081336 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application session.commit() Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.session.flush() Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application compat.raise_( Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 20:29:35.083008 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 20:29:35.084337 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application conn.query(q) Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application result.read() Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 20:29:35.085755 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-64510049' for key 'project.ixu_project_name_domain_id'") Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [parameters: {'id': '93b1de82ede547eeb78aad52ad078874', 'name': 'tempest-project-dup-64510049', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:35.087218 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-64510049 at domain ID default. Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:29:35.088478 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-64510049, project id 93b1de82ede547eeb78aad52ad078874. Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3764/7520] 10.222.0.78 () {60 vars in 1152 bytes} [Sun Aug 28 20:29:34 2022] POST /identity/v3/projects => generated 283 bytes in 459 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:29:35.092540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:35.116154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798828a-713e-458f-8098-68ac037ecb26 tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:35.133807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a353414f68bc42888010dbceb5e51cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1fd308185ff4014b5efd33c712fcc41', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:35.137655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:35.137655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:35.137655 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] PATH_INFO: `/v3/projects/c54baaa5441a4c85b2c0ba595c024c6b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:35.138266 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdfb09-cd6a-4384-88a6-aef42b26d6f6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:35.139252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c54baaa5441a4c85b2c0ba595c024c6b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:35.141558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:35.156052 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:35.158599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:35.159014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:35.160291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:35.172202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:35.355706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54baaa5441a4c85b2c0ba595c024c6b', 'request_id': 'req-52789b98-fa6b-40aa-bc07-144491d0d6ff'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.392048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54baaa5441a4c85b2c0ba595c024c6b', 'request_id': 'req-52789b98-fa6b-40aa-bc07-144491d0d6ff'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.398649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:35.401400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1c99d-f646-453f-ae2a-90708ca503e1 service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:35.402960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54baaa5441a4c85b2c0ba595c024c6b', 'request_id': 'req-52789b98-fa6b-40aa-bc07-144491d0d6ff'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.424595 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3757/7521] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:35.426285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:35.426653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:35.426934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:35.474640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] MFA Rules not processed for user `a43c48ccb84c497e9987eb4bc236e656`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:35.475729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:35.507441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] The token cache is being invalidate because project c54baaa5441a4c85b2c0ba595c024c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:35.507734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.509106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.510295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3765/7522] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:35 2022] DELETE /identity/v3/projects/c54baaa5441a4c85b2c0ba595c024c6b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:35.517470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:35.519191 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:35.614336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:35.615970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789b98-fa6b-40aa-bc07-144491d0d6ff tempest-ProjectsNegativeStaticTestJSON-1971853633 tempest-ProjectsNegativeStaticTestJSON-1971853633-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:35.619913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3758/7523] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:35.622933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:35.625952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:35.631943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:35.632847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:35.633138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:35.633421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] PATH_INFO: `/v3/users/6ba16205afdf49afb2dfcb0d14ffcd4b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:35.635888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba16205afdf49afb2dfcb0d14ffcd4b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:35.640835 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:35.656094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9ec5-93de-4a02-b7c0-15603b06222f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:35.663259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:35.664370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:35.664900 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:35.665243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] PATH_INFO: `/v3/projects/fc868200f14147e19c99a9d61aa56e10` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:35.666932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc868200f14147e19c99a9d61aa56e10)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:35.669417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:35.739349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:35.881476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba16205afdf49afb2dfcb0d14ffcd4b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.894343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc868200f14147e19c99a9d61aa56e10', 'request_id': 'req-6aaeeea1-a93b-4927-818d-f56fec61c750'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.903845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc868200f14147e19c99a9d61aa56e10', 'request_id': 'req-6aaeeea1-a93b-4927-818d-f56fec61c750'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.904857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba16205afdf49afb2dfcb0d14ffcd4b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.915658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc868200f14147e19c99a9d61aa56e10', 'request_id': 'req-6aaeeea1-a93b-4927-818d-f56fec61c750'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.917581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba16205afdf49afb2dfcb0d14ffcd4b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.918401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba16205afdf49afb2dfcb0d14ffcd4b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:35.919254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1adc44f3-8926-420a-bb41-ebedbfe379ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba16205afdf49afb2dfcb0d14ffcd4b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:36.011341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] The token cache is being invalidate because project fc868200f14147e19c99a9d61aa56e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:36.011711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:36.012580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:36.015259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3759/7524] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:35 2022] DELETE /identity/v3/projects/fc868200f14147e19c99a9d61aa56e10 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:36.016790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:36.018670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.138366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeeea1-a93b-4927-818d-f56fec61c750 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:36.147228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:36.147879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.148172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.148456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.150785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.187762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3766/7525] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:35 2022] DELETE /identity/v3/users/6ba16205afdf49afb2dfcb0d14ffcd4b => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:36.190905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ce04-dad5-4d5c-9f7c-9ac6e13c1172 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.191496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ce04-dad5-4d5c-9f7c-9ac6e13c1172 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.192577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ce04-dad5-4d5c-9f7c-9ac6e13c1172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.237556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b9b5ce04-dad5-4d5c-9f7c-9ac6e13c1172 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:36.239795 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b9b5ce04-dad5-4d5c-9f7c-9ac6e13c1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.295051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:36.296942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4224916-a97e-48a2-8da2-42ab0d516c9a service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:36.322422 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3760/7526] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:36.324590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.325254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.325398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.341701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:36.378762 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3767/7527] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:36.386812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871a8f-1a1f-40ec-b60c-048174487f16 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.387105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871a8f-1a1f-40ec-b60c-048174487f16 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.387536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871a8f-1a1f-40ec-b60c-048174487f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.397235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:36.400152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.410113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0b871a8f-1a1f-40ec-b60c-048174487f16 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:36.412073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0b871a8f-1a1f-40ec-b60c-048174487f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.422209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:36.439913 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3768/7528] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:36.444366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.444856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.445028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.468797 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3761/7529] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:36.478788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] MFA Rules not processed for user `cdf6b4ecef824696bc39abf6ce08e205`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:36.479060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:36.482782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.503155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e57a-bec1-4c0e-8dac-944d1b42472c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:36.534289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:36.534974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.535278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.535578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.537329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:36.537650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:36.544553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:36.591925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3762/7530] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:36.591925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:36.594833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:36.603029 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3769/7531] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:36.603029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:36.646600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f3bc8-914e-448f-9010-77f8bb904cb7 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:36.671301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:36.671951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.672241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.672520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.675162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:36.679399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:36.762225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8171d-b09e-4a91-a8f9-3844d35f37d1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:36.785083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:36.786769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:36.787200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:36.787715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:36.843279 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3770/7532] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:36 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:36.845209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:36.851550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:36.862036 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:36.912426 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3763/7533] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:37.042523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:37.057287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a4d3e-835d-418d-b387-eae4022979d5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:37.063123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:37.064030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:37.064633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:37.065078 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:37.065931 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:37.068642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:37.071113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:37.261812 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3771/7534] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:36 2022] POST /identity/v3/users => generated 289 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:37.266596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:37.284194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed080-172e-422b-8ae2-b554ddf9f03f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:37.302567 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:37.303200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:37.303703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:37.304051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:37.304723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:37.307841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:37.356352 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:37.367763 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3764/7535] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:29:37.391692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c779482-de17-448b-b675-4ea3c15d4019 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:37.401070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357a67e-156e-4924-96d3-6995fd98ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:37.401706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a67e-156e-4924-96d3-6995fd98ba4a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:37.402029 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a67e-156e-4924-96d3-6995fd98ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:37.402864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a67e-156e-4924-96d3-6995fd98ba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:37.403009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a67e-156e-4924-96d3-6995fd98ba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:37.404575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a67e-156e-4924-96d3-6995fd98ba4a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:37.422342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:37.432282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3772/7536] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:37.435011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964fa4-2226-4308-910a-9585e2c4a5d6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:37.441148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:37.442520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:37.442807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:37.443084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] PATH_INFO: `/v3/projects/b9e7579edfd8495ab1d16d3e32ef4980/users/a578808cf4394ab591f41589c1b2e113/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:37.466582 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e7579edfd8495ab1d16d3e32ef4980, user_id=a578808cf4394ab591f41589c1b2e113, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:37.470951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:37.567644 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3765/7537] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:37 2022] PUT /identity/v3/projects/b9e7579edfd8495ab1d16d3e32ef4980/users/a578808cf4394ab591f41589c1b2e113/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:37.587049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:37.587361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:37.587641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:37.630195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:37.641809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] MFA Rules not processed for user `a578808cf4394ab591f41589c1b2e113`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:37.641809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:37.753413 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3773/7538] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:37.760465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:37.916816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b27ca-34d3-463e-a9e2-df044cae7205 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:37.934431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:37.936023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:37.936721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:37.937405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:37.939635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:37.943219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:37.983870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:37.986040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:38.009775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bea12-d160-48bc-942f-eda00d45e207 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:38.020061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:38.020976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:38.021453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:38.021970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] PATH_INFO: `/v3/projects/8cecb211900443a38a7ac64551e9bba8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:38.023763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cecb211900443a38a7ac64551e9bba8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:38.028521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:38.065252 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:38.079643 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3766/7539] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:37 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:38.081044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:38.182220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6a31-64f0-451a-89d2-223826af5f80 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:38.204682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:38.205515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:38.205964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:38.206320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:38.209839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:38.212258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:38.216823 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cecb211900443a38a7ac64551e9bba8', 'request_id': 'req-4029b7aa-97c6-45e7-9633-a88e323e02d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:38.229001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cecb211900443a38a7ac64551e9bba8', 'request_id': 'req-4029b7aa-97c6-45e7-9633-a88e323e02d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:38.246342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cecb211900443a38a7ac64551e9bba8', 'request_id': 'req-4029b7aa-97c6-45e7-9633-a88e323e02d3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:38.346800 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3767/7540] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:38 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:38.357656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:38.401247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] The token cache is being invalidate because project 8cecb211900443a38a7ac64551e9bba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:38.403533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24536c-3d4e-4afa-b0a2-b0c3454af61c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:38.408021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:38.411837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:38.414388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3774/7541] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:37 2022] DELETE /identity/v3/projects/8cecb211900443a38a7ac64551e9bba8 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:38.420771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:38.423523 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:38.680147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029b7aa-97c6-45e7-9633-a88e323e02d3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:38.697243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:38.703331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:38.704123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:38.704483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:38.704814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] PATH_INFO: `/v3/users/a353414f68bc42888010dbceb5e51cc9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:38.706372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a353414f68bc42888010dbceb5e51cc9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:38.708219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:38.709997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:38.710951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:38.712591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:38.718365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:38.718573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:38.730488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:38.800512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3768/7542] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:38.802360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:38.806145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:38.837368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a8cb-c1ea-4e39-a432-bf4e3ee97bef admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:38.859130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:38.860441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:38.866481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:38.867898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:38.868684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:38.870510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:38.889411 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3769/7543] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:38.893671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:38.906586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47cbd7-3a72-4690-9401-e0a1dd6013f1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:38.914627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e1605-aa1f-4932-87ad-5a27273bb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:38.915882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e1605-aa1f-4932-87ad-5a27273bb67f admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:38.916396 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e1605-aa1f-4932-87ad-5a27273bb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:38.916999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e1605-aa1f-4932-87ad-5a27273bb67f admin admin] PATH_INFO: `/v3/projects/8d5a2fdde3894c23b9b93253fff8787c/users/69772d3f19474209b1578979b3b5a0bf/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:38.943076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e1605-aa1f-4932-87ad-5a27273bb67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5a2fdde3894c23b9b93253fff8787c, user_id=69772d3f19474209b1578979b3b5a0bf, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:38.948631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e1605-aa1f-4932-87ad-5a27273bb67f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:38.972380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:39.062109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a353414f68bc42888010dbceb5e51cc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:39.092094 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3770/7544] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:38 2022] PUT /identity/v3/projects/8d5a2fdde3894c23b9b93253fff8787c/users/69772d3f19474209b1578979b3b5a0bf/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:39.101544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a353414f68bc42888010dbceb5e51cc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:39.105401 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:39.105695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:39.106171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:39.135481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a353414f68bc42888010dbceb5e51cc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:39.136513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a353414f68bc42888010dbceb5e51cc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:39.138250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a353414f68bc42888010dbceb5e51cc9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:39.166185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] MFA Rules not processed for user `69772d3f19474209b1578979b3b5a0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:39.172590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:39.269766 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3771/7545] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:39.291761 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3775/7546] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:38 2022] DELETE /identity/v3/users/a353414f68bc42888010dbceb5e51cc9 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:39.293709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:39.302162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:39.486565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b91bc-bde1-40e5-9bfe-d9cd2b8884a5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:39.631925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:39.632905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:39.633409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:39.634450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:39.639087 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:39.899883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:39.918849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8458de-2684-4ea8-84c7-508a7979f4c0 service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:39.933572 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3772/7547] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:40.061465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:40.326765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:40.328412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:40.360323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b14fba-517f-4558-89d3-b59240e808d4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:40.360553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b14fba-517f-4558-89d3-b59240e808d4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:40.360890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b14fba-517f-4558-89d3-b59240e808d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:40.404799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d4b14fba-517f-4558-89d3-b59240e808d4 None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:40.406301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d4b14fba-517f-4558-89d3-b59240e808d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:40.427979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:40.502479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549700-fbe1-48db-a559-090aa7f98517 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:40.511637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:40.512892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:40.513691 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:40.514267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] PATH_INFO: `/v3/projects/e1fd308185ff4014b5efd33c712fcc41` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:40.521158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fd308185ff4014b5efd33c712fcc41)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:40.521158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:40.535975 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3773/7548] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:29:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:40.539179 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:40.540251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:40.540656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:40.579144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] MFA Rules not processed for user `54542f1a89e34df5bdb8dc8ed4ad3b88`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:40.580423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:40.658953 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3774/7549] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:40.695065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fd308185ff4014b5efd33c712fcc41', 'request_id': 'req-c5c73cbf-c28f-4619-98a5-cd0098e77532'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:40.706005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fd308185ff4014b5efd33c712fcc41', 'request_id': 'req-c5c73cbf-c28f-4619-98a5-cd0098e77532'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:40.713136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fd308185ff4014b5efd33c712fcc41', 'request_id': 'req-c5c73cbf-c28f-4619-98a5-cd0098e77532'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:40.805630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:40.809787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] The token cache is being invalidate because project e1fd308185ff4014b5efd33c712fcc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:40.810117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:40.816236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c5c73cbf-c28f-4619-98a5-cd0098e77532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:40.817446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:40.819429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:40.821835 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3776/7550] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:40 2022] DELETE /identity/v3/projects/e1fd308185ff4014b5efd33c712fcc41 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:40.823472 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd1e9-b384-4ed7-8d36-28051c619ab9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:40.823768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd1e9-b384-4ed7-8d36-28051c619ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:40.824174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd1e9-b384-4ed7-8d36-28051c619ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:40.909824 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5adfd1e9-b384-4ed7-8d36-28051c619ab9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:40.912037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5adfd1e9-b384-4ed7-8d36-28051c619ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:40.962416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd179b4c-b6e3-48ce-81da-75c1c54a9ca7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:41.011214 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3777/7551] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:41.018591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.019880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.020348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.052705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:41.054269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:41.060460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:41.061269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.061751 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.062801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.066355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:41.067886 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3778/7552] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:41.071938 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:41.094202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d21241-497e-43fa-9089-10ae329ba444 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:41.107302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:41.108208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.108657 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.109071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.110637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:41.110943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:41.116921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:41.150212 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3779/7553] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:41.154075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:41.154700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:41.157033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:41.168802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4325f4-fdf0-437b-aba6-5176538af5c0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:41.171512 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3775/7554] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:29:41.180276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:41.182533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.194922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.194922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.194922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:41.194922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:41.374309 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3780/7555] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:41 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:41.374964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:41.392621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2210e7-83dc-407e-99cf-6a0be3a0a8f7 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:41.497704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:41.498533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.498939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.499281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.500066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:41.502630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:41.740947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3776/7556] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:41 2022] POST /identity/v3/users => generated 299 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:41.758579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:41.784551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b206e-e6fd-4daa-88f0-c1c3d899df9e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:41.790629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:41.791573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.792083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.792527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.793387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:41.795318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:41.807654 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3781/7557] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:41.812162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:41.824987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5fd23-a611-440c-8490-77a7e9b8a91e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:41.830712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:41.831322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:41.831597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:41.831876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] PATH_INFO: `/v3/projects/750250bb11f64bcdb7b09431af796b2b/users/f69dc8c336cc470d82c438a1fc19e8dc/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:41.854613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750250bb11f64bcdb7b09431af796b2b, user_id=f69dc8c336cc470d82c438a1fc19e8dc, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:41.857581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:41.986303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:41.987742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:42.000120 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3777/7558] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:41 2022] PUT /identity/v3/projects/750250bb11f64bcdb7b09431af796b2b/users/f69dc8c336cc470d82c438a1fc19e8dc/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:42.011403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:42.126476 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d5db-697a-473f-836c-4693060d4438 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:42.143624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73768db5-1154-43d9-a402-7587323d3a74 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:42.151951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:42.153358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.154395 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.154759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.156173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:42.157965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:42.170507 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3778/7559] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:42.186993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:42.204150 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:42.204896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.205283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.205656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a83ee-2363-43b1-a909-f0b7dfa1de09 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:42.205808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.209714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:42.212878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f36e2-3c07-4adc-a041-fc2bc9d0d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:42.213904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f36e2-3c07-4adc-a041-fc2bc9d0d49a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.214195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f36e2-3c07-4adc-a041-fc2bc9d0d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.214500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f36e2-3c07-4adc-a041-fc2bc9d0d49a admin admin] PATH_INFO: `/v3/projects/750250bb11f64bcdb7b09431af796b2b/users/f69dc8c336cc470d82c438a1fc19e8dc/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.217144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f36e2-3c07-4adc-a041-fc2bc9d0d49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=750250bb11f64bcdb7b09431af796b2b, user_id=f69dc8c336cc470d82c438a1fc19e8dc, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:42.220096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f36e2-3c07-4adc-a041-fc2bc9d0d49a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:42.249905 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3779/7560] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:42 2022] PUT /identity/v3/projects/750250bb11f64bcdb7b09431af796b2b/users/f69dc8c336cc470d82c438a1fc19e8dc/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:42.264279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c651-34ac-4067-b6c3-979e69b39b53 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.264684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c651-34ac-4067-b6c3-979e69b39b53 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.264964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c651-34ac-4067-b6c3-979e69b39b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.337244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:42.339656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:42.354681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2917c651-34ac-4067-b6c3-979e69b39b53 None None] MFA Rules not processed for user `f69dc8c336cc470d82c438a1fc19e8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:42.355853 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3782/7561] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:42.362932 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2917c651-34ac-4067-b6c3-979e69b39b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:42.506023 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3780/7562] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:42.510262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:42.526768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507a86-6d67-4ebc-ad17-fc2af4f07923 service glance] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:42.565474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.565474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.565474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.610656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:42.613364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:42.681194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:42.685416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.685416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.685416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.685416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:42.685416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:42.719863 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3781/7563] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:42.720285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:42.750886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:42.753007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:42.817992 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3783/7564] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:42 2022] POST /identity/v3/projects => generated 383 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:42.822692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:42.875660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1c5b-c743-461f-a58e-b8ba4cc94adc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:42.932171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff833558-f857-47ad-ba2d-6050ec4be803 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:42.942066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:42.943116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.943505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.943882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:42.944871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:42.947087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:42.949681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:42.949681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:42.949681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:42.949681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:43.027441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:43.029075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:43.043899 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3784/7565] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:42 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:43.045674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:43.054544 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3782/7566] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:29:43.087151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a3405-dd5f-498f-a0b6-a3aea5b0f154 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:43.095140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:43.095860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:43.096179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:43.096458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:43.097158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:43.099069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:43.138940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3785/7567] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:43.140780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:43.156404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e4f6-9bf0-432a-be8d-6ab7454c3885 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:43.159394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:43.164677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3fcb0-4814-4f11-9691-0e1262c8b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:43.165919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3fcb0-4814-4f11-9691-0e1262c8b5ef admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:43.166522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3fcb0-4814-4f11-9691-0e1262c8b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:43.166933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3fcb0-4814-4f11-9691-0e1262c8b5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:43.167980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3fcb0-4814-4f11-9691-0e1262c8b5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:43.170773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3fcb0-4814-4f11-9691-0e1262c8b5ef admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:43.192243 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3783/7568] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:43.200801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:43.223622 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c503a2-fc78-4571-b4ff-cca69ae3cb53 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:43.233980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:43.234890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:43.235515 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:43.236027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] PATH_INFO: `/v3/projects/99ecf91835b245d38b21b166842c39e3/users/8c18d764074343c5b11d1da5f6760b26/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:43.278170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ecf91835b245d38b21b166842c39e3, user_id=8c18d764074343c5b11d1da5f6760b26, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:43.286921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:43.343076 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3786/7569] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:43 2022] PUT /identity/v3/projects/99ecf91835b245d38b21b166842c39e3/users/8c18d764074343c5b11d1da5f6760b26/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:43.355008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:43.355700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:43.366199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:43.427480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] MFA Rules not processed for user `8c18d764074343c5b11d1da5f6760b26`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:43.428725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:43.534523 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3784/7570] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:43.561687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:43.628468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bfea5-2dd9-4af6-b4f9-a5b838503981 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:43.633418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a017-b0f1-47b5-8fe5-565d890b3333 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:43.634311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a017-b0f1-47b5-8fe5-565d890b3333 service glance] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:43.634710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a017-b0f1-47b5-8fe5-565d890b3333 service glance] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:43.635095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a017-b0f1-47b5-8fe5-565d890b3333 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:43.668010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:43.712126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a017-b0f1-47b5-8fe5-565d890b3333 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:43.713800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a017-b0f1-47b5-8fe5-565d890b3333 service glance] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:43.729350 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3787/7571] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:43.853663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:43.879298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:43.889114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:43.996948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d9d47-98b5-4bab-84f2-b87aefbdf73d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:44.007307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:44.007980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:44.008269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:44.008601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] PATH_INFO: `/v3/users/a578808cf4394ab591f41589c1b2e113` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:44.009933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a578808cf4394ab591f41589c1b2e113)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:44.011952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:44.266691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a578808cf4394ab591f41589c1b2e113'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:44.266691 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a578808cf4394ab591f41589c1b2e113'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:44.283136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:44.335399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a578808cf4394ab591f41589c1b2e113'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:44.346706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a578808cf4394ab591f41589c1b2e113'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:44.349711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a578808cf4394ab591f41589c1b2e113'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:44.395055 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3785/7572] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:43 2022] DELETE /identity/v3/users/a578808cf4394ab591f41589c1b2e113 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:44.402588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:44.402588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:44.402588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:44.423443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:44.425024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:44.449044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:44.485807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:44.505953 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3788/7573] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:44.514404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:44.517768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:44.595605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434610-7e57-4b5c-83c3-5f59d6371705 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:44.600163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:44.600897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:44.601279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:44.601655 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:44.618850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:44.620595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:44.632734 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3786/7574] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:44.694200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:45.272961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:45.364733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:45.593303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:45.593303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:45.596361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:45.599168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:45.612469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8ee67-a3a5-4566-bf26-1be920daa8fa None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:45.616645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9da44-26d0-4b39-9f85-f88c289e66e8 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:45.624983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:45.625281 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:45.625799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:45.625996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:45.626231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:45.626466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:45.626637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] PATH_INFO: `/v3/projects/b9e7579edfd8495ab1d16d3e32ef4980` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:45.626922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] PATH_INFO: `/v3/users/f69dc8c336cc470d82c438a1fc19e8dc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:45.628333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69dc8c336cc470d82c438a1fc19e8dc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:45.628484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e7579edfd8495ab1d16d3e32ef4980)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:45.630512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:45.630881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:46.123505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:46.151236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e7579edfd8495ab1d16d3e32ef4980', 'request_id': 'req-4110d4c7-6854-4935-8b0a-dc0b23382e40'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.164300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e7579edfd8495ab1d16d3e32ef4980', 'request_id': 'req-4110d4c7-6854-4935-8b0a-dc0b23382e40'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.174939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e7579edfd8495ab1d16d3e32ef4980', 'request_id': 'req-4110d4c7-6854-4935-8b0a-dc0b23382e40'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.183787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69dc8c336cc470d82c438a1fc19e8dc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.216119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69dc8c336cc470d82c438a1fc19e8dc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.235360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69dc8c336cc470d82c438a1fc19e8dc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.238054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69dc8c336cc470d82c438a1fc19e8dc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.241108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69dc8c336cc470d82c438a1fc19e8dc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.279690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] The token cache is being invalidate because project b9e7579edfd8495ab1d16d3e32ef4980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:46.279985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.280594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.286764 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3787/7575] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:45 2022] DELETE /identity/v3/projects/b9e7579edfd8495ab1d16d3e32ef4980 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:46.288152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:46.289685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:46.377268 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3789/7576] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:45 2022] DELETE /identity/v3/users/f69dc8c336cc470d82c438a1fc19e8dc => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:46.384905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:46.390379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:46.428224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:46.473966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d4c7-6854-4935-8b0a-dc0b23382e40 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:46.590766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:46.591413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:46.591698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:46.592262 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] PATH_INFO: `/v3/users/69772d3f19474209b1578979b3b5a0bf` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:46.596186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69772d3f19474209b1578979b3b5a0bf)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:46.601774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:46.621182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:46.716267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3262633-1b19-4de1-8f2e-33b12739700a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:46.729116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:46.730492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:46.738737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:46.738737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:46.738737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:46.756659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:46.760946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671f044-27bd-4f46-845a-df52d02091ad service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:46.775920 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3790/7577] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:46.795963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:46.797160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:46.797529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:46.849171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:46.850326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:46.881132 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3791/7578] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:46.909300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69772d3f19474209b1578979b3b5a0bf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.910945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69772d3f19474209b1578979b3b5a0bf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:46.913980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:46.915986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:47.021064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69772d3f19474209b1578979b3b5a0bf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:47.031205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69772d3f19474209b1578979b3b5a0bf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:47.032534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69772d3f19474209b1578979b3b5a0bf'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:47.041872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d166-e4f1-4211-aef8-23bf88748ab2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:47.060721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:47.060721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:47.060721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:47.060721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:47.061340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:47.061451 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3788/7579] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:46 2022] DELETE /identity/v3/users/69772d3f19474209b1578979b3b5a0bf => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:47.068547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:47.070067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:47.083644 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3792/7580] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:47.388550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:47.651451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:47.654708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:47.781946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfa8b-c2af-4891-805a-65f2a979af31 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:47.789880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:47.791393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:47.791757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:47.792294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:47.794325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:47.816237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:47.821006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:47.836322 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3789/7581] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:48.074558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:48.076218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:48.082533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:48.094090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb657-ebee-4dc3-8023-a774fa325abb service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:48.194245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:48.196525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:48.256545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:48.257986 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:48.258438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:48.261560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] PATH_INFO: `/v3/projects/8d5a2fdde3894c23b9b93253fff8787c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:48.280072 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5a2fdde3894c23b9b93253fff8787c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:48.289705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:48.402597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c158f91-c4f9-4a7d-bf0c-ea6679a4695b service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:48.411096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:48.411749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:48.412037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:48.412320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] PATH_INFO: `/v3/projects/750250bb11f64bcdb7b09431af796b2b` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:48.413704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=750250bb11f64bcdb7b09431af796b2b)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:48.421579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:48.487403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5a2fdde3894c23b9b93253fff8787c', 'request_id': 'req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.505572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5a2fdde3894c23b9b93253fff8787c', 'request_id': 'req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.517013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5a2fdde3894c23b9b93253fff8787c', 'request_id': 'req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.572660 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750250bb11f64bcdb7b09431af796b2b', 'request_id': 'req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.582526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750250bb11f64bcdb7b09431af796b2b', 'request_id': 'req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.595134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750250bb11f64bcdb7b09431af796b2b', 'request_id': 'req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.660656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] The token cache is being invalidate because project 8d5a2fdde3894c23b9b93253fff8787c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:48.661148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.665582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-41ec0dda-b5d3-4dbc-b7af-83312f9b5804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.671441 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3793/7582] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:48 2022] DELETE /identity/v3/projects/8d5a2fdde3894c23b9b93253fff8787c => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:48.679871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d40cc-4576-4db1-8267-22be72fd9097 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:48.680572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d40cc-4576-4db1-8267-22be72fd9097 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:48.680572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d40cc-4576-4db1-8267-22be72fd9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:48.721918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-873d40cc-4576-4db1-8267-22be72fd9097 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:48.735067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-873d40cc-4576-4db1-8267-22be72fd9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:48.743563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] The token cache is being invalidate because project 750250bb11f64bcdb7b09431af796b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:48.744186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.745020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:48.751006 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3790/7583] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:48 2022] DELETE /identity/v3/projects/750250bb11f64bcdb7b09431af796b2b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:48.756526 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:48.763629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:48.838933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:48.915862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc8f55-74c3-42fc-b4c6-e244a7670b8a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:48.922951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:48.923650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:48.923933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:48.924265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] PATH_INFO: `/v3/users/8c18d764074343c5b11d1da5f6760b26` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:48.926048 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c18d764074343c5b11d1da5f6760b26)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:48.930724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:48.965197 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3794/7584] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:48.975464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:48.975825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:48.976408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.006572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:49.007895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:49.018048 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3795/7585] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:49.023022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:49.033914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419acadd-4525-43a7-9ff2-3e7e92f54922 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:49.041505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:49.043250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.043527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.043797 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.047518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:49.047902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:49.051530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:49.070012 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3796/7586] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:49.075365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:49.087344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f8fc-f86b-4f13-88cb-20cf68c2a42c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:49.093908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:49.095118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.095412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.095968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.096514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:49.099420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:49.192246 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c18d764074343c5b11d1da5f6760b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:49.194772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c18d764074343c5b11d1da5f6760b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:49.213928 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3797/7587] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:49 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:49.215953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:49.278079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c18d764074343c5b11d1da5f6760b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:49.288716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c18d764074343c5b11d1da5f6760b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:49.290030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c18d764074343c5b11d1da5f6760b26'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:49.333044 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3791/7588] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:48 2022] DELETE /identity/v3/users/8c18d764074343c5b11d1da5f6760b26 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:49.343739 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221dd15-4d89-4f9e-b98c-1c928efb1d37 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:49.472044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:49.473510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.473999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.474446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.475274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:49.478014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:49.608335 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3798/7589] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:49 2022] POST /identity/v3/users => generated 284 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:49.612671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:49.614113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:49.629134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56032aca-b236-49eb-a623-1c98dc9d8c5b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:49.636276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:49.638317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.638492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.638802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.640353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:49.642094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:49.662910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3792/7590] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:49.667158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:49.680913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9336aa8-d3f7-4246-acd7-9049156a8e44 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:49.687089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d6a4a-8ee8-4e17-a8cb-b188c7361d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:49.687688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d6a4a-8ee8-4e17-a8cb-b188c7361d78 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.690041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d6a4a-8ee8-4e17-a8cb-b188c7361d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.690041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d6a4a-8ee8-4e17-a8cb-b188c7361d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.690041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d6a4a-8ee8-4e17-a8cb-b188c7361d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:49.690906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d6a4a-8ee8-4e17-a8cb-b188c7361d78 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:49.703897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3799/7591] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:29:49.706081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:49.724652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c1d84-384f-43b8-80b4-db7c97b7bfa5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:49.731898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:49.733124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.733727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.734211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] PATH_INFO: `/v3/projects/0765a5fc02c94b3786af421871a3999f/users/c56de22e13404b668bc4ee5c778aecf8/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.761454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0765a5fc02c94b3786af421871a3999f, user_id=c56de22e13404b668bc4ee5c778aecf8, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:49.766729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:49.874621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3793/7592] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:49 2022] PUT /identity/v3/projects/0765a5fc02c94b3786af421871a3999f/users/c56de22e13404b668bc4ee5c778aecf8/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:49.889503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:49.890086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:49.890412 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:49.890687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:49.938656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] MFA Rules not processed for user `c56de22e13404b668bc4ee5c778aecf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:49.939245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:50.052233 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3800/7593] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:50.052502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.139575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.142179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:50.159697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5184628-cca2-47eb-b2b2-e146cf959929 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.167134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.167954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.168279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.168710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.169542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.171647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.197785 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:50.254958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949eade-55cd-4afc-a858-8b05622a5ace None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.264732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.264732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.264732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.264732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] PATH_INFO: `/v3/projects/99ecf91835b245d38b21b166842c39e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.265207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ecf91835b245d38b21b166842c39e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.266980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.293627 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3794/7594] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:50 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:50.299148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.402589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254060fe-408b-4637-a801-005aeb8a9d4f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.415111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ecf91835b245d38b21b166842c39e3', 'request_id': 'req-a19bc158-c25a-4b06-9150-5d8c762eb1cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:50.429102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ecf91835b245d38b21b166842c39e3', 'request_id': 'req-a19bc158-c25a-4b06-9150-5d8c762eb1cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:50.440429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ecf91835b245d38b21b166842c39e3', 'request_id': 'req-a19bc158-c25a-4b06-9150-5d8c762eb1cb'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:50.526624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] The token cache is being invalidate because project 99ecf91835b245d38b21b166842c39e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:50.526624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:50.526871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a19bc158-c25a-4b06-9150-5d8c762eb1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:50.533204 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3801/7595] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:50 2022] DELETE /identity/v3/projects/99ecf91835b245d38b21b166842c39e3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:50.536855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7cdef-4576-432a-9264-394c79e98803 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.537157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7cdef-4576-432a-9264-394c79e98803 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.537508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7cdef-4576-432a-9264-394c79e98803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.563532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.567967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.568760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.569973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.571720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.576428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.578876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-81b7cdef-4576-432a-9264-394c79e98803 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:50.580146 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81b7cdef-4576-432a-9264-394c79e98803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:50.596932 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3802/7596] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:50.599304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.599606 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.599887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.637125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:50.638493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:50.650131 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3803/7597] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:50.653215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.667723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e382-4fa7-4e80-9465-acdbefc3309d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.674609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.675241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.676080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.676362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.677012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:29:50.677335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.679427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.697893 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3804/7598] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:29:50.702496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.715409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bacbc0-9363-4463-8743-b7d68eb3ca31 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.720916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.721809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.727327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.727327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.727327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.727327 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.739582 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3795/7599] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:50 2022] POST /identity/v3/users => generated 285 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:50.740959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.743137 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:50.760944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48cc1-81b4-4f48-8d4a-a66eaea291c3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.768031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.768851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.769458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.770105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.770836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.773314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.785520 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3796/7600] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:50.789682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.805433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0681-ad55-411a-8c48-4077632c6850 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.812457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.814448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.814448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.814448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.814448 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.816118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:50.832086 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3797/7601] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:29:50.836653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:50.897062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87055807-4984-439d-978e-d5cf438cc247 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:50.897062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff922c-e304-4d47-ae44-28334064a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:50.897062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff922c-e304-4d47-ae44-28334064a40c admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:50.897062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff922c-e304-4d47-ae44-28334064a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:50.899600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff922c-e304-4d47-ae44-28334064a40c admin admin] PATH_INFO: `/v3/projects/9a1ce586c1934874910724b9338c0ada/users/0639f0b190ee4069a0c228736ea1dc34/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:50.899600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff922c-e304-4d47-ae44-28334064a40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1ce586c1934874910724b9338c0ada, user_id=0639f0b190ee4069a0c228736ea1dc34, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:50.899600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff922c-e304-4d47-ae44-28334064a40c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:51.642066 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3805/7602] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:50 2022] POST /identity/v3/projects => generated 375 bytes in 939 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:51.689149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:51.760640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b939f1-8fb5-48ce-8f69-68079df2d570 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:51.765794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:51.766439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:51.766726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:51.767114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:51.767756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:51.770067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:51.833247 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3798/7603] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:50 2022] PUT /identity/v3/projects/9a1ce586c1934874910724b9338c0ada/users/0639f0b190ee4069a0c228736ea1dc34/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:51.844605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:51.845005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:51.845348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:51.888829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] MFA Rules not processed for user `0639f0b190ee4069a0c228736ea1dc34`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:51.890290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:51.929314 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3806/7604] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:51 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:29:51.930862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:51.954329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaa30-5a4c-4d4a-8262-2c9a49a6bb0f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:51.987602 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3799/7605] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:52.000335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.001787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:52.039589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.040525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.041026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.041745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.042603 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.044564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.063524 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3807/7606] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:52.067496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.079724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ef2e-b406-42de-a605-2bca9821d92c None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.084524 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130fde-c98d-475c-9a22-201f7d6f61fd admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.084672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.084672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.084672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.085023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.087598 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:52.088484 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.089216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.089404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.089633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.090399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.092387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.107043 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3808/7607] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:52.110852 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.123787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce14ded-372f-426a-a0f5-c0e3a2790e3d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.130641 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.131560 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.131853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.132182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] PATH_INFO: `/v3/projects/f8844069b3434c5bb53c853e31d97769/users/78a2863249854989b92cfc253f29deec/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.162201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8844069b3434c5bb53c853e31d97769, user_id=78a2863249854989b92cfc253f29deec, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.165534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.181096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.182669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fd63-7387-44d8-a87a-fc4e88cffe8a service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.193803 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3800/7608] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:52.273600 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3809/7609] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:52 2022] PUT /identity/v3/projects/f8844069b3434c5bb53c853e31d97769/users/78a2863249854989b92cfc253f29deec/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:52.286325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.286741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.286865 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.295993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:52.319354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] MFA Rules not processed for user `78a2863249854989b92cfc253f29deec`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:52.320591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:52.430237 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3801/7610] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:52.434616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.516638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8daf-56b0-4d85-a9e4-7501100175f1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.523028 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.524435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.524435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.524435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.525147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.527170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.592265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.596467 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:52.640421 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3810/7611] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:29:52 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:52.645793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.684435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3170-4fc5-488d-a3e7-920d67e78644 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.726735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356f5bc-cb3c-4aee-b0ac-8c17d4d5a996 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.731638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.732259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.732533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.732955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.733601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.735579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.745924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c178aac643a48d48f2707b407ffa65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.746783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.747198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.747706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.811019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.812492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.822793 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3802/7612] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:52.885398 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3811/7613] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:29:52 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:29:52.886669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.904218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d642f-be82-498f-a737-22e53ddaa7d8 service glance] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.909630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.911074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.911494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.911770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.912623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.915891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:52.928665 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3803/7614] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:52.932599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:52.944909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cfb3a-3f87-42d7-8c32-ee052b836fd0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:52.950685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:52.951364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:52.951644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:52.951918 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] PATH_INFO: `/v3/projects/5d5e299bab0a41ddbcda658446e0fd13/users/994fe097dfcf4dbb8b5291f5e82caf7d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:52.971985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5e299bab0a41ddbcda658446e0fd13, user_id=994fe097dfcf4dbb8b5291f5e82caf7d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:52.976384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:53.092440 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3812/7615] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:52 2022] PUT /identity/v3/projects/5d5e299bab0a41ddbcda658446e0fd13/users/994fe097dfcf4dbb8b5291f5e82caf7d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:53.096578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:53.109591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84900f-9af7-408f-a299-3d6a23fc16a5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:53.174864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb5a6c-57a9-475f-b832-f8631339c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:53.176239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5a6c-57a9-475f-b832-f8631339c505 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:53.176520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5a6c-57a9-475f-b832-f8631339c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:53.176820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5a6c-57a9-475f-b832-f8631339c505 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:53.177430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb5a6c-57a9-475f-b832-f8631339c505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:53.179057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb5a6c-57a9-475f-b832-f8631339c505 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:53.190234 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3804/7616] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:29:53.195090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:53.218374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c480d7-00da-448f-b740-96f5cd5ac883 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:53.225870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:53.226971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:53.227252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:53.227574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] PATH_INFO: `/v3/projects/5d5e299bab0a41ddbcda658446e0fd13/users/994fe097dfcf4dbb8b5291f5e82caf7d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:53.229826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5e299bab0a41ddbcda658446e0fd13, user_id=994fe097dfcf4dbb8b5291f5e82caf7d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:53.232692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:53.248180 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3813/7617] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:29:53 2022] PUT /identity/v3/projects/5d5e299bab0a41ddbcda658446e0fd13/users/994fe097dfcf4dbb8b5291f5e82caf7d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:53.259295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:53.259577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:53.259844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:53.293729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] MFA Rules not processed for user `994fe097dfcf4dbb8b5291f5e82caf7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:53.295034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:53.400082 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3805/7618] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:53.408715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:53.411693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:53.497076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67998de-899a-469f-86be-ee790afc12f3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:53.501444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:53.502395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:53.502788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:53.503212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:53.515165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:53.516844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:53.530269 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3814/7619] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:54.609651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:55.013675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:56.427576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:56.445699 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:56.542253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1152-87d5-462f-a0a5-2f49bb44b770 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:56.549525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:56.550594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:56.551315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:56.551776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] PATH_INFO: `/v3/users/c56de22e13404b668bc4ee5c778aecf8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:56.553520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56de22e13404b668bc4ee5c778aecf8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:56.556500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:56.719802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:56.731057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aed42-b9b3-4657-a6d4-f9fb5ff68cd5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:56.735754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:56.736366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:56.736645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:56.737051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] PATH_INFO: `/v3/users/78a2863249854989b92cfc253f29deec` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:56.738222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a2863249854989b92cfc253f29deec)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:56.740195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:56.790057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56de22e13404b668bc4ee5c778aecf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:56.790884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56de22e13404b668bc4ee5c778aecf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:56.942369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56de22e13404b668bc4ee5c778aecf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:56.950358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56de22e13404b668bc4ee5c778aecf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:56.956102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c29d5e29-a178-4aea-9cf3-9c30b06c21a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56de22e13404b668bc4ee5c778aecf8'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:56.970617 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3806/7620] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:56 2022] DELETE /identity/v3/users/c56de22e13404b668bc4ee5c778aecf8 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:56.975569 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:56.975885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:56.976169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:56.995827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:57.002125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:57.062325 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3807/7621] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:29:57.069930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a2863249854989b92cfc253f29deec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:57.073198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:57.074709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:57.083741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a2863249854989b92cfc253f29deec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:57.091093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a2863249854989b92cfc253f29deec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:57.091858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a2863249854989b92cfc253f29deec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:57.092496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a2863249854989b92cfc253f29deec'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:57.141957 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c31f94-b2cc-4ce8-a46e-08c37914dd46 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:57.146842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:57.147453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:57.147732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:57.148010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:57.150024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:57.170353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:57.171791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3750f-3415-4010-b1e8-982a3bffe80d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:57.182699 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3808/7622] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:29:57.286282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3815/7623] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:56 2022] DELETE /identity/v3/users/78a2863249854989b92cfc253f29deec => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:57.287747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:57.288239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:57.288530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:57.334305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:57.335611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:57.477100 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3809/7624] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:57.495535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:57.495535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:57.518539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:57.592249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec350-6ad1-4382-aa62-2c44a04b8502 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:57.597310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916048-3a98-4014-bc53-484f5b018b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:57.598094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916048-3a98-4014-bc53-484f5b018b10 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:57.598312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916048-3a98-4014-bc53-484f5b018b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:57.598562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916048-3a98-4014-bc53-484f5b018b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:57.615424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38916048-3a98-4014-bc53-484f5b018b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:57.617231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38916048-3a98-4014-bc53-484f5b018b10 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:57.629736 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3816/7625] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:29:57.779933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:57.782109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:57.797791 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdd26d-f897-4a3d-88bc-c07be886d950 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:57.804562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:57.805962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:57.805962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:57.806319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] PATH_INFO: `/v3/projects/0765a5fc02c94b3786af421871a3999f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:57.808990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0765a5fc02c94b3786af421871a3999f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:57.812403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:57.930872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:57.930872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:57.931624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:57.953776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] MFA Rules not processed for user `cdf6b4ecef824696bc39abf6ce08e205`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:29:57.955139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:58.006366 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0765a5fc02c94b3786af421871a3999f', 'request_id': 'req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.013362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0765a5fc02c94b3786af421871a3999f', 'request_id': 'req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.021640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0765a5fc02c94b3786af421871a3999f', 'request_id': 'req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.027643 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3817/7626] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:29:58.127507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] The token cache is being invalidate because project 0765a5fc02c94b3786af421871a3999f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:58.130151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.130151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.130547 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3810/7627] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:57 2022] DELETE /identity/v3/projects/0765a5fc02c94b3786af421871a3999f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:58.135998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:58.149974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce570-873f-4d4a-aa9c-1b6bd16e176a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:58.214547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:58.215311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:58.215487 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:58.215768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] PATH_INFO: `/v3/users/0639f0b190ee4069a0c228736ea1dc34` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:58.217234 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0639f0b190ee4069a0c228736ea1dc34)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:58.219217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:58.225783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:58.426877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:58.441023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:58.442672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:58.457077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97852c-468d-43c5-a492-a7d0f9d4ffe0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:58.490564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:58.490564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:58.490564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:58.490564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] PATH_INFO: `/v3/projects/f8844069b3434c5bb53c853e31d97769` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:58.491456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8844069b3434c5bb53c853e31d97769)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:58.492408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:58.549325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0639f0b190ee4069a0c228736ea1dc34'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.565707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0639f0b190ee4069a0c228736ea1dc34'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.575284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0639f0b190ee4069a0c228736ea1dc34'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.576260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0639f0b190ee4069a0c228736ea1dc34'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.576950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0639f0b190ee4069a0c228736ea1dc34'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.639752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8844069b3434c5bb53c853e31d97769', 'request_id': 'req-b331d139-f70f-42a5-a938-7581d413d28b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.648991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8844069b3434c5bb53c853e31d97769', 'request_id': 'req-b331d139-f70f-42a5-a938-7581d413d28b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.655974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8844069b3434c5bb53c853e31d97769', 'request_id': 'req-b331d139-f70f-42a5-a938-7581d413d28b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.757087 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3818/7628] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:58 2022] DELETE /identity/v3/users/0639f0b190ee4069a0c228736ea1dc34 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:58.848291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] The token cache is being invalidate because project f8844069b3434c5bb53c853e31d97769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:58.848291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.848291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:58.848291 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3811/7629] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:58 2022] DELETE /identity/v3/projects/f8844069b3434c5bb53c853e31d97769 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:29:58.854068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:58.855994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:58.935383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae3ee-62cc-4e2b-af26-a75873fae7f2 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:58.941250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:58.942587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:58.942934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:58.943269 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] PATH_INFO: `/v3/users/994fe097dfcf4dbb8b5291f5e82caf7d` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:58.944505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=994fe097dfcf4dbb8b5291f5e82caf7d)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:58.946672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:59.456875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:29:59.459535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:29:59.460613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994fe097dfcf4dbb8b5291f5e82caf7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.484882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994fe097dfcf4dbb8b5291f5e82caf7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.508113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994fe097dfcf4dbb8b5291f5e82caf7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.508113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994fe097dfcf4dbb8b5291f5e82caf7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.508113 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-56163b95-21d9-4095-b184-3fbbcd261bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994fe097dfcf4dbb8b5291f5e82caf7d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.548857 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d139-f70f-42a5-a938-7581d413d28b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:29:59.557295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:29:59.558581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:59.558959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:59.559414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] PATH_INFO: `/v3/projects/9a1ce586c1934874910724b9338c0ada` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:29:59.562565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1ce586c1934874910724b9338c0ada)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:29:59.564519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:29:59.615702 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3819/7630] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:29:58 2022] DELETE /identity/v3/users/994fe097dfcf4dbb8b5291f5e82caf7d => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:59.771690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1ce586c1934874910724b9338c0ada', 'request_id': 'req-846ff532-66cc-495f-82cc-0230b3f1dd43'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.780651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1ce586c1934874910724b9338c0ada', 'request_id': 'req-846ff532-66cc-495f-82cc-0230b3f1dd43'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.789054 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1ce586c1934874910724b9338c0ada', 'request_id': 'req-846ff532-66cc-495f-82cc-0230b3f1dd43'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.968085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] The token cache is being invalidate because project 9a1ce586c1934874910724b9338c0ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:29:59.971553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.971553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-846ff532-66cc-495f-82cc-0230b3f1dd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:29:59.973412 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3812/7631] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:29:59 2022] DELETE /identity/v3/projects/9a1ce586c1934874910724b9338c0ada => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:29:59.979588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:29:59.980324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:29:59.980324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.007006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:00.008735 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.083791 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3820/7632] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:00.092601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.093006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.093206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.124264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:00.126544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.137626 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3813/7633] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:00.143474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.155144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096be2ec-3e47-4cf1-b70e-7fefb388a566 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.161257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.162203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.162465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.162911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.163616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:00.164159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.165953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.180987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3821/7634] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:00.186185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.197241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d506-b52b-4a2a-a59b-ee08d96183b4 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.204235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.204978 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.205345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.205618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.206261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.208265 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.330406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.332846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.355919 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3814/7635] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:00 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:00.358574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.371937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.412110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f76bc-99c1-4279-be51-56c0438e62ee admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.441755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d290a-bb64-40eb-b414-54dec41a653e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.446979 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.447636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.447921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.448324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] PATH_INFO: `/v3/projects/5d5e299bab0a41ddbcda658446e0fd13` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.449591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5e299bab0a41ddbcda658446e0fd13)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.451560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.469924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.470702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.470980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.471283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.473619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.561410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.562933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.573401 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3822/7636] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:00.576639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.585307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8373f8-91d2-4ee6-ba04-b47099313cb6 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.591898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.592521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.592801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.593077 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.593722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.595690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.631561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5e299bab0a41ddbcda658446e0fd13', 'request_id': 'req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:00.638030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5e299bab0a41ddbcda658446e0fd13', 'request_id': 'req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:00.646649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5e299bab0a41ddbcda658446e0fd13', 'request_id': 'req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:00.761666 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3823/7637] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:00 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:00.764410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.776406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7daab1-d891-464d-b9ec-48592bf98574 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.830031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] The token cache is being invalidate because project 5d5e299bab0a41ddbcda658446e0fd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:00.830337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:00.831094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0ab5cc62-b62f-4a9d-bd15-dd0841df5bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:00.837072 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3815/7638] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:00 2022] DELETE /identity/v3/projects/5d5e299bab0a41ddbcda658446e0fd13 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:00.838825 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fd8bb-826e-4e47-8ead-a11b1d8e7637 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.839199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fd8bb-826e-4e47-8ead-a11b1d8e7637 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.839477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fd8bb-826e-4e47-8ead-a11b1d8e7637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.843166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.846445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.846445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.846445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.846445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.847082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.861045 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3824/7639] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:00.866124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.866350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-889fd8bb-826e-4e47-8ead-a11b1d8e7637 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:00.867799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-889fd8bb-826e-4e47-8ead-a11b1d8e7637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.868662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.887360 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3816/7640] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:00.887977 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720169fb-afd8-4269-9618-f9f39bfc0871 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.890680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.891156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.891626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.898345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.899018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.899307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.899673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.900422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.902274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.916900 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3825/7641] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:00.917125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:00.920692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:00.922505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.928331 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3817/7642] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:00.933424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1683a9-c910-40ff-88c8-cbc631d2f81c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.938846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652165-0eb6-4fc3-9918-7eaa680602aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.939551 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652165-0eb6-4fc3-9918-7eaa680602aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.939848 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652165-0eb6-4fc3-9918-7eaa680602aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.940125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652165-0eb6-4fc3-9918-7eaa680602aa admin admin] PATH_INFO: `/v3/projects/69dec9c6b5784e24816acab6c0ebf7b9/users/1e74e54536fe4be08046c6c9dd90abc0/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.941964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.952861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4914bb5-8fdc-457f-b762-9f44984dfec8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:00.960121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652165-0eb6-4fc3-9918-7eaa680602aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dec9c6b5784e24816acab6c0ebf7b9, user_id=1e74e54536fe4be08046c6c9dd90abc0, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.960749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:00.961902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:00.961902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:00.962497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:00.963237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:00.963693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:00.964053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652165-0eb6-4fc3-9918-7eaa680602aa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.965558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:00.980322 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3818/7643] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:00.985089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:00.996417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415eba6-50a2-4da8-a39e-46deff5b0fb6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.001338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.001989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.002276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.002554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.003199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.005145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.118038 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3826/7644] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:00 2022] PUT /identity/v3/projects/69dec9c6b5784e24816acab6c0ebf7b9/users/1e74e54536fe4be08046c6c9dd90abc0/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:01.123465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.124047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.124337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.160729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] MFA Rules not processed for user `1e74e54536fe4be08046c6c9dd90abc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:01.162060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:01.173905 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3819/7645] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:00 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:01.177019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.252781 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3827/7646] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:01.259636 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.263017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd308-4ad6-4f5d-b5a8-7c3cc22917bd admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.272316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.277706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.277706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.277706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.277706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.278588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.350232 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a7691-39dd-49d8-bba3-652d1a5325b4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.391068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.391068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.391068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.391068 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.392253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.392253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.464937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:01.475890 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3820/7647] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:01 2022] POST /identity/v3/users => generated 284 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:30:01.482005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.497126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ef434-3458-4230-861b-c0217e5c94c3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.502105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.502724 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.503008 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.503294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.504189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.506403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.525770 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3821/7648] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:01.530459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.550033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db33a-a893-4aed-a940-2330b3cae3e2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.560584 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3828/7649] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:01 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:30:01.561722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.644854 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5e269-ad04-454c-adae-6c53fca50efe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.651369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.652062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.652348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.652619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.653375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.655741 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.678892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.679486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.679747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.680044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.680709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.682559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.697676 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3822/7650] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:01.699862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.711183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679329d-58b8-47c6-bc3a-9e5bd101d93a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.717435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa3490-ffb8-4b4d-aa24-a848a79bd596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.718466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3490-ffb8-4b4d-aa24-a848a79bd596 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.718854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3490-ffb8-4b4d-aa24-a848a79bd596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.719279 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3490-ffb8-4b4d-aa24-a848a79bd596 admin admin] PATH_INFO: `/v3/projects/12a26db4f1264750ab2129be51710eca/users/1be8016d67a04a3db92f62ebb5c95702/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.736523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa3490-ffb8-4b4d-aa24-a848a79bd596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a26db4f1264750ab2129be51710eca, user_id=1be8016d67a04a3db92f62ebb5c95702, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.740065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa3490-ffb8-4b4d-aa24-a848a79bd596 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.788462 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3829/7651] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:01 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:01.793883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.805183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fc8ec-f86f-4325-a652-18d6d79bbfe1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.811532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.813919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.814213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.814485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.815201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.816916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:01.828363 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3830/7652] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:01.833883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:01.836608 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3823/7653] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:01 2022] PUT /identity/v3/projects/12a26db4f1264750ab2129be51710eca/users/1be8016d67a04a3db92f62ebb5c95702/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:01.849761 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82022da7-1bf0-4753-89b7-8d336bdbb61b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:01.850796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.851107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.851437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.902617 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] MFA Rules not processed for user `1be8016d67a04a3db92f62ebb5c95702`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:01.905043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:01.938459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:01.939175 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:01.939450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:01.939793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] PATH_INFO: `/v3/projects/3bd630ab4c5943739835d548ad252848/users/756b0bcbeeb84e969f7ec9628dc8ed5d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:01.961614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd630ab4c5943739835d548ad252848, user_id=756b0bcbeeb84e969f7ec9628dc8ed5d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:01.964685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.015271 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3824/7654] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:02.030117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.033814 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:02.097482 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6944c-05ea-4cde-954d-02c4c93a6b6d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:02.101925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:02.102559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.102829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.103261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.113421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:02.115684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.129810 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3825/7655] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:02.175655 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3831/7656] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:01 2022] PUT /identity/v3/projects/3bd630ab4c5943739835d548ad252848/users/756b0bcbeeb84e969f7ec9628dc8ed5d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:02.179772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.193492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4020f-3e12-4a0f-be28-4cdce6ae30ff service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:02.261045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c840e0-b179-4e58-b312-f1b6e0a00fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:02.262149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c840e0-b179-4e58-b312-f1b6e0a00fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.262149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c840e0-b179-4e58-b312-f1b6e0a00fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.262431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c840e0-b179-4e58-b312-f1b6e0a00fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.263062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c840e0-b179-4e58-b312-f1b6e0a00fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:02.264675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c840e0-b179-4e58-b312-f1b6e0a00fd6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.278880 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3826/7657] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:02.291549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.302724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6449f-3bfe-4506-9370-5b3864e382c5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:02.307786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:02.308530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.308882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.309230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] PATH_INFO: `/v3/projects/3bd630ab4c5943739835d548ad252848/users/756b0bcbeeb84e969f7ec9628dc8ed5d/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.311329 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd630ab4c5943739835d548ad252848, user_id=756b0bcbeeb84e969f7ec9628dc8ed5d, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:02.314135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.325928 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3832/7658] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:02 2022] PUT /identity/v3/projects/3bd630ab4c5943739835d548ad252848/users/756b0bcbeeb84e969f7ec9628dc8ed5d/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:02.339842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.340349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.340732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.379839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] MFA Rules not processed for user `756b0bcbeeb84e969f7ec9628dc8ed5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:02.380315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:02.486246 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3827/7659] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:02.491701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.505350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef8dc-d87b-4211-9967-06f2d2429b12 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:02.510780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756b0bcbeeb84e969f7ec9628dc8ed5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd630ab4c5943739835d548ad252848', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:02.511563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.511949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.512356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.513129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:02.513547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:02.515714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.533897 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3833/7660] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:02.536632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.546217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8589a-ab56-4f7d-8894-b013c4ad0e58 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:02.551454 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756b0bcbeeb84e969f7ec9628dc8ed5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd630ab4c5943739835d548ad252848', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:02.552078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.552364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.552649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.553329 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:02.555282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.717355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3828/7661] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:02 2022] POST /identity/v3/projects => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:02.721961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.745249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f2917-26a8-4030-9a9a-bb1a9cd5ef59 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:02.855359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756b0bcbeeb84e969f7ec9628dc8ed5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd630ab4c5943739835d548ad252848', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:02.855991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:02.856310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:02.856883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:02.857653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:02.858007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:02.859874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:02.875224 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3834/7662] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:02.896237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:02.902698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:02.970726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:03.048548 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d088fc6-4244-4bed-a419-f86cd55ca66d tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:03.057149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:03.058512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:03.059071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:03.059670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:03.075905 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:03.078081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:03.096261 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3829/7663] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:03.968128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:04.725112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:06.155540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:06.851509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:07.547936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:07.567632 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499974de-004d-429a-a2be-0644a71aa9d8 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:07.573359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756b0bcbeeb84e969f7ec9628dc8ed5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd630ab4c5943739835d548ad252848', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:07.573920 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:07.574224 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:07.574491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] PATH_INFO: `/v3/projects/0af08eea9dab4f60a0943512f558d7a3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:07.575710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0af08eea9dab4f60a0943512f558d7a3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:07.577827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:07.712397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af08eea9dab4f60a0943512f558d7a3', 'request_id': 'req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:07.721571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af08eea9dab4f60a0943512f558d7a3', 'request_id': 'req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:07.729553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af08eea9dab4f60a0943512f558d7a3', 'request_id': 'req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:07.741401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:07.854696 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] The token cache is being invalidate because project 0af08eea9dab4f60a0943512f558d7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:07.855293 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:07.856211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-bfb826ae-451c-4b35-a3e6-5f1d13cc2cd9 tempest-QuotasNegativeTest-2103910127 tempest-QuotasNegativeTest-2103910127-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:07.859312 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3835/7664] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:07 2022] DELETE /identity/v3/projects/0af08eea9dab4f60a0943512f558d7a3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:07.863422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:07.937263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc275e5-5f21-4ade-8465-291db103ff89 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:08.030972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:08.031622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:08.031907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:08.032185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] PATH_INFO: `/v3/users/1e74e54536fe4be08046c6c9dd90abc0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:08.033471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e74e54536fe4be08046c6c9dd90abc0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:08.035521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:08.227832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e74e54536fe4be08046c6c9dd90abc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:08.228544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e74e54536fe4be08046c6c9dd90abc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:08.304045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e74e54536fe4be08046c6c9dd90abc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:08.313886 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e74e54536fe4be08046c6c9dd90abc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:08.315130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e74e54536fe4be08046c6c9dd90abc0'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:08.336663 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3830/7665] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:07 2022] DELETE /identity/v3/users/1e74e54536fe4be08046c6c9dd90abc0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:08.341209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:08.341493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:08.342038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:08.364604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:08.366117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:08.460547 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3836/7666] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:08.472270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:08.473947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:08.537435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:08.559681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea8da8-7d34-4f4a-8e80-3f7786571710 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:08.563952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:08.564676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:08.564876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:08.565187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:08.576028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:08.577830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:08.589355 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3831/7667] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:08.774769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:09.185783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:09.187897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:09.201979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b17c3-99da-4fb1-b702-1b347ceb0de4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:09.209208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:09.210416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:09.210946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:09.211433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] PATH_INFO: `/v3/projects/69dec9c6b5784e24816acab6c0ebf7b9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:09.212869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dec9c6b5784e24816acab6c0ebf7b9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:09.214944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:09.328555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dec9c6b5784e24816acab6c0ebf7b9', 'request_id': 'req-490c7fb4-6c62-43ee-9338-8b6e03323649'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:09.336271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dec9c6b5784e24816acab6c0ebf7b9', 'request_id': 'req-490c7fb4-6c62-43ee-9338-8b6e03323649'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:09.344088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dec9c6b5784e24816acab6c0ebf7b9', 'request_id': 'req-490c7fb4-6c62-43ee-9338-8b6e03323649'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:09.476577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] The token cache is being invalidate because project 69dec9c6b5784e24816acab6c0ebf7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:09.476809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:09.477490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:09.479106 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3837/7668] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:09 2022] DELETE /identity/v3/projects/69dec9c6b5784e24816acab6c0ebf7b9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:09.483371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:09.504622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d77f-dae2-4704-ab22-a7747322218b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:09.629379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:09.630385 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:09.630862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:09.631527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] PATH_INFO: `/v3/users/756b0bcbeeb84e969f7ec9628dc8ed5d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:09.635076 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=756b0bcbeeb84e969f7ec9628dc8ed5d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:09.650527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:09.672889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:09.941140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756b0bcbeeb84e969f7ec9628dc8ed5d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:09.944421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756b0bcbeeb84e969f7ec9628dc8ed5d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:10.083712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:10.134244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756b0bcbeeb84e969f7ec9628dc8ed5d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:10.143373 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756b0bcbeeb84e969f7ec9628dc8ed5d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:10.144604 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d0b46852-961a-43ee-8638-0cefc901bfcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756b0bcbeeb84e969f7ec9628dc8ed5d'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:10.166960 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3832/7669] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:09 2022] DELETE /identity/v3/users/756b0bcbeeb84e969f7ec9628dc8ed5d => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:11.014364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:11.172022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:11.173680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:11.191107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7fb4-6c62-43ee-9338-8b6e03323649 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:11.256754 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:11.266262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:11.266644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:11.266921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] PATH_INFO: `/v3/projects/3bd630ab4c5943739835d548ad252848` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:11.268372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd630ab4c5943739835d548ad252848)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:11.271045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:11.420772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd630ab4c5943739835d548ad252848', 'request_id': 'req-cef2bcb8-9565-4895-9fa0-f1449a931261'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:11.429395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd630ab4c5943739835d548ad252848', 'request_id': 'req-cef2bcb8-9565-4895-9fa0-f1449a931261'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:11.441947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd630ab4c5943739835d548ad252848', 'request_id': 'req-cef2bcb8-9565-4895-9fa0-f1449a931261'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:11.530322 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] The token cache is being invalidate because project 3bd630ab4c5943739835d548ad252848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:11.530694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:11.531504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cef2bcb8-9565-4895-9fa0-f1449a931261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:11.533142 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3838/7670] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:11 2022] DELETE /identity/v3/projects/3bd630ab4c5943739835d548ad252848 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:11.539425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:11.540370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:11.540776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:11.571144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:11.572437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:11.649553 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3833/7671] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:11.657452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:11.657751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:11.658062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:11.683282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:11.685777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:11.717517 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3839/7672] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:11.721924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:11.732822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb6d36-e42a-4a0e-b408-40e110d78561 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:11.738826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:11.739695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:11.739971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:11.740432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:11.741111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:11.741492 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:11.743338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:11.757910 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3834/7673] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:11.770582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:11.781629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3f3d-2564-4d11-afb8-429530dc277d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:11.788000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:11.788709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:11.789056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:11.789583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:11.790470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:11.792832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:11.925916 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3840/7674] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:11 2022] POST /identity/v3/projects => generated 407 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:11.929575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:11.947770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a0b87-aec3-4fb1-8183-2318bce3ed9a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.048492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:12.062673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.063593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.064034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.064511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.065618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.069636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.183169 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3835/7675] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:11 2022] POST /identity/v3/users => generated 304 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:12.192120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.199299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35883f-12d2-4a6a-9168-bb3408ac3069 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.204161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.204751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.205032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.205304 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.206349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.207679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.221108 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3841/7676] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:12.225451 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.241807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86568-bcd5-4f6b-8938-6292d695b11a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.242165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fffb9-41cf-4437-8bc1-afb0c9f015e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.242646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fffb9-41cf-4437-8bc1-afb0c9f015e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.242933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fffb9-41cf-4437-8bc1-afb0c9f015e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.243218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fffb9-41cf-4437-8bc1-afb0c9f015e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.243834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fffb9-41cf-4437-8bc1-afb0c9f015e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.245470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fffb9-41cf-4437-8bc1-afb0c9f015e9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.258675 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3836/7677] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:12.262527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.273790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef898c-8f6d-4137-a445-0cbd552749f3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.279895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.280771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.281132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.281571 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] PATH_INFO: `/v3/projects/45919750987e4c5e8323e188071edf43/users/36eef006231c42f0a0b5254cf973a266/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.299355 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45919750987e4c5e8323e188071edf43, user_id=36eef006231c42f0a0b5254cf973a266, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.302779 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.414502 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3842/7678] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:12 2022] PUT /identity/v3/projects/45919750987e4c5e8323e188071edf43/users/36eef006231c42f0a0b5254cf973a266/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:12.424992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.425294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.425576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.456380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] MFA Rules not processed for user `36eef006231c42f0a0b5254cf973a266`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:12.457623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:12.523547 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3837/7679] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:12 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:12.528211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.595085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61aa05-8d8b-413a-927c-af1707450049 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.600480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.601134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.601414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.601688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.602396 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.604295 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.721594 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3843/7680] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:12 2022] POST /identity/v3/projects => generated 407 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:12.724276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.740384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59949c2-0360-4562-9caf-be136a7511c5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.791147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:12.804003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.804631 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.805013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.805292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.805959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.807899 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.899713 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3838/7681] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:12 2022] POST /identity/v3/users => generated 310 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:12.901038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.915724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b2f6-6984-4bf4-b68f-67f61ea81c89 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.919542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.920160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.920444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.920722 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.921435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.923159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:12.936699 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3844/7682] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:12.941534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:12.953477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0b89-1222-457f-b3b4-cd27fbada162 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:12.960294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:12.961067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:12.961419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:12.961764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] PATH_INFO: `/v3/projects/ae644d05cfe743c0a147fbda75e3a592/users/02ae5822fdda4553bd2cc5dbc970a8f3/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:12.983914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae644d05cfe743c0a147fbda75e3a592, user_id=02ae5822fdda4553bd2cc5dbc970a8f3, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:12.986821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:13.055053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3839/7683] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:12 2022] PUT /identity/v3/projects/ae644d05cfe743c0a147fbda75e3a592/users/02ae5822fdda4553bd2cc5dbc970a8f3/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:13.059790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:13.074826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a526-ecc5-40d5-83d7-da4e13a01032 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:13.152688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fff74-3168-4018-90ae-3c0af686b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:13.153462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fff74-3168-4018-90ae-3c0af686b94a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:13.153862 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fff74-3168-4018-90ae-3c0af686b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:13.154263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fff74-3168-4018-90ae-3c0af686b94a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:13.155079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fff74-3168-4018-90ae-3c0af686b94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:13.156817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fff74-3168-4018-90ae-3c0af686b94a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:13.174723 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3845/7684] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:13.179255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:13.192995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953e5bc-f852-468c-b48e-3b107e3a71da admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:13.201443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:13.202124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:13.204404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:13.204404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] PATH_INFO: `/v3/projects/ae644d05cfe743c0a147fbda75e3a592/users/02ae5822fdda4553bd2cc5dbc970a8f3/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:13.206555 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae644d05cfe743c0a147fbda75e3a592, user_id=02ae5822fdda4553bd2cc5dbc970a8f3, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:13.209630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:13.231487 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3840/7685] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:13 2022] PUT /identity/v3/projects/ae644d05cfe743c0a147fbda75e3a592/users/02ae5822fdda4553bd2cc5dbc970a8f3/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:13.236425 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:13.236984 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:13.237432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:13.289300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:13.290513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] MFA Rules not processed for user `02ae5822fdda4553bd2cc5dbc970a8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:13.292826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:13.378138 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3846/7686] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:13.390594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:13.392292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:13.485139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7e180-d04f-4e6a-9ba6-15687e6a51ae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:13.489507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:13.490510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:13.490695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:13.491619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:13.573361 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:13.574843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:13.584786 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3841/7687] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:13 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:14.203554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:14.323806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:14.325366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:14.430170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d8866-15b6-45d5-a327-9b1f3525ffe5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:14.436332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a609-5b81-405d-802f-67b979f9ec65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:14.437212 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a609-5b81-405d-802f-67b979f9ec65 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:14.438047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a609-5b81-405d-802f-67b979f9ec65 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:14.438047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a609-5b81-405d-802f-67b979f9ec65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:14.448403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a609-5b81-405d-802f-67b979f9ec65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:14.450088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a609-5b81-405d-802f-67b979f9ec65 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:14.466060 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3847/7688] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:14 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:14.904430 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:15.327615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:22.554521 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:22.556079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:22.660335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f510-7ab5-4f88-9277-8d05c2d4cd91 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:22.665923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:22.666758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:22.667364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:22.667759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] PATH_INFO: `/v3/users/1be8016d67a04a3db92f62ebb5c95702` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:22.669255 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be8016d67a04a3db92f62ebb5c95702)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:22.671405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:22.949651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be8016d67a04a3db92f62ebb5c95702'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:22.950364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be8016d67a04a3db92f62ebb5c95702'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:23.094171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be8016d67a04a3db92f62ebb5c95702'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:23.104121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be8016d67a04a3db92f62ebb5c95702'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:23.105095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be8016d67a04a3db92f62ebb5c95702'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:23.125952 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3842/7689] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:22 2022] DELETE /identity/v3/users/1be8016d67a04a3db92f62ebb5c95702 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:23.131674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:23.131674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:23.131674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:23.156069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:23.157298 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:23.272859 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3848/7690] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:23.281191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:23.283435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:23.420614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4060a7f-0435-4370-9605-19acc69f4d27 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:23.430228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:23.430928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:23.431666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:23.431666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:23.445125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:23.448342 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:23.472059 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3843/7691] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:23.797238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:23.798750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:23.820580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040264-9db2-47db-aef9-d459107abbb2 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:23.835461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:23.837098 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:23.838088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:23.839820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:23.840134 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] PATH_INFO: `/v3/projects/12a26db4f1264750ab2129be51710eca` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:23.842681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a26db4f1264750ab2129be51710eca)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:23.842980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:23.844593 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:23.880225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed1f3-9556-473b-abc2-024e8c4c3c71 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:23.885790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:23.886923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:23.887391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:23.887850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] PATH_INFO: `/v3/users/36eef006231c42f0a0b5254cf973a266` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:23.889289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eef006231c42f0a0b5254cf973a266)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:23.891258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:23.913535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:24.014725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a26db4f1264750ab2129be51710eca', 'request_id': 'req-da150c3f-7b1f-4311-a662-c46ccf478196'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.023264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a26db4f1264750ab2129be51710eca', 'request_id': 'req-da150c3f-7b1f-4311-a662-c46ccf478196'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.032635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a26db4f1264750ab2129be51710eca', 'request_id': 'req-da150c3f-7b1f-4311-a662-c46ccf478196'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.193407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] The token cache is being invalidate because project 12a26db4f1264750ab2129be51710eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:24.194182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.194726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-da150c3f-7b1f-4311-a662-c46ccf478196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.198034 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3849/7692] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:23 2022] DELETE /identity/v3/projects/12a26db4f1264750ab2129be51710eca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:24.202959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0de49-e7d1-4921-b90e-64af2820cd15 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.203574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0de49-e7d1-4921-b90e-64af2820cd15 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.204032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0de49-e7d1-4921-b90e-64af2820cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.216024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eef006231c42f0a0b5254cf973a266'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.219964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eef006231c42f0a0b5254cf973a266'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.232992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-36e0de49-e7d1-4921-b90e-64af2820cd15 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:24.234259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-36e0de49-e7d1-4921-b90e-64af2820cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:24.293700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eef006231c42f0a0b5254cf973a266'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.308207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eef006231c42f0a0b5254cf973a266'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.309467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-99bacfa3-8ede-44ec-b48c-28393ba636d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eef006231c42f0a0b5254cf973a266'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:24.327800 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3850/7693] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:24.336468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.336947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.337324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.347869 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3844/7694] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:23 2022] DELETE /identity/v3/users/36eef006231c42f0a0b5254cf973a266 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:24.351397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.351397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.351678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.370619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:24.372275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:24.378408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:24.380885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:24.412836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:24.521733 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3851/7695] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:24.526293 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3845/7696] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:24.526968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:24.537033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:24.538316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014c19-eb06-43b7-aad5-deb492711ecd None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:24.538764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:24.544210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:24.545008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.545417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.545801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.546686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:24.547104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:24.548946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:24.571599 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3852/7697] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:24.576124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:24.605530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3791b8-374f-4caf-ac23-b6ac50e1a3e9 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:24.616183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:24.623178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.623178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.623178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.623178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:24.623178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:24.649785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5754b-fe51-4147-ac1f-9f25ede9e2a3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:24.657633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:24.659551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.659835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.660110 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.674618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:24.677507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:24.702644 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3846/7698] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:24.730147 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3853/7699] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:24 2022] POST /identity/v3/projects => generated 359 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:30:24.733507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:24.745382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6454e-7903-49a5-952f-b0141a6eb25d service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:24.797786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:24.831782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:24.833241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.833898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.837277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.837277 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:24.838423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:24.923310 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3847/7700] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:24 2022] POST /identity/v3/users => generated 280 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:24.927554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:24.940192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623179-76a4-4be3-9c4b-c6d2390c9a0c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:24.946009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:24.946768 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.947173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.947538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.948307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:24.950112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:24.963306 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3854/7701] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:24.967415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:24.979920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8620ac-a780-4b9b-8c69-fa960142cb74 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:24.985397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:24.986669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:24.987268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:24.987795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:24.988550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:24.991694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:25.008487 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3848/7702] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:25.012546 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:25.029018 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54366dfa-b5dd-4980-aa18-4deb78fbc194 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:25.036132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4940374-9718-48e5-b48a-a7c28347eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:25.037026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940374-9718-48e5-b48a-a7c28347eea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:25.037320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940374-9718-48e5-b48a-a7c28347eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:25.037749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940374-9718-48e5-b48a-a7c28347eea3 admin admin] PATH_INFO: `/v3/projects/a78de7cbb2384804a42da1c2a3f224e5/users/8b1aa355b7e94f5392e13900490c2c13/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:25.058048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4940374-9718-48e5-b48a-a7c28347eea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78de7cbb2384804a42da1c2a3f224e5, user_id=8b1aa355b7e94f5392e13900490c2c13, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:25.063160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4940374-9718-48e5-b48a-a7c28347eea3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:25.122678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:25.126300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:25.165639 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3855/7703] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:25 2022] PUT /identity/v3/projects/a78de7cbb2384804a42da1c2a3f224e5/users/8b1aa355b7e94f5392e13900490c2c13/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:25.182725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94f070-1609-433d-928a-e7fbfcb0354a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:25.182843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:25.182843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:25.182843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:25.240085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] MFA Rules not processed for user `8b1aa355b7e94f5392e13900490c2c13`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:25.242049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:25.289490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:25.290877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:25.291351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:25.292128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] PATH_INFO: `/v3/projects/45919750987e4c5e8323e188071edf43` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:25.293888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45919750987e4c5e8323e188071edf43)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:25.299429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:25.388447 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3856/7704] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:25.424316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45919750987e4c5e8323e188071edf43', 'request_id': 'req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:25.427617 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:25.448220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45919750987e4c5e8323e188071edf43', 'request_id': 'req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:25.462092 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45919750987e4c5e8323e188071edf43', 'request_id': 'req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:25.512200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:25.527874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f13a-0b58-46fe-9ede-11283aa00e85 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:25.575286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] The token cache is being invalidate because project 45919750987e4c5e8323e188071edf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:25.575806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:25.577696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:25.580496 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3849/7705] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:25 2022] DELETE /identity/v3/projects/45919750987e4c5e8323e188071edf43 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:25.584883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:25.590407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:25.623871 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:25.624782 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:25.625258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:25.625724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:25.628812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:25.720857 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:25.723790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:25.749268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:25.768542 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3857/7706] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:25.800132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609ca4b-92c4-4dc3-90fe-e1da7bcb2291 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:25.807287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:25.808171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:25.808547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:25.808875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] PATH_INFO: `/v3/users/02ae5822fdda4553bd2cc5dbc970a8f3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:25.810677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ae5822fdda4553bd2cc5dbc970a8f3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:25.816835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:26.104711 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ae5822fdda4553bd2cc5dbc970a8f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:26.105968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ae5822fdda4553bd2cc5dbc970a8f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:26.255304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ae5822fdda4553bd2cc5dbc970a8f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:26.272145 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ae5822fdda4553bd2cc5dbc970a8f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:26.273669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d1bea33b-e545-492e-9e9b-fde0ba34e927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ae5822fdda4553bd2cc5dbc970a8f3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:26.318843 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3850/7707] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:25 2022] DELETE /identity/v3/users/02ae5822fdda4553bd2cc5dbc970a8f3 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:26.744297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:26.764488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5b6e0-573d-438a-949a-246a6440c529 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:26.935384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:26.935819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:26.936165 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:26.936534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] PATH_INFO: `/v3/projects/ae644d05cfe743c0a147fbda75e3a592` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:26.938769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae644d05cfe743c0a147fbda75e3a592)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:26.940757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:27.138056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae644d05cfe743c0a147fbda75e3a592', 'request_id': 'req-4f7e8189-c2a5-44a1-9475-2720fef33938'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:27.143024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:27.146205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae644d05cfe743c0a147fbda75e3a592', 'request_id': 'req-4f7e8189-c2a5-44a1-9475-2720fef33938'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:27.154994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae644d05cfe743c0a147fbda75e3a592', 'request_id': 'req-4f7e8189-c2a5-44a1-9475-2720fef33938'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:27.266300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] The token cache is being invalidate because project ae644d05cfe743c0a147fbda75e3a592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:27.266619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:27.270161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4f7e8189-c2a5-44a1-9475-2720fef33938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:27.272335 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3858/7708] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:26 2022] DELETE /identity/v3/projects/ae644d05cfe743c0a147fbda75e3a592 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:27.277633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:27.278505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:27.278505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:27.305386 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:27.307051 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:27.438111 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3851/7709] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:27.451450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:27.452070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:27.452408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:27.478056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:27.479605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:27.489975 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3859/7710] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:27.494531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:27.506463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb74bd0-bdf5-46be-a0c1-5e643ca8bded None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:27.511972 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:27.512619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:27.512994 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:27.513282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:27.514205 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:27.514524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:27.516544 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:27.534310 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3852/7711] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:27.541051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:27.553140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072ea91-7ddf-450c-9440-56ca9bf0b909 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:27.581282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:27.581282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:27.581282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:27.581282 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:27.582253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:27.586933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:27.724067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3860/7712] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:27 2022] POST /identity/v3/projects => generated 391 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:27.729764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:27.764457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad3efd-66a8-4ce4-8d13-d65fe440c67d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:27.925122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:27.944063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:27.945106 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:27.945605 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:27.946120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:27.948368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:27.953619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:28.068990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3853/7713] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:27 2022] POST /identity/v3/users => generated 296 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:30:28.070284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:28.081841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a52421-8b1a-43c3-a590-ffffc85e7120 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:28.088520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:28.089475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:28.090481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:28.090481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:28.091479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:28.093440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:28.107052 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3861/7714] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:28.111377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:28.132953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453c92-81c7-411b-b8dc-309ab78c6a67 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:28.139194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d8ada-f712-4eb3-9245-8e00b8f2f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:28.141991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8ada-f712-4eb3-9245-8e00b8f2f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:28.141991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8ada-f712-4eb3-9245-8e00b8f2f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:28.141991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8ada-f712-4eb3-9245-8e00b8f2f8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:28.141991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d8ada-f712-4eb3-9245-8e00b8f2f8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:28.144165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d8ada-f712-4eb3-9245-8e00b8f2f8e8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:28.166098 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3854/7715] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:28.167922 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:28.181333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f2e8-3a8d-4af7-aa86-dc7fc80a7b23 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:28.187429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:28.188445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:28.188926 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:28.189513 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] PATH_INFO: `/v3/projects/8a973a57bbbe44599b804044f4ac83ea/users/8ae699f25833425397f9f59f6d1a5e9e/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:28.209908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a973a57bbbe44599b804044f4ac83ea, user_id=8ae699f25833425397f9f59f6d1a5e9e, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:28.213468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:28.323844 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3862/7716] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:28 2022] PUT /identity/v3/projects/8a973a57bbbe44599b804044f4ac83ea/users/8ae699f25833425397f9f59f6d1a5e9e/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:28.335291 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:28.336162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:28.336162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:28.371554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] MFA Rules not processed for user `8ae699f25833425397f9f59f6d1a5e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:28.372999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:28.502003 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3855/7717] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:28.507463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:28.623706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788c010-529c-41b8-9319-d72f6405a833 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:28.637932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:28.637932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:28.637932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:28.637932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:28.638403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:28.640405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:28.793603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:28.801128 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3863/7718] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:28 2022] POST /identity/v3/projects => generated 393 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:28.814251 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fbe21-3dc4-42a7-8ff3-161bb35bd215 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:28.941527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:28.942553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:28.943248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:28.943672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:28.944586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:28.956522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:29.192830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:29.205121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3856/7719] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:28 2022] POST /identity/v3/users => generated 303 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:30:29.211372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1a80-50ce-4395-89a6-f59e9c075198 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:29.217786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:29.218787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:29.219149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:29.219491 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:29.220510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:29.222809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:29.242067 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3864/7720] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:29.243936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:29.256120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8eda-e9ad-4849-8a15-65b8b500306d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:29.261463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:29.262413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:29.262697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:29.263284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] PATH_INFO: `/v3/projects/2d16f8ac70c041938056a30b71fd7d73/users/dd4acee93b5f4f809354e4339e02937f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:29.282877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d16f8ac70c041938056a30b71fd7d73, user_id=dd4acee93b5f4f809354e4339e02937f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:29.286505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:29.390489 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3857/7721] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:29 2022] PUT /identity/v3/projects/2d16f8ac70c041938056a30b71fd7d73/users/dd4acee93b5f4f809354e4339e02937f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:29.395940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:29.441083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f734c-eef0-4eca-9baf-502a25569df4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:29.584453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:29.587213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788a4c1-af25-4b34-a386-52dee6e84252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:29.587890 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788a4c1-af25-4b34-a386-52dee6e84252 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:29.588248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788a4c1-af25-4b34-a386-52dee6e84252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:29.588582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788a4c1-af25-4b34-a386-52dee6e84252 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:29.589321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788a4c1-af25-4b34-a386-52dee6e84252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:29.591176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788a4c1-af25-4b34-a386-52dee6e84252 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:29.605570 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3865/7722] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:29.609895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:29.637075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146db6-869a-46ad-bd32-0348d1a26183 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:29.684278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:29.686845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:29.687965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:29.688467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] PATH_INFO: `/v3/projects/2d16f8ac70c041938056a30b71fd7d73/users/dd4acee93b5f4f809354e4339e02937f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:29.696849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d16f8ac70c041938056a30b71fd7d73, user_id=dd4acee93b5f4f809354e4339e02937f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:29.702432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:29.744364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:29.746320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:29.746320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:29.752427 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3858/7723] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:29 2022] PUT /identity/v3/projects/2d16f8ac70c041938056a30b71fd7d73/users/dd4acee93b5f4f809354e4339e02937f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:29.818819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] MFA Rules not processed for user `dd4acee93b5f4f809354e4339e02937f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:29.820397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:29.967375 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3866/7724] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:29.980867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:29.983625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:30.025073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:30.135148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4ffcd-9c78-4545-9a26-b0e617a76708 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:30.149432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf920-05eb-4d58-87c4-57cc052b31fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:30.150122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf920-05eb-4d58-87c4-57cc052b31fe service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:30.150415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf920-05eb-4d58-87c4-57cc052b31fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:30.150695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf920-05eb-4d58-87c4-57cc052b31fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:30.173889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf920-05eb-4d58-87c4-57cc052b31fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:30.174993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf920-05eb-4d58-87c4-57cc052b31fe service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:30.203258 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3859/7725] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:36.705670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:36.862583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a737-5408-426a-925d-a6d4a3e68b6a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:36.884198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:36.885361 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:36.885728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:36.886129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] PATH_INFO: `/v3/users/8ae699f25833425397f9f59f6d1a5e9e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:36.887996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae699f25833425397f9f59f6d1a5e9e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:36.890776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:37.142321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae699f25833425397f9f59f6d1a5e9e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:37.162543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae699f25833425397f9f59f6d1a5e9e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:37.173681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae699f25833425397f9f59f6d1a5e9e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:37.174490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae699f25833425397f9f59f6d1a5e9e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:37.178100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae699f25833425397f9f59f6d1a5e9e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:37.181469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:37.279538 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3867/7726] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:36 2022] DELETE /identity/v3/users/8ae699f25833425397f9f59f6d1a5e9e => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:37.284755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:37.288884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:37.289838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:37.316768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:37.318397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:37.419463 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3860/7727] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:37.442518 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:37.444647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:37.586664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62c5c-4a35-43a2-a684-8c8c65383782 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:37.601732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:37.602675 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:37.602951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:37.603229 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:37.633359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:37.635841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:37.666598 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3868/7728] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:38.983274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:38.986851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:39.008190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a2ad-f5d1-4aa8-903f-bb54229a6f10 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:39.028778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:39.030066 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:39.030646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:39.031218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] PATH_INFO: `/v3/users/f34ef02913674b04b2822574c2c478f9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:39.032742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34ef02913674b04b2822574c2c478f9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:39.036156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:39.323107 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34ef02913674b04b2822574c2c478f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.323829 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34ef02913674b04b2822574c2c478f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.365993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:39.379260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8816ee-4a87-4a0c-b39b-ccb0d99d187d service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:39.386989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:39.391592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34ef02913674b04b2822574c2c478f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.391991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:39.402684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:39.402684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:39.402684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:39.413219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34ef02913674b04b2822574c2c478f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.415816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34ef02913674b04b2822574c2c478f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.462186 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3861/7729] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:38 2022] DELETE /identity/v3/users/f34ef02913674b04b2822574c2c478f9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:39.463211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:39.463564 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:39.467123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:39.482155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce327c-926e-4aed-852d-81c33b63ca89 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:39.531212 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3869/7730] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:39.536445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:39.538231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:39.539277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:39.553472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:39.598023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:39.599627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:39.622857 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3870/7731] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:39.625304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc6bbb-3d8a-4381-bb17-7e0a744104ab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:39.632928 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:39.643437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:39.643437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:39.643437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] PATH_INFO: `/v3/projects/8a973a57bbbe44599b804044f4ac83ea` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:39.643437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a973a57bbbe44599b804044f4ac83ea)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:39.643437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:39.644774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:39.646374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:39.762895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee576a-09ef-41a5-a48b-38e58994f03d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:39.769070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:39.770325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:39.770607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:39.770882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:39.803695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:39.805949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:39.830534 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3871/7732] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:39.842964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a973a57bbbe44599b804044f4ac83ea', 'request_id': 'req-e5944833-f055-4407-9730-8fd22b5658c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.851766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a973a57bbbe44599b804044f4ac83ea', 'request_id': 'req-e5944833-f055-4407-9730-8fd22b5658c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.861276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a973a57bbbe44599b804044f4ac83ea', 'request_id': 'req-e5944833-f055-4407-9730-8fd22b5658c4'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.987673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] The token cache is being invalidate because project 8a973a57bbbe44599b804044f4ac83ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:39.989085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.989530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:39.991595 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3862/7733] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:39 2022] DELETE /identity/v3/projects/8a973a57bbbe44599b804044f4ac83ea => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:39.996543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:40.008148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025242-7f71-474f-a9bf-5f5a1c66c991 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:40.121099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:40.122397 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:40.122685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:40.123114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] PATH_INFO: `/v3/users/dd4acee93b5f4f809354e4339e02937f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:40.125287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4acee93b5f4f809354e4339e02937f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:40.127733 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:40.169807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:40.326864 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:40.328468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:40.374494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944833-f055-4407-9730-8fd22b5658c4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:40.403971 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:40.405324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:40.405607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:40.405904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] PATH_INFO: `/v3/projects/19747ba661ca427ea056cf5402e7450c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:40.407650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4acee93b5f4f809354e4339e02937f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.417190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19747ba661ca427ea056cf5402e7450c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:40.425874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:40.459404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4acee93b5f4f809354e4339e02937f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.486827 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4acee93b5f4f809354e4339e02937f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.490669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4acee93b5f4f809354e4339e02937f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.492136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4acee93b5f4f809354e4339e02937f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.598732 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3872/7734] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:39 2022] DELETE /identity/v3/users/dd4acee93b5f4f809354e4339e02937f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:40.640774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19747ba661ca427ea056cf5402e7450c', 'request_id': 'req-d462212a-9a5d-4484-b228-785de5bc9326'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.660672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19747ba661ca427ea056cf5402e7450c', 'request_id': 'req-d462212a-9a5d-4484-b228-785de5bc9326'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.677367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19747ba661ca427ea056cf5402e7450c', 'request_id': 'req-d462212a-9a5d-4484-b228-785de5bc9326'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.779927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] The token cache is being invalidate because project 19747ba661ca427ea056cf5402e7450c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:40.780491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.781419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:40.788624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:40.789710 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3863/7735] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:40 2022] DELETE /identity/v3/projects/19747ba661ca427ea056cf5402e7450c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:40.791059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:40.963075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54f161-12f0-4a00-9254-43b69b39497a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:40.979891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:40.980562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:40.981268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:40.981268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] PATH_INFO: `/v3/users/bf15db78388644c1888ce853c4032635` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.017177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf15db78388644c1888ce853c4032635)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:41.019891 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:41.038797 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:41.040619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:41.120274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:41.187903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462212a-9a5d-4484-b228-785de5bc9326 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:41.224956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:41.226155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:41.226155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:41.226435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] PATH_INFO: `/v3/projects/2d16f8ac70c041938056a30b71fd7d73` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.227682 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d16f8ac70c041938056a30b71fd7d73)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:41.230084 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:41.289249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf15db78388644c1888ce853c4032635'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.308012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf15db78388644c1888ce853c4032635'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.318416 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf15db78388644c1888ce853c4032635'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.319210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf15db78388644c1888ce853c4032635'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.319901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf15db78388644c1888ce853c4032635'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.458445 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3873/7736] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:40 2022] DELETE /identity/v3/users/bf15db78388644c1888ce853c4032635 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:41.459592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:41.471767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:41.472464 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d16f8ac70c041938056a30b71fd7d73', 'request_id': 'req-e670389b-80ba-40c5-8647-10b839e09029'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.493183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d16f8ac70c041938056a30b71fd7d73', 'request_id': 'req-e670389b-80ba-40c5-8647-10b839e09029'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.508975 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d16f8ac70c041938056a30b71fd7d73', 'request_id': 'req-e670389b-80ba-40c5-8647-10b839e09029'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.514910 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:41.600069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] The token cache is being invalidate because project 2d16f8ac70c041938056a30b71fd7d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:41.600069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.601143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e670389b-80ba-40c5-8647-10b839e09029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.610269 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3864/7737] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:41 2022] DELETE /identity/v3/projects/2d16f8ac70c041938056a30b71fd7d73 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:41.612074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fce36e-558e-48f9-81e8-5f2ce7373ca0 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:41.612362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fce36e-558e-48f9-81e8-5f2ce7373ca0 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:41.612642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fce36e-558e-48f9-81e8-5f2ce7373ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.640577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-47fce36e-558e-48f9-81e8-5f2ce7373ca0 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:41.640577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-47fce36e-558e-48f9-81e8-5f2ce7373ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:41.676482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32ae7-6fa4-461e-b3e3-0cbbd3eb621f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:41.683199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:41.686953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:41.686953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:41.686953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] PATH_INFO: `/v3/users/cdf6b4ecef824696bc39abf6ce08e205` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.687381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf6b4ecef824696bc39abf6ce08e205)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:41.690063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:41.745897 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3865/7738] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:41.751111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:41.751474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:41.751819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.781189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:41.782570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:41.794250 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3866/7739] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:41.799427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:41.815260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c45f-8182-40ad-a5b3-0d89de9e77de None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:41.822578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:41.823860 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:41.824044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:41.824340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.825000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:41.825305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:41.829208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:41.862244 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3867/7740] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:30:41.863807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:41.866308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:41.893933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ea0c9-8554-48db-8c58-a85ad157f38d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:41.904080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:41.904846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:41.905200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:41.905589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] PATH_INFO: `/v3/projects/8f626f7d7d214deb95c600f193e75b12` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:41.934648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf6b4ecef824696bc39abf6ce08e205'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.938152 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f626f7d7d214deb95c600f193e75b12)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:41.944125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:41.956253 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf6b4ecef824696bc39abf6ce08e205'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.966809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf6b4ecef824696bc39abf6ce08e205'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.967658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf6b4ecef824696bc39abf6ce08e205'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:41.968661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf6b4ecef824696bc39abf6ce08e205'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.102282 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3874/7741] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:41 2022] DELETE /identity/v3/users/cdf6b4ecef824696bc39abf6ce08e205 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:42.103426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.106462 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:42.117276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f626f7d7d214deb95c600f193e75b12', 'request_id': 'req-eb981d08-8a07-4af3-bd5a-921024c560e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.128806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f626f7d7d214deb95c600f193e75b12', 'request_id': 'req-eb981d08-8a07-4af3-bd5a-921024c560e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.136408 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f626f7d7d214deb95c600f193e75b12', 'request_id': 'req-eb981d08-8a07-4af3-bd5a-921024c560e2'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.227410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] The token cache is being invalidate because project 8f626f7d7d214deb95c600f193e75b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:42.228311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.229536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-eb981d08-8a07-4af3-bd5a-921024c560e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.232742 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3868/7742] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:41 2022] DELETE /identity/v3/projects/8f626f7d7d214deb95c600f193e75b12 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:42.237736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f909-c991-4d07-81ce-9ce6c9569f7c None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.238812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f909-c991-4d07-81ce-9ce6c9569f7c None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.239339 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f909-c991-4d07-81ce-9ce6c9569f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.246787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100487a1-8b2c-4861-8c3a-0c224f421109 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.255366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.256164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.261802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.261802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.261802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.261802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.268002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2fa6f909-c991-4d07-81ce-9ce6c9569f7c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:42.269841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2fa6f909-c991-4d07-81ce-9ce6c9569f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:42.279954 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3869/7743] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:42.301576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.301576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.301576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.324423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:42.329055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:42.340154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3870/7744] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:42.340154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.351663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464108d-58c3-4444-99a8-e6cffa1d3a7b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.359953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.360646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.361653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.361653 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.362383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:42.362786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.365646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.386190 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3871/7745] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:42.387183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.392569 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3875/7746] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:42 2022] POST /identity/v3/projects => generated 391 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:42.397374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.399263 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:42.403304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d339-d679-4224-b3cc-d36c82d0884f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.484547 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:42.498180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358b60-0e78-4dae-9d02-421d47f008fc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.501316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.502202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.502628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.502883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.503577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.506197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.506197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.506197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.506197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.507733 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.508093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.509217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.604431 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3876/7747] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:42 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:42.606151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.611659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:42.625903 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3872/7748] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:42.625903 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.631715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1c9b6-f09f-4a13-b09c-8db0b0432ba1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.709845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719918bd-7d75-4016-8d00-42bf3f0200eb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.715527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.716232 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.716577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.717041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.717725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.719745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.733189 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3873/7749] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:42.734362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.739174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.740033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.740311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.740594 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] PATH_INFO: `/v3/projects/a53d2813633c4dcab0210a81ff20f549` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.741892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53d2813633c4dcab0210a81ff20f549)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.744297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.748639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179c209-c28d-4607-9841-797cd1f4ce2b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.754659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:42.760527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.761442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.761726 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.762038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.762697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.764741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.862543 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3874/7750] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:42 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:42.863967 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.878670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f7b20-7532-4bae-9014-8a3fa9555289 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.886035 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:42.886832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:42.887240 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:42.887608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:42.888394 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:42.890676 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:42.909062 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3875/7751] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:42.910956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:42.924532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe14e70-d49e-4a40-93be-1259acb7e69c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:42.931949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53d2813633c4dcab0210a81ff20f549', 'request_id': 'req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.939403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53d2813633c4dcab0210a81ff20f549', 'request_id': 'req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.947149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53d2813633c4dcab0210a81ff20f549', 'request_id': 'req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:42.999800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.000670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.001019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.001368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.002125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:43.004445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:43.015716 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3876/7752] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:43.016795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:43.041113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15788-0779-4110-87f6-a4ef5fbd175c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:43.048168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.049669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.049669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.049669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] PATH_INFO: `/v3/projects/e802df29e2e04f66a5a55eb548798dd1/users/0be573dac55047928f1071516a6259ad/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.069484 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e802df29e2e04f66a5a55eb548798dd1, user_id=0be573dac55047928f1071516a6259ad, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:43.072261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:43.077049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] The token cache is being invalidate because project a53d2813633c4dcab0210a81ff20f549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:43.077567 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.078806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.082599 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3877/7753] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:42 2022] DELETE /identity/v3/projects/a53d2813633c4dcab0210a81ff20f549 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:43.082599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:43.085618 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:43.105875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470ef1-6ae1-4d36-8ed1-d0b97ade9e77 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:43.111673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.116825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.116825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.116825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.116825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:43.116825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:43.134008 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3878/7754] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:43.134008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:43.135793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:43.150256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37978e3d-1899-455b-a299-183da1cd49c1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:43.154870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.155505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.155781 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.157288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] PATH_INFO: `/v3/users/a43c48ccb84c497e9987eb4bc236e656` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.160759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43c48ccb84c497e9987eb4bc236e656)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:43.161381 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:43.215053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3877/7755] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:43 2022] PUT /identity/v3/projects/e802df29e2e04f66a5a55eb548798dd1/users/0be573dac55047928f1071516a6259ad/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:43.216871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:43.314499 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3689c0-4bd3-4dbf-8fde-582d6150e68a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:43.321343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec66ea-0766-445e-9934-dbf95e31f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.322490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec66ea-0766-445e-9934-dbf95e31f4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.326810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec66ea-0766-445e-9934-dbf95e31f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.327662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec66ea-0766-445e-9934-dbf95e31f4ee admin admin] PATH_INFO: `/v3/projects/1787e56fcd0b41a4901625e6f9ab80bb/users/90089aa2d5534cc8b1be4287f94b4d73/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.352592 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec66ea-0766-445e-9934-dbf95e31f4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1787e56fcd0b41a4901625e6f9ab80bb, user_id=90089aa2d5534cc8b1be4287f94b4d73, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:43.356010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec66ea-0766-445e-9934-dbf95e31f4ee admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:43.424418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43c48ccb84c497e9987eb4bc236e656'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.451354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43c48ccb84c497e9987eb4bc236e656'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.460292 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3878/7756] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:43 2022] PUT /identity/v3/projects/1787e56fcd0b41a4901625e6f9ab80bb/users/90089aa2d5534cc8b1be4287f94b4d73/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:43.466369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.466369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.466369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.466752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43c48ccb84c497e9987eb4bc236e656'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.466877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43c48ccb84c497e9987eb4bc236e656'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.467715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a08edc45-c0e6-42c3-a010-01924a4555cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43c48ccb84c497e9987eb4bc236e656'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:43.497575 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] MFA Rules not processed for user `0be573dac55047928f1071516a6259ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:43.499536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:43.584213 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3879/7757] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:43 2022] DELETE /identity/v3/users/a43c48ccb84c497e9987eb4bc236e656 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:43.584213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.584213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.584213 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.630118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:43.631305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:43.631534 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3879/7758] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:43.648175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:43.650288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:43.657507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:43.708020 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3880/7759] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:43.746878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:43.751183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:43.791404 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe95e22-cf3b-48f3-95e2-0195bf843be8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:43.805372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:43.865505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed29e1-3b9f-4664-8da7-cabcc61879ac None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:43.876507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.877651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.878245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.878859 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.908432 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:43.912428 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:43.935349 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:43.936419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:43.936921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:43.937668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:43.975597 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3881/7760] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:44.085263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:44.089337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:44.111121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3880/7761] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:44.151832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:44.152068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:44.153485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:44.154519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:44.176790 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419977-457c-4ec3-b047-dab8ce0cf94f service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:44.177937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41dcda-8527-44ed-a3a9-1296afb4cfd7 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:44.187005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:44.188097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:44.193012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:44.193012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] PATH_INFO: `/v3/users/0be573dac55047928f1071516a6259ad` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:44.193012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be573dac55047928f1071516a6259ad)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:44.195439 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:44.197275 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:44.198639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:44.199414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:44.199633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] PATH_INFO: `/v3/projects/091421ca3de74beb9a4fbaab2c89d7a2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:44.202370 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] RBAC: Authorizing `identity:delete_project(project_id=091421ca3de74beb9a4fbaab2c89d7a2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:44.207433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:44.501014 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be573dac55047928f1071516a6259ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.501766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be573dac55047928f1071516a6259ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.522992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091421ca3de74beb9a4fbaab2c89d7a2', 'request_id': 'req-8ca2c9c7-0284-4867-b1dc-9d740360265b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.556975 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091421ca3de74beb9a4fbaab2c89d7a2', 'request_id': 'req-8ca2c9c7-0284-4867-b1dc-9d740360265b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.570624 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091421ca3de74beb9a4fbaab2c89d7a2', 'request_id': 'req-8ca2c9c7-0284-4867-b1dc-9d740360265b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.739628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be573dac55047928f1071516a6259ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.753418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be573dac55047928f1071516a6259ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.755101 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-83a71d89-1f99-41cb-a249-3d12c3105b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be573dac55047928f1071516a6259ad'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.785306 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3881/7762] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:44 2022] DELETE /identity/v3/users/0be573dac55047928f1071516a6259ad => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:44.789410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:44.789982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:44.791919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:44.793435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:44.814674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:44.816671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:44.887034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] The token cache is being invalidate because project 091421ca3de74beb9a4fbaab2c89d7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:44.888511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.890669 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-8ca2c9c7-0284-4867-b1dc-9d740360265b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:44.899027 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3882/7763] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:44 2022] DELETE /identity/v3/projects/091421ca3de74beb9a4fbaab2c89d7a2 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:44.902009 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc469a3-f7a5-493a-82c0-0b970425a956 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:44.902677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc469a3-f7a5-493a-82c0-0b970425a956 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:44.904247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc469a3-f7a5-493a-82c0-0b970425a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:44.915117 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3882/7764] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:44.931744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:44.939213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:44.971101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4bc469a3-f7a5-493a-82c0-0b970425a956 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:44.973469 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4bc469a3-f7a5-493a-82c0-0b970425a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:44.982647 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3883/7765] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:44.984310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813a4a-0adc-457c-96a5-571f2485ace9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:44.984742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813a4a-0adc-457c-96a5-571f2485ace9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:44.985109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813a4a-0adc-457c-96a5-571f2485ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.008847 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-64813a4a-0adc-457c-96a5-571f2485ace9 None None] MFA Rules not processed for user `eab435220eb1424985b28ec0642ef70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:45.010746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-64813a4a-0adc-457c-96a5-571f2485ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:45.072118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd213-54ec-4c14-84a6-9c278d3fa3a9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.078331 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.079295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.079430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.079846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.093505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3884/7766] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:45.095202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.095664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.096091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.111789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:45.120292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:45.125934 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:45.128183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:45.141417 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3883/7767] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:45.146291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3885/7768] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:45.151105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:45.182815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62687f74-8188-491d-aebe-bc124c405ced service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.184786 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.185050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.185432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.185836 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.186773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:45.187065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:45.188809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:45.217066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:45.217626 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3884/7769] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:45.228751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e1da-7413-4d70-87a4-5ae695143e74 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.234708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.235690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.236070 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.236942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.238945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:45.241772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:45.294129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:45.387790 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3886/7770] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:45 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:45.394816 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:45.427826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13928b86-2d31-4b55-862b-2e49a55e2098 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.588094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.588094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.588094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.588094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.589635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:45.589635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:45.849053 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3885/7771] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:45 2022] POST /identity/v3/users => generated 281 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:45.850607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:45.867818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ba67-6785-401e-a5a3-19c6a7f70b43 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.874101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.874861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.875206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.875545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.876399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:45.878132 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:45.900908 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:45.908237 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3887/7772] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:45.919517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39074193-2ca9-433c-a86c-155a8461a179 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.928875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.930221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:45.931630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:45.932183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:45.933083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:45.934958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:45.973498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:45.985665 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3886/7773] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:45.991621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579354ff-4e5f-4ec8-9824-e315eaf0c0a7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:45.998032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5a1b-d8d4-4c39-8986-5f17c52bd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:45.999960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5a1b-d8d4-4c39-8986-5f17c52bd0d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:46.000545 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5a1b-d8d4-4c39-8986-5f17c52bd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:46.001013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5a1b-d8d4-4c39-8986-5f17c52bd0d0 admin admin] PATH_INFO: `/v3/projects/3eb7c9bee46e4bd091606fbf7133360d/users/a154dbb5442f42a5bbcc26545cb2b794/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:46.021426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:46.023145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5a1b-d8d4-4c39-8986-5f17c52bd0d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb7c9bee46e4bd091606fbf7133360d, user_id=a154dbb5442f42a5bbcc26545cb2b794, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:46.023659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:46.026505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5a1b-d8d4-4c39-8986-5f17c52bd0d0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:46.203861 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3888/7774] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:45 2022] PUT /identity/v3/projects/3eb7c9bee46e4bd091606fbf7133360d/users/a154dbb5442f42a5bbcc26545cb2b794/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:46.210185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:46.210753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:46.211208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:46.221088 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97161e9-6bcf-46af-8a16-d3b3211a68b6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:46.255399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:46.256664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:46.386598 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3889/7775] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:46.429102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:46.433093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:46.530112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:46.620227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3b393-de35-4f36-ab38-b62f90c011b9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:46.633019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:46.633659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:46.633967 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:46.634330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:46.656644 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:46.658168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:46.671189 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:46.671838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:46.672281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:46.672452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:46.675018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:46.689171 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3890/7776] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:46.712991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:46.714458 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88bcd-511c-4486-97c0-04f2dd31a075 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:46.733492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:46.764981 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:46.765314 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3887/7777] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:30:47.165609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:47.167960 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:47.206843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829a04-c298-423b-9d07-c48034a44ca1 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:47.228380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:47.234057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:47.234057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:47.234057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] PATH_INFO: `/v3/projects/e802df29e2e04f66a5a55eb548798dd1` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:47.234057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e802df29e2e04f66a5a55eb548798dd1)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:47.235211 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:47.445373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e802df29e2e04f66a5a55eb548798dd1', 'request_id': 'req-cb632784-27ee-43c5-8e41-59762c1b1980'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:47.465919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e802df29e2e04f66a5a55eb548798dd1', 'request_id': 'req-cb632784-27ee-43c5-8e41-59762c1b1980'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:47.482180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e802df29e2e04f66a5a55eb548798dd1', 'request_id': 'req-cb632784-27ee-43c5-8e41-59762c1b1980'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:47.649980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] The token cache is being invalidate because project e802df29e2e04f66a5a55eb548798dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:47.650548 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:47.653218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-cb632784-27ee-43c5-8e41-59762c1b1980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:47.658295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3891/7778] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:47 2022] DELETE /identity/v3/projects/e802df29e2e04f66a5a55eb548798dd1 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:30:47.665053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:47.665398 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:47.665988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:47.714813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:47.717750 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:47.804195 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3888/7779] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:47.812112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:47.812423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:47.812700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:47.836987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:47.838273 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:47.847527 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3892/7780] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:47.852747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:47.864422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a44ddb-a86c-489f-98d1-72aea9ac872d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:47.869746 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:47.870445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:47.870755 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:47.871025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:47.871739 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:47.872075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:47.874178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:47.888025 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3889/7781] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:47.892957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:47.903359 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634c42-6d17-4f4c-b719-d8058bf60fb6 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:47.908580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:47.909176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:47.909444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:47.910154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:47.910874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:47.912809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:48.465754 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3893/7782] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:47 2022] POST /identity/v3/projects => generated 381 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:48.469702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:48.479731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:48.496399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b631e-3699-4595-a701-9c470af910c2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:48.504040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:48.630768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:48.631486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:48.631813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:48.632213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:48.632991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:48.646328 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:48.646701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:48.701256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:48.717095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2e06-e69f-4bff-be08-f1195acc6b74 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:48.739210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:48.740154 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:48.741673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:48.741673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] PATH_INFO: `/v3/users/8b1aa355b7e94f5392e13900490c2c13` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:48.742802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1aa355b7e94f5392e13900490c2c13)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:48.745126 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:48.777440 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3890/7783] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:48 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:48.782080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:48.802635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447ccf-bfcb-4803-adc5-d315a739e9f3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:48.814885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:48.817843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:48.818603 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:48.819159 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:48.820671 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:48.823031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:48.855951 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3891/7784] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:48.860497 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:48.886165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ccd0-2ee2-4bf4-a1e7-7aa7bd8cdf8d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:48.899508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:48.901418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:48.903514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:48.904123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:48.908278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:48.911729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:48.946021 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3892/7785] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:48.953341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:48.964863 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533296d2-e2da-40c0-a143-d2e80f5e3b13 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:48.970371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f26c-ea2a-4f5c-9784-02e804f93ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:48.972281 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f26c-ea2a-4f5c-9784-02e804f93ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:48.972449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f26c-ea2a-4f5c-9784-02e804f93ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:48.972853 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f26c-ea2a-4f5c-9784-02e804f93ddd admin admin] PATH_INFO: `/v3/projects/948d5952c15c44a4b36dfc1009913a8a/users/60f31cb5dd8c492e9c4d19351d8256f9/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:48.994120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f26c-ea2a-4f5c-9784-02e804f93ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=948d5952c15c44a4b36dfc1009913a8a, user_id=60f31cb5dd8c492e9c4d19351d8256f9, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:48.995250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1aa355b7e94f5392e13900490c2c13'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:48.999872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f26c-ea2a-4f5c-9784-02e804f93ddd admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:49.024137 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1aa355b7e94f5392e13900490c2c13'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:49.035738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1aa355b7e94f5392e13900490c2c13'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:49.036687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1aa355b7e94f5392e13900490c2c13'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:49.038079 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-319dce63-1e4c-4257-8336-470f4d7a917a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1aa355b7e94f5392e13900490c2c13'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:49.128628 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3893/7786] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:48 2022] PUT /identity/v3/projects/948d5952c15c44a4b36dfc1009913a8a/users/60f31cb5dd8c492e9c4d19351d8256f9/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:49.141020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:49.142333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:49.143858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:49.161812 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3894/7787] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:30:48 2022] DELETE /identity/v3/users/8b1aa355b7e94f5392e13900490c2c13 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:49.163071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:49.163410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:49.163707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:49.181922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] MFA Rules not processed for user `60f31cb5dd8c492e9c4d19351d8256f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:49.183572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:49.187310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:49.188566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:49.286499 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3895/7788] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:49.292183 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:49.295595 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:49.325247 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3894/7789] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:49.338662 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:49.340462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:49.419496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e36a9-79c1-41b5-b0b3-4d27b5d7e2d9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:49.422266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:49.422909 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:49.423190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:49.423470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:49.443439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:49.445407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:49.476561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:49.480133 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3896/7790] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:49.481553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22d62-36a7-4128-8625-e489a106e23f None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:49.485999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a35cc-0a0f-438a-a5a8-0c00d4f1c8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:49.486625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a35cc-0a0f-438a-a5a8-0c00d4f1c8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:49.487003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a35cc-0a0f-438a-a5a8-0c00d4f1c8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:49.487321 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a35cc-0a0f-438a-a5a8-0c00d4f1c8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:49.500680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a35cc-0a0f-438a-a5a8-0c00d4f1c8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:49.502546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a35cc-0a0f-438a-a5a8-0c00d4f1c8f5 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:49.523566 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3895/7791] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:49.949814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:49.951365 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:49.990022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a4c5-1775-4af2-865e-69b72c8255b4 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:50.002415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:50.003184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:50.003509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:50.003786 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] PATH_INFO: `/v3/projects/a78de7cbb2384804a42da1c2a3f224e5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:50.005031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78de7cbb2384804a42da1c2a3f224e5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:50.007230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:50.076424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:50.273393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78de7cbb2384804a42da1c2a3f224e5', 'request_id': 'req-09eca74f-2090-4e8e-bb30-c7a44e0f3324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:50.284279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78de7cbb2384804a42da1c2a3f224e5', 'request_id': 'req-09eca74f-2090-4e8e-bb30-c7a44e0f3324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:50.295690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78de7cbb2384804a42da1c2a3f224e5', 'request_id': 'req-09eca74f-2090-4e8e-bb30-c7a44e0f3324'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:50.414930 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] The token cache is being invalidate because project a78de7cbb2384804a42da1c2a3f224e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:30:50.415375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:50.417906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-09eca74f-2090-4e8e-bb30-c7a44e0f3324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:30:50.423076 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3897/7792] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:30:49 2022] DELETE /identity/v3/projects/a78de7cbb2384804a42da1c2a3f224e5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:50.425285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:50.426133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:50.426664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:50.456344 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:50.458529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:50.614828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:50.615945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:50.616792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:50.636882 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3896/7793] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:50.667773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:50.669444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:50.687956 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3898/7794] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:30:50.691552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:50.705722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35643849-043c-43fe-a3e4-30383c94c27b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:50.727121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:50.730069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:50.730668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:50.731224 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:50.734759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:30:50.735438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:50.741712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:50.762612 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3897/7795] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:30:50.763478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:50.787421 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66b15-b750-4f6f-8b4a-272c46e1d2c1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:50.814903 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:50.815944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:50.816424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:50.817214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:50.818770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:50.821341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:51.033178 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3899/7796] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:50 2022] POST /identity/v3/projects => generated 405 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:30:51.037732 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:51.053141 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880da9-4594-4cc1-b749-cf0cbdd9ab75 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:51.186984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:51.187728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:51.188111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:51.188568 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:51.189337 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:51.191703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:51.344897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:51.351878 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3898/7797] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:51 2022] POST /identity/v3/users => generated 303 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:51.363550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2297da-22da-4e2e-a3f7-79eacc62e2ef admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:51.373538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:51.375900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:51.377096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:51.377666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:51.380373 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:51.384415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:51.414139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:51.430210 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3900/7798] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:51.433785 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89705f-e5ae-4d8b-928f-a55a09a30e68 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:51.449551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6c69-9014-498d-bd43-9588120eaa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:51.453734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6c69-9014-498d-bd43-9588120eaa45 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:51.454095 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6c69-9014-498d-bd43-9588120eaa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:51.454381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6c69-9014-498d-bd43-9588120eaa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:51.455078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e6c69-9014-498d-bd43-9588120eaa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:51.456868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e6c69-9014-498d-bd43-9588120eaa45 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:51.516986 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3899/7799] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:30:51.528998 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:51.544185 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13cd49-1616-42c7-b08d-7f09f0477ffe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:51.555119 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:51.556145 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:51.556599 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:51.558210 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] PATH_INFO: `/v3/projects/eade34be160642ea9722bf93ef959e8a/users/c45a24155a2b477981c49a6e2216f6a3/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:51.603648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eade34be160642ea9722bf93ef959e8a, user_id=c45a24155a2b477981c49a6e2216f6a3, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:51.606841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:51.676424 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3901/7800] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:51 2022] PUT /identity/v3/projects/eade34be160642ea9722bf93ef959e8a/users/c45a24155a2b477981c49a6e2216f6a3/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:51.682925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:51.683415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:51.686227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:51.717242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:51.721813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:51.734554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:51.905706 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3900/7801] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:51.955801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:51.964180 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:52.071055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65ef8-43c9-4960-b261-6b1caf309170 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:52.077265 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a04eb-7edd-499a-bced-c6722ca1b042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:52.078872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a04eb-7edd-499a-bced-c6722ca1b042 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:52.079389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a04eb-7edd-499a-bced-c6722ca1b042 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:52.079896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a04eb-7edd-499a-bced-c6722ca1b042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:52.096450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a04eb-7edd-499a-bced-c6722ca1b042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:52.098878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a04eb-7edd-499a-bced-c6722ca1b042 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:52.114593 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3902/7802] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:55.975585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:55.977815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:56.057467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2d79-e86c-4381-911e-0958679cffa6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:56.062810 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:56.072069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:56.072069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:56.072069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:56.072069 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:56.150191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:56.151651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:56.205622 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3901/7803] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:30:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:30:56.975596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:56.976151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:56.976277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:57.050647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] MFA Rules not processed for user `c45a24155a2b477981c49a6e2216f6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:30:57.059278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:30:57.148527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:57.269064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:57.269625 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3903/7804] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:30:57.289586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0dc5-b871-4ea2-9bfc-a8713456be44 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:57.318540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:57.319264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:57.322350 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:57.324370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:57.325231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:57.327919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:57.500063 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3902/7805] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:30:57 2022] POST /identity/v3/projects => generated 403 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:57.507305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:57.527197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3608e-6123-4335-b89e-af778c10d78c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:57.664955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:57.665973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:57.667162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:57.667627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:57.669417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:57.678557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:57.792660 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3904/7806] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:30:57 2022] POST /identity/v3/users => generated 308 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:30:57.797180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:57.834939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805449a-18b6-4cbd-b904-0dbc705326c1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:57.842654 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:57.843467 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:57.845738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:57.845738 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:57.846162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:57.848180 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:57.926259 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3903/7807] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:57.928745 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:57.963906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361463-bcfa-47d0-9e0d-e02a14694640 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:57.998936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:57.999633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:58.002942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:58.005084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] PATH_INFO: `/v3/projects/b15f0569d01e402db823bdc40bf158b2/users/7590920445a04f36b50ca598e4484b3a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:58.072879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15f0569d01e402db823bdc40bf158b2, user_id=7590920445a04f36b50ca598e4484b3a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:58.084738 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:58.251806 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3905/7808] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:57 2022] PUT /identity/v3/projects/b15f0569d01e402db823bdc40bf158b2/users/7590920445a04f36b50ca598e4484b3a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:30:58.258611 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:58.295231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf2ce1-bc34-43a1-ac72-d33ba5af972f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:58.319821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:30:58.462483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc3c6-94b9-4d46-b437-02c98e68b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:58.463919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc3c6-94b9-4d46-b437-02c98e68b96e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:58.464474 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc3c6-94b9-4d46-b437-02c98e68b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:58.464907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc3c6-94b9-4d46-b437-02c98e68b96e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:58.465675 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc3c6-94b9-4d46-b437-02c98e68b96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:58.467556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc3c6-94b9-4d46-b437-02c98e68b96e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:58.483954 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3904/7809] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:30:58.485040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:30:58.501056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaea5e-b662-4e90-8118-9ccccf4bcf56 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:30:58.508817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:30:58.510498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:30:58.511048 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:30:58.511601 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] PATH_INFO: `/v3/projects/b15f0569d01e402db823bdc40bf158b2/users/7590920445a04f36b50ca598e4484b3a/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:30:58.514303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15f0569d01e402db823bdc40bf158b2, user_id=7590920445a04f36b50ca598e4484b3a, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:30:58.518340 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:30:58.541333 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3906/7810] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:30:58 2022] PUT /identity/v3/projects/b15f0569d01e402db823bdc40bf158b2/users/7590920445a04f36b50ca598e4484b3a/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:00.531579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:00.532131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:00.532131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:00.598885 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] MFA Rules not processed for user `90089aa2d5534cc8b1be4287f94b4d73`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:00.600914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:00.790469 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3905/7811] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:00.797173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:00.800393 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:00.978791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00e29-f0e1-48e5-ab85-8f9b1239c917 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:00.990278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:00.998709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:01.000136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:01.000822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:01.002403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:01.006906 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:01.156690 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3907/7812] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:31:00 2022] POST /identity/v3/projects => generated 379 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:01.163731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:01.218324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c268fbe-38d8-4a64-bc58-a20d6b7395cf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:01.439326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:01.440157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:01.440714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:01.441074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:01.442144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:01.444661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:01.586651 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3906/7813] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:01 2022] POST /identity/v3/users => generated 296 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:01.591662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:01.603148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:01.609576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d8c1-8451-4286-9144-a9e102065480 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:01.625838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:01.626681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:01.627385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:01.627774 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:01.628881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:01.635375 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:01.686172 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3908/7814] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:01.695131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:01.709227 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8286e6c-1d72-4d3f-a663-1561b7fde9be admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:01.720907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:01.721595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:01.721968 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:01.722850 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] PATH_INFO: `/v3/projects/56c05ed801854c209463013f864b60b7/users/871e1d05a6a54118b6265b36487dcb07/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:01.760777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c05ed801854c209463013f864b60b7, user_id=871e1d05a6a54118b6265b36487dcb07, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:01.764369 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:01.901471 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3907/7815] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:01 2022] PUT /identity/v3/projects/56c05ed801854c209463013f864b60b7/users/871e1d05a6a54118b6265b36487dcb07/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:01.906731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:01.921780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df716ca-3b3a-44b3-8f0f-16ed02fcb976 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:02.135466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb2aff-37d6-4f51-936f-462040e0f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:02.136486 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2aff-37d6-4f51-936f-462040e0f6fb admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:02.137206 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2aff-37d6-4f51-936f-462040e0f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:02.140095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2aff-37d6-4f51-936f-462040e0f6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:02.141225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb2aff-37d6-4f51-936f-462040e0f6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:02.143413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb2aff-37d6-4f51-936f-462040e0f6fb admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:02.162031 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3909/7816] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:02.166765 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:02.184471 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053d4f4-a7da-42db-a14b-fadbec39bea2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:02.204747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dbcfd-07e7-491b-bc39-14049dbbfc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:02.206026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dbcfd-07e7-491b-bc39-14049dbbfc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:02.206026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dbcfd-07e7-491b-bc39-14049dbbfc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:02.207075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dbcfd-07e7-491b-bc39-14049dbbfc7a admin admin] PATH_INFO: `/v3/projects/56c05ed801854c209463013f864b60b7/users/871e1d05a6a54118b6265b36487dcb07/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:02.225100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dbcfd-07e7-491b-bc39-14049dbbfc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c05ed801854c209463013f864b60b7, user_id=871e1d05a6a54118b6265b36487dcb07, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:02.231315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dbcfd-07e7-491b-bc39-14049dbbfc7a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:02.248050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:02.285405 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3908/7817] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:02 2022] PUT /identity/v3/projects/56c05ed801854c209463013f864b60b7/users/871e1d05a6a54118b6265b36487dcb07/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:02.340723 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:02.341006 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:02.341285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:02.428969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] MFA Rules not processed for user `7590920445a04f36b50ca598e4484b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:02.434814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:02.679477 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3910/7818] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:02.856615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:02.856615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:02.856615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:02.914455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] MFA Rules not processed for user `a154dbb5442f42a5bbcc26545cb2b794`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:02.917749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:03.151540 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3909/7819] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:03.156684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:03.158243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:03.349596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c99e-6bcd-4282-bbd0-a9689777f6a9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:03.365364 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:03.366529 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:03.367321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:03.368736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:03.369668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:03.372872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:03.503922 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3911/7820] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:03 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:03.505573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:03.523009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4aaf-789f-4490-a5aa-589387215279 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:03.533188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384d2b-db0a-4545-8875-0911af90851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:03.535223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384d2b-db0a-4545-8875-0911af90851c admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:03.537047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384d2b-db0a-4545-8875-0911af90851c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:03.537469 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384d2b-db0a-4545-8875-0911af90851c admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:03.538838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7384d2b-db0a-4545-8875-0911af90851c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:03.541893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7384d2b-db0a-4545-8875-0911af90851c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:03.565313 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3910/7821] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:03.570656 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:03.603238 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:03.608844 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b931f4-b930-4309-92ea-b007cb4d4004 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:03.616299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:03.624489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:03.624489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:03.624489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] PATH_INFO: `/v3/system/users/cb0a73ebd9584bb6b006de369be49133/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:03.644784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cb0a73ebd9584bb6b006de369be49133, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:03.669872 n-d-854121-7 devstack@keystone.service[82299]: WARNING py.warnings [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 20:31:03.669872 n-d-854121-7 devstack@keystone.service[82299]: warnings.warn(msg) Aug 28 20:31:03.669872 n-d-854121-7 devstack@keystone.service[82299]: Aug 28 20:31:03.671350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:03.862204 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3912/7822] 10.222.0.78 () {60 vars in 1378 bytes} [Sun Aug 28 20:31:03 2022] PUT /identity/v3/system/users/cb0a73ebd9584bb6b006de369be49133/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:03.875615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:03.885580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:03.885580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:03.954844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] MFA Rules not processed for user `cb0a73ebd9584bb6b006de369be49133`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:03.954844 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:04.081107 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3911/7823] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:03 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 20:31:04.082452 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:04.285883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c1f8-1fe4-4472-8201-24dc94c1361a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:04.331688 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0a73ebd9584bb6b006de369be49133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:04.332763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:04.333214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:04.333670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] PATH_INFO: `/v3/services` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:04.334598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:04.336274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:04.345388 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3913/7824] 10.222.0.78 () {58 vars in 1110 bytes} [Sun Aug 28 20:31:04 2022] GET /identity/v3/services => generated 2191 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:04.350120 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:04.461483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:04.639539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffe195-89fc-4762-8251-a183c719acf5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:04.733410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0a73ebd9584bb6b006de369be49133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:04.734541 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:04.735805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:04.735965 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] PATH_INFO: `/v3/limits` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:04.737247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:04.741800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 28 20:31:04.817049 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 20:31:04.818296 n-d-854121-7 devstack@keystone.service[82298]: ERROR keystone.server.flask.application Aug 28 20:31:04.824409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:04.828442 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3912/7825] 10.222.0.78 () {60 vars in 1126 bytes} [Sun Aug 28 20:31:04 2022] POST /identity/v3/limits => generated 124 bytes in 478 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 20:31:05.017260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:05.284417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd26192-8440-4fee-afd7-ff3ee5b8beec None tempest-ImageQuotaTest-1445897019-system-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:05.376015 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0a73ebd9584bb6b006de369be49133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:05.376732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:05.377279 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:05.377845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:05.379021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:05.380403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:05.407116 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3914/7826] 10.222.0.78 () {58 vars in 1137 bytes} [Sun Aug 28 20:31:04 2022] GET /identity/v3/registered_limits => generated 129 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:31:05.422591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:05.701777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:05.704575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:05.706696 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:05.728910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5cc8a-6b6b-41f8-a555-07bf4a19982d None tempest-ImageQuotaTest-1445897019-system-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:05.838156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0a73ebd9584bb6b006de369be49133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:05.839230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:05.839800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:05.840309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:05.841709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:05.843306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:05.870588 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3913/7827] 10.222.0.78 () {58 vars in 1137 bytes} [Sun Aug 28 20:31:05 2022] GET /identity/v3/registered_limits => generated 129 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:31:05.988436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe618-1934-40d9-a098-52377fa8a38c None tempest-ImageQuotaTest-1445897019-system-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:05.996164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:05.996801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:05.997086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:05.997572 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:06.001762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:06.028501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:06.034372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:06.073314 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3915/7828] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:07.474690 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:07.498297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc826041-3654-4065-9094-58e80b119df3 None tempest-ImageQuotaTest-1445897019-system-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:07.511901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:07.512574 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:07.513016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:07.513441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] PATH_INFO: `/v3/users/c45a24155a2b477981c49a6e2216f6a3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:07.516743 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45a24155a2b477981c49a6e2216f6a3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:07.523225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:07.916916 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45a24155a2b477981c49a6e2216f6a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:07.920556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45a24155a2b477981c49a6e2216f6a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:08.042519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45a24155a2b477981c49a6e2216f6a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:08.080799 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45a24155a2b477981c49a6e2216f6a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:08.083788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45a24155a2b477981c49a6e2216f6a3'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:08.175875 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3914/7829] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:07 2022] DELETE /identity/v3/users/c45a24155a2b477981c49a6e2216f6a3 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:08.970382 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:08.998798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c96d-6153-4146-a2c6-4dc0936d5821 service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:09.293965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:09.324116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:09.326630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:09.327390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:09.330434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] PATH_INFO: `/v3/projects/eade34be160642ea9722bf93ef959e8a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:09.335619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eade34be160642ea9722bf93ef959e8a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:09.341408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:09.605698 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eade34be160642ea9722bf93ef959e8a', 'request_id': 'req-517e6901-148f-42d8-ac3c-63fd5ae0779d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:09.630143 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eade34be160642ea9722bf93ef959e8a', 'request_id': 'req-517e6901-148f-42d8-ac3c-63fd5ae0779d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:09.646539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eade34be160642ea9722bf93ef959e8a', 'request_id': 'req-517e6901-148f-42d8-ac3c-63fd5ae0779d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:09.728954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] The token cache is being invalidate because project eade34be160642ea9722bf93ef959e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:31:09.729197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:09.731983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:09.739291 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3916/7830] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:31:08 2022] DELETE /identity/v3/projects/eade34be160642ea9722bf93ef959e8a => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:09.742620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:09.744998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:09.780946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556571a-6303-4806-b5a4-df4fe8f810bc admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:10.063869 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:10.065784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:10.066239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:10.066613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] PATH_INFO: `/v3/users/7590920445a04f36b50ca598e4484b3a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:10.079954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7590920445a04f36b50ca598e4484b3a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:10.100681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:10.476288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:10.506199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7590920445a04f36b50ca598e4484b3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:10.510043 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7590920445a04f36b50ca598e4484b3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:10.619730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7590920445a04f36b50ca598e4484b3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:10.630407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7590920445a04f36b50ca598e4484b3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:10.631792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-37fb329f-5514-44aa-b639-8b90ede6bfbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7590920445a04f36b50ca598e4484b3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:10.682313 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3915/7831] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:09 2022] DELETE /identity/v3/users/7590920445a04f36b50ca598e4484b3a => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:11.250866 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:11.254849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:11.314631 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6901-148f-42d8-ac3c-63fd5ae0779d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:11.548071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:11.550684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:11.550684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:11.550684 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] PATH_INFO: `/v3/projects/b15f0569d01e402db823bdc40bf158b2` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:11.557440 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15f0569d01e402db823bdc40bf158b2)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:11.561634 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:11.761013 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15f0569d01e402db823bdc40bf158b2', 'request_id': 'req-313bdd4b-9e6a-4448-b7f2-a6f12204e355'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:11.786643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15f0569d01e402db823bdc40bf158b2', 'request_id': 'req-313bdd4b-9e6a-4448-b7f2-a6f12204e355'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:11.801141 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15f0569d01e402db823bdc40bf158b2', 'request_id': 'req-313bdd4b-9e6a-4448-b7f2-a6f12204e355'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:11.893069 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] The token cache is being invalidate because project b15f0569d01e402db823bdc40bf158b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:31:11.893387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:11.894881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-313bdd4b-9e6a-4448-b7f2-a6f12204e355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:11.897461 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3917/7832] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:31:11 2022] DELETE /identity/v3/projects/b15f0569d01e402db823bdc40bf158b2 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:11.902463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:11.902944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:11.903016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:11.981418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:11.983000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:12.139493 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3916/7833] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:12.145695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.146257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.146731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.171577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:12.173358 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:12.198879 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3918/7834] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:12.202919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:12.216680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146815-3b43-47d6-922c-9f5fd855e515 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:12.224261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:12.225236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.225770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.226294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.227181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:31:12.227729 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:12.243167 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:12.273947 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3917/7835] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:31:12.275742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:12.292021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cad728-1f29-4599-8ae1-56ba289890ef None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:12.308525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:12.309254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.309760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.310142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.310883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:12.313190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:12.321533 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:12.462970 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3919/7836] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:31:12 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:12.467960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:12.488253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d96ae9-c1dc-42e1-bcc4-42233c02b465 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:12.644769 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:12.645392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.645678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.646018 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.647098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:12.649282 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:12.755642 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3918/7837] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:12 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:12.757086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:12.771371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4adb7-52e5-456f-b6dc-93270f92fb38 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:12.777060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:12.778690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.779159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.779530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.780335 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:12.782807 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:12.800036 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3920/7838] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:12.802134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:12.819503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19503e88-940e-422e-a586-7351007bcc62 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:12.841410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ef0bd-3098-4b5f-85e6-7f90713705de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:12.842935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef0bd-3098-4b5f-85e6-7f90713705de admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.843706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef0bd-3098-4b5f-85e6-7f90713705de admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.844199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef0bd-3098-4b5f-85e6-7f90713705de admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.845884 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ef0bd-3098-4b5f-85e6-7f90713705de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:12.849276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ef0bd-3098-4b5f-85e6-7f90713705de admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:12.865935 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3919/7839] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:31:12.869199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:12.884885 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a9887-bfac-46af-90be-23bd73c6b688 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:12.890867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:12.891604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:12.892153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:12.892504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] PATH_INFO: `/v3/projects/2920bf2addeb4215a1f509e69d434fd6/users/d01b551abd284c0aaa6108d39ce31ebc/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:12.911259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2920bf2addeb4215a1f509e69d434fd6, user_id=d01b551abd284c0aaa6108d39ce31ebc, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:12.915047 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:13.034355 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3921/7840] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:12 2022] PUT /identity/v3/projects/2920bf2addeb4215a1f509e69d434fd6/users/d01b551abd284c0aaa6108d39ce31ebc/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:13.047970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:13.048364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:13.048512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:13.080447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:13.085094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] MFA Rules not processed for user `d01b551abd284c0aaa6108d39ce31ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:13.086422 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:13.245828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:13.247760 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3920/7841] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:13.407944 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7268eb-d628-4e10-b36b-5f54df397755 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:13.435417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:13.439444 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:13.440450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:13.442198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:13.445638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:13.449302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:13.594087 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3922/7842] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:31:13 2022] POST /identity/v3/projects => generated 381 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:13.595633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:13.615520 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96ddd-f483-4d2f-88c8-a89ecbe45e45 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:13.816714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:13.817801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:13.818325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:13.818812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:13.819887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:13.823712 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:13.972073 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3921/7843] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:13 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:13.973221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:13.992106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930993fc-4cda-4ab4-85f4-afd434aec00f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:14.005734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:14.006499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:14.006731 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:14.007012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:14.007867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:14.009535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:14.042501 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3923/7844] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:14.044117 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:14.055749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c81d8-e102-4f94-87b3-f945e10b4f0e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:14.073127 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:14.073831 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:14.074140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:14.074424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] PATH_INFO: `/v3/projects/7b2f49b2bc72469fbf41106d357076d9/users/0935d0828a6d4dcfab66c69072c12830/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:14.100542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2f49b2bc72469fbf41106d357076d9, user_id=0935d0828a6d4dcfab66c69072c12830, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:14.103927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:14.243458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3922/7845] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:14 2022] PUT /identity/v3/projects/7b2f49b2bc72469fbf41106d357076d9/users/0935d0828a6d4dcfab66c69072c12830/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:14.249547 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:14.273555 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354746f2-5bad-4617-8373-f0cc4b71a73e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:14.362670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0186-021b-4f6d-92d9-a83c62d99dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:14.363542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0186-021b-4f6d-92d9-a83c62d99dea admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:14.364031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0186-021b-4f6d-92d9-a83c62d99dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:14.364479 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0186-021b-4f6d-92d9-a83c62d99dea admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:14.365309 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c0186-021b-4f6d-92d9-a83c62d99dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:14.367418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c0186-021b-4f6d-92d9-a83c62d99dea admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:14.381709 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3924/7846] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:14.386166 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:14.399429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df010624-3e44-47ee-8c73-88771c2826a2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:14.406757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:14.407693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:14.407962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:14.408241 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] PATH_INFO: `/v3/projects/7b2f49b2bc72469fbf41106d357076d9/users/0935d0828a6d4dcfab66c69072c12830/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:14.422294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2f49b2bc72469fbf41106d357076d9, user_id=0935d0828a6d4dcfab66c69072c12830, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:14.426114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:14.445913 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3923/7847] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:14 2022] PUT /identity/v3/projects/7b2f49b2bc72469fbf41106d357076d9/users/0935d0828a6d4dcfab66c69072c12830/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:31:14.457250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:14.457787 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:14.458000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:14.519415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] MFA Rules not processed for user `0935d0828a6d4dcfab66c69072c12830`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:14.519415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:14.533243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:14.657415 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3925/7848] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:14.670661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:14.673175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:14.812862 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b744db-88fe-4bf7-b7ce-a7832a137a7a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:14.834902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060f607-a2db-41d4-a72c-d2223b09640c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:14.837424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060f607-a2db-41d4-a72c-d2223b09640c service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:14.837424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060f607-a2db-41d4-a72c-d2223b09640c service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:14.837424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060f607-a2db-41d4-a72c-d2223b09640c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:14.856920 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060f607-a2db-41d4-a72c-d2223b09640c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:14.860450 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060f607-a2db-41d4-a72c-d2223b09640c service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:14.868170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:14.905915 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3924/7849] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:15.229576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:15.244166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9610d4-715a-4340-b221-9c3d523edc9c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:15.260186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:15.260901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:15.261247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:15.261589 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:15.388040 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:15.392879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:15.415641 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3926/7850] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:18.750363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:18.751274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:18.751722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:18.807621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] MFA Rules not processed for user `eab435220eb1424985b28ec0642ef70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:18.809363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:19.059096 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3925/7851] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:21.119780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:21.122493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:21.242834 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:21.253511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:21.335297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523933f9-0635-4416-bab7-8eee67917c81 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:21.358475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:21.359406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:21.359831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:21.360262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:21.363200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:21.383757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:21.386002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516f65d-64cc-4f40-b5e3-ea867c71597d service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:21.406484 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3927/7852] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:21.472267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4295-1183-43c4-afb5-a3fabde42cf3 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:21.487006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:21.487707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:21.487996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:21.488276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] PATH_INFO: `/v3/users/a154dbb5442f42a5bbcc26545cb2b794` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:21.493168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a154dbb5442f42a5bbcc26545cb2b794)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:21.497214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:21.778730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a154dbb5442f42a5bbcc26545cb2b794'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:21.784466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a154dbb5442f42a5bbcc26545cb2b794'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:21.864194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a154dbb5442f42a5bbcc26545cb2b794'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:21.909559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a154dbb5442f42a5bbcc26545cb2b794'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:21.913178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a154dbb5442f42a5bbcc26545cb2b794'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:21.961269 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3926/7853] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:21 2022] DELETE /identity/v3/users/a154dbb5442f42a5bbcc26545cb2b794 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:31:22.226588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:22.227042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:22.227153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:22.297331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] MFA Rules not processed for user `871e1d05a6a54118b6265b36487dcb07`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:22.300214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:22.347912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:22.423491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:22.425579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:22.557202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:22.599553 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3928/7854] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:22.612539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:22.615122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:22.650736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c5a9c-46ec-4043-9309-fdb815b279b9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:22.664902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:22.666177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:22.666466 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:22.667260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] PATH_INFO: `/v3/projects/3eb7c9bee46e4bd091606fbf7133360d` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:22.686847 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb7c9bee46e4bd091606fbf7133360d)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:22.689186 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:22.748664 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710b45f-a45e-4aab-9fdd-06cb471b72ed None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:22.753089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:22.753713 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:22.754025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:22.754346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:22.765368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:22.767259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:22.790375 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3929/7855] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:22.857407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb7c9bee46e4bd091606fbf7133360d', 'request_id': 'req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:22.887335 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb7c9bee46e4bd091606fbf7133360d', 'request_id': 'req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:22.903073 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb7c9bee46e4bd091606fbf7133360d', 'request_id': 'req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.048364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] The token cache is being invalidate because project 3eb7c9bee46e4bd091606fbf7133360d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:31:23.055275 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.056645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.059134 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3927/7856] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:31:22 2022] DELETE /identity/v3/projects/3eb7c9bee46e4bd091606fbf7133360d => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:31:23.063438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:23.079411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5d7d1-b690-4b25-98a8-5c09fbe10af1 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:23.142009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:23.144148 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:23.267420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:23.268734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:23.269100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:23.269433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] PATH_INFO: `/v3/users/cb0a73ebd9584bb6b006de369be49133` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:23.270729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0a73ebd9584bb6b006de369be49133)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:23.272900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:23.299744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8fbe9-1af9-43a4-a5b7-cf6c7798695b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:23.308840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:23.312086 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:23.312452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:23.313285 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:23.317108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:23.448770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:23.450777 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:23.464757 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3928/7857] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:23.466042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:23.468268 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:23.487697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1e2f6-39db-4238-8623-52283fba5ab1 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:23.494980 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:23.495698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:23.495992 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:23.496276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] PATH_INFO: `/v3/users/60f31cb5dd8c492e9c4d19351d8256f9` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:23.498244 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f31cb5dd8c492e9c4d19351d8256f9)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:23.500805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:23.504453 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:23.519549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0a73ebd9584bb6b006de369be49133'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.526908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:23.547667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0a73ebd9584bb6b006de369be49133'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.584345 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0a73ebd9584bb6b006de369be49133'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.586174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0a73ebd9584bb6b006de369be49133'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.589714 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd4e5728-2640-48e5-9938-71fba12b87b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0a73ebd9584bb6b006de369be49133'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.743866 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3930/7858] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:23 2022] DELETE /identity/v3/users/cb0a73ebd9584bb6b006de369be49133 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:23.804053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f31cb5dd8c492e9c4d19351d8256f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.804778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f31cb5dd8c492e9c4d19351d8256f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:23.995067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f31cb5dd8c492e9c4d19351d8256f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:24.009118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f31cb5dd8c492e9c4d19351d8256f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:24.010269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f31cb5dd8c492e9c4d19351d8256f9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:24.032540 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3929/7859] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:23 2022] DELETE /identity/v3/users/60f31cb5dd8c492e9c4d19351d8256f9 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:24.037163 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:24.037455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:24.037937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:24.061875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:24.063706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:24.171724 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3931/7860] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:24.183710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:24.185359 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:24.305356 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a38238-d403-435d-999c-df86b4a31a25 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:24.310962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:24.311679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:24.312271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:24.312640 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:24.327249 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:24.328868 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:24.343875 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3930/7861] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:24.602820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:24.603715 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:24.643260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6da94d-6e8b-45e2-9f82-483654ed321c None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:24.678158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:24.690901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:24.700709 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:24.716004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:24.726990 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:24.729208 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application [None req-40c85a1a-8594-4234-9671-576cacbbbd39 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 20:31:24.753796 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 20:31:24.754825 n-d-854121-7 devstack@keystone.service[82299]: ERROR keystone.server.flask.application Aug 28 20:31:24.768513 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3932/7862] 10.222.0.78 () {58 vars in 1149 bytes} [Sun Aug 28 20:31:24 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 20:31:24.815912 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:24.819794 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:24.898161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c3600-2522-46d6-9f09-184ff4630bef service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:24.913352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:24.914788 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:24.915302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:24.915805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] PATH_INFO: `/v3/projects/948d5952c15c44a4b36dfc1009913a8a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:24.917812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] RBAC: Authorizing `identity:delete_project(project_id=948d5952c15c44a4b36dfc1009913a8a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:24.920173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:25.311559 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948d5952c15c44a4b36dfc1009913a8a', 'request_id': 'req-41e80524-b397-4421-83f8-f0da4842593e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:25.329327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948d5952c15c44a4b36dfc1009913a8a', 'request_id': 'req-41e80524-b397-4421-83f8-f0da4842593e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:25.357417 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948d5952c15c44a4b36dfc1009913a8a', 'request_id': 'req-41e80524-b397-4421-83f8-f0da4842593e'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:25.493104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] The token cache is being invalidate because project 948d5952c15c44a4b36dfc1009913a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:31:25.493104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:25.493104 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-41e80524-b397-4421-83f8-f0da4842593e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:25.499369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:25.499974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:25.500418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:25.504823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3931/7863] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:31:24 2022] DELETE /identity/v3/projects/948d5952c15c44a4b36dfc1009913a8a => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:25.534124 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:25.537983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:25.679228 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3933/7864] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:25.686910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:25.687201 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:25.687500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:25.698207 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:25.710491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:25.711944 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:25.721254 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3932/7865] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:25.726284 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:25.741061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2221e0-35de-4fc8-8455-c0037d74447a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:25.757442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:25.758291 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:25.758893 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:25.759324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:25.760324 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:31:25.760822 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:25.762895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:25.786960 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3934/7866] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:31:25.790977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:25.807314 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426c41-67ef-4dc9-8ccb-4cce225224b6 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:25.813315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:25.813963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:25.814409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:25.814881 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:25.815677 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:25.820780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:25.978308 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3933/7867] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:31:25 2022] POST /identity/v3/projects => generated 359 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:25.982853 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:26.021442 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aac4c0-8b20-4664-91b4-449aa95dba9c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:26.138104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:26.172404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:26.173044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:26.173330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:26.173708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:26.176109 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:26.178172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:26.401607 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3935/7868] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:25 2022] POST /identity/v3/users => generated 280 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:26.405587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:26.446642 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c94312-122c-4b28-a6d3-5c023e53ae6b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:26.497672 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:26.498509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:26.510374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:26.510922 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:26.511798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:26.513462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:26.557025 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:26.567093 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3934/7869] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:26.578056 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6e3d-892a-47e1-b724-97dd6d06fe08 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:26.586692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93f8ff-b10a-490a-959d-c36848901c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:26.588581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93f8ff-b10a-490a-959d-c36848901c5c admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:26.588581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93f8ff-b10a-490a-959d-c36848901c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:26.588581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93f8ff-b10a-490a-959d-c36848901c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:26.589044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93f8ff-b10a-490a-959d-c36848901c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:26.593258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93f8ff-b10a-490a-959d-c36848901c5c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:26.611848 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3936/7870] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:26.617945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:26.641309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd653f-3703-4113-b098-ff6455d5162e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:26.650546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:26.651588 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:26.652025 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:26.652554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] PATH_INFO: `/v3/projects/ed03447844244decb86aed85d040005a/users/b0facde714a347dbaf3a6f6bca7e8306/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:26.682393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed03447844244decb86aed85d040005a, user_id=b0facde714a347dbaf3a6f6bca7e8306, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:26.688078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:26.815140 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3935/7871] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:26 2022] PUT /identity/v3/projects/ed03447844244decb86aed85d040005a/users/b0facde714a347dbaf3a6f6bca7e8306/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:31:26.817237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec997-bf28-4707-b2e3-40d662b7baf7 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:26.817693 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec997-bf28-4707-b2e3-40d662b7baf7 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:26.817801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec997-bf28-4707-b2e3-40d662b7baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:26.943623 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2caec997-bf28-4707-b2e3-40d662b7baf7 None None] MFA Rules not processed for user `b0facde714a347dbaf3a6f6bca7e8306`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:26.946575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2caec997-bf28-4707-b2e3-40d662b7baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:27.188767 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3937/7872] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:27.202055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:27.207720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:27.304468 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:27.304814 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:27.351504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:27.352286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092746d-ea28-4b2b-8eb9-b3ced24c01c0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:27.352286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:27.352286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:27.352286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:27.352561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:27.354174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:27.357507 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:27.376369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] MFA Rules not processed for user `90089aa2d5534cc8b1be4287f94b4d73`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:27.381490 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:27.395161 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3936/7873] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:27.515534 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3938/7874] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:28.291911 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:28.318977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6a64b-936c-482a-88b4-eb49b82726a7 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:28.325570 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:28.326806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:28.327496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:28.327952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:28.343917 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:28.374370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:28.376371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:28.395180 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3937/7875] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:28.540757 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:28.543148 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:28.653276 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:28.693215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d84af-1814-4f3a-b3e9-f2d6061cb3d1 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:28.700379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:28.701360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:28.701801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:28.702285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:28.704597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:28.745777 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:28.748067 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8208-903a-4f87-b792-1bec5500428d service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:28.764337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3939/7876] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:36.332650 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:36.334365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:36.637171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12b64-7073-4921-a73c-77cb1924847b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:36.666176 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:36.666852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:36.667139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:36.667418 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] PATH_INFO: `/v3/users/d01b551abd284c0aaa6108d39ce31ebc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:36.679564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01b551abd284c0aaa6108d39ce31ebc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:36.681565 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:36.984800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:37.014334 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01b551abd284c0aaa6108d39ce31ebc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:37.018800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01b551abd284c0aaa6108d39ce31ebc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:37.085518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01b551abd284c0aaa6108d39ce31ebc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:37.121688 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01b551abd284c0aaa6108d39ce31ebc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:37.129047 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01b551abd284c0aaa6108d39ce31ebc'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:37.256782 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3938/7877] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:36 2022] DELETE /identity/v3/users/d01b551abd284c0aaa6108d39ce31ebc => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:37.260596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:37.261112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:37.266563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:37.328716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:37.331913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:37.548327 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3940/7878] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:37.570512 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:37.572154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:37.707254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25550b53-a2dd-4183-9adf-0e4e5d95719c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:37.707254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:37.707645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:37.708253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:37.708632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:37.721717 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:37.723407 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:37.739038 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3939/7879] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:38.691172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:38.692726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:38.724438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c47c-10d0-4b78-9d59-8077effa2582 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:38.743565 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:38.755661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:38.755661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:38.755661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] PATH_INFO: `/v3/projects/2920bf2addeb4215a1f509e69d434fd6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:38.755661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2920bf2addeb4215a1f509e69d434fd6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:38.755661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:39.038943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2920bf2addeb4215a1f509e69d434fd6', 'request_id': 'req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.061120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2920bf2addeb4215a1f509e69d434fd6', 'request_id': 'req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.072194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2920bf2addeb4215a1f509e69d434fd6', 'request_id': 'req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.183621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] The token cache is being invalidate because project 2920bf2addeb4215a1f509e69d434fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:31:39.183933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.188563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.191337 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3941/7880] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:31:38 2022] DELETE /identity/v3/projects/2920bf2addeb4215a1f509e69d434fd6 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:39.197096 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:39.215341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778adb-0f2e-4f81-8115-0fc68a950379 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:39.384160 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:39.384893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:39.385228 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:39.385561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] PATH_INFO: `/v3/users/0935d0828a6d4dcfab66c69072c12830` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:39.386996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0935d0828a6d4dcfab66c69072c12830)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:39.389525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:39.632039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0935d0828a6d4dcfab66c69072c12830'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.634554 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0935d0828a6d4dcfab66c69072c12830'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.773023 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0935d0828a6d4dcfab66c69072c12830'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.777029 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:39.786573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0935d0828a6d4dcfab66c69072c12830'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.787445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-26c1de39-b19f-4d63-8a71-ea6ee7865b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0935d0828a6d4dcfab66c69072c12830'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:39.839879 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3940/7881] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:31:39 2022] DELETE /identity/v3/users/0935d0828a6d4dcfab66c69072c12830 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:40.716389 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:40.725022 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:40.741063 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a77d3-37dd-4bd8-b4f0-4b7f278530fe admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:40.864585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:40.865350 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:40.865635 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:40.866138 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] PATH_INFO: `/v3/projects/7b2f49b2bc72469fbf41106d357076d9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:40.867457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2f49b2bc72469fbf41106d357076d9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:40.869581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:40.884685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:41.023619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2f49b2bc72469fbf41106d357076d9', 'request_id': 'req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:41.034239 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2f49b2bc72469fbf41106d357076d9', 'request_id': 'req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:41.046091 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2f49b2bc72469fbf41106d357076d9', 'request_id': 'req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:41.172093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] The token cache is being invalidate because project 7b2f49b2bc72469fbf41106d357076d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:31:41.172712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:41.173619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-fd91b8ca-d85e-43ca-81b3-7cfb2ebc7c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:31:41.179141 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3942/7882] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:31:40 2022] DELETE /identity/v3/projects/7b2f49b2bc72469fbf41106d357076d9 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:41.180530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.181465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.181752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.235556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:41.241375 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:41.398363 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3941/7883] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:41.398580 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.398877 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.399161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.435726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:41.437001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:41.448505 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3943/7884] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:41.452867 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:41.469804 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9c750-f2d2-4313-a636-c41616f5739b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:41.475759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:41.476380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.476685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.476958 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.477614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:31:41.477962 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:41.479576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:41.496128 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3942/7885] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:31:41.504818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:41.515120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec8d4-a2aa-404e-922c-e4669ecd8cb4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:41.523201 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:41.523839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.524118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.524394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.525194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:41.527044 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:41.617434 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3944/7886] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:31:41 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:41.619411 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:41.631722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08576d1-1bc3-4b7a-ae8b-ad256201731d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:41.718292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:41.719584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.719924 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.720525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.721702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:41.723766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:41.836424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:41.837619 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3943/7887] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:41 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:41.849207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a3d4-a1a0-42af-8614-4d44af20149b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:41.870075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:41.870550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.870833 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.871104 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.871849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:41.873829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:41.887234 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3945/7888] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:41.892242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:41.906933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304086b-351e-4565-b598-cf140ae7130f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:41.913403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a9c2f-b02d-4bb4-9924-d9c66c016843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:41.914155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a9c2f-b02d-4bb4-9924-d9c66c016843 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.914537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a9c2f-b02d-4bb4-9924-d9c66c016843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.915823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a9c2f-b02d-4bb4-9924-d9c66c016843 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.915963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a9c2f-b02d-4bb4-9924-d9c66c016843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:41.917931 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a9c2f-b02d-4bb4-9924-d9c66c016843 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:41.936687 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3944/7889] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:41.938082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:41.955177 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbca83-19ab-4b8c-b4be-08ed1f45c445 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:41.962157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:41.963482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:41.963958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:41.964512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] PATH_INFO: `/v3/projects/d3fa36acd1824305910792fe65e826e6/users/e19af791f8ca473893c263ad788f5df1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:41.993928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fa36acd1824305910792fe65e826e6, user_id=e19af791f8ca473893c263ad788f5df1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:41.997123 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:42.154861 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3946/7890] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:41 2022] PUT /identity/v3/projects/d3fa36acd1824305910792fe65e826e6/users/e19af791f8ca473893c263ad788f5df1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:42.166719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:42.167003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:42.170019 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:42.210354 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] MFA Rules not processed for user `e19af791f8ca473893c263ad788f5df1`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:42.212510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:42.250601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:42.298351 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3945/7891] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:42.316027 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:42.441519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7e53-8e81-49cb-b31d-3da63570f951 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:42.479743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:42.480838 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:42.481220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:42.481955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:42.482750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:42.484911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:42.579042 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3947/7892] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:31:42 2022] POST /identity/v3/projects => generated 363 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:42.583651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:42.604539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997fdd-37aa-4a74-b542-ce7939e220b2 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:42.732362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:42.733131 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:42.733487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:42.733915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:42.734721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:42.737636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:42.873141 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3946/7893] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:31:42 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:31:42.877536 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:42.897157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd241136-e1cc-4459-9c97-1dabc9c1abba admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:42.910612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:42.911521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:42.911974 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:42.912391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:42.913198 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:42.915266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:42.946805 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3948/7894] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:42.949130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:42.962626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683451-0b47-4714-b6f8-8c200b9b0edb admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:42.979245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:42.979245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:42.979245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:42.979245 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] PATH_INFO: `/v3/projects/3fca95221523459d89673e99dba5cd5b/users/3e021140fb0440c2bcc04f4dafe59052/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:43.002242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fca95221523459d89673e99dba5cd5b, user_id=3e021140fb0440c2bcc04f4dafe59052, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:43.007892 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:43.097887 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3947/7895] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:42 2022] PUT /identity/v3/projects/3fca95221523459d89673e99dba5cd5b/users/3e021140fb0440c2bcc04f4dafe59052/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:31:43.102395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:43.126100 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb894-e140-4c38-a61e-f7cf177bdc37 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:43.147685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:43.236267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20010f46-a50a-4bb9-8d98-dd6f3a21f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:43.236267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20010f46-a50a-4bb9-8d98-dd6f3a21f4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:43.236267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20010f46-a50a-4bb9-8d98-dd6f3a21f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:43.236267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20010f46-a50a-4bb9-8d98-dd6f3a21f4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:43.236679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20010f46-a50a-4bb9-8d98-dd6f3a21f4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:43.237832 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20010f46-a50a-4bb9-8d98-dd6f3a21f4c2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:43.249987 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3949/7896] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:31:43.256851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:43.274055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a0c1-902a-4be8-a348-2ca9477d9488 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:43.283294 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:43.284855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:43.285168 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:43.285438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] PATH_INFO: `/v3/projects/3fca95221523459d89673e99dba5cd5b/users/3e021140fb0440c2bcc04f4dafe59052/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:43.287645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fca95221523459d89673e99dba5cd5b, user_id=3e021140fb0440c2bcc04f4dafe59052, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:43.290561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:43.302461 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3948/7897] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:31:43 2022] PUT /identity/v3/projects/3fca95221523459d89673e99dba5cd5b/users/3e021140fb0440c2bcc04f4dafe59052/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:31:43.313020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:43.316166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:43.316166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:43.348585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] MFA Rules not processed for user `3e021140fb0440c2bcc04f4dafe59052`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:43.349820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:43.495710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3950/7898] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:43.502679 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:43.504915 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:43.646206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2079ae-1267-4fac-a4c9-22bf1d70f774 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:43.658990 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabc0d-56fe-40ae-b60d-b0e0aedbbbff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:43.659578 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabc0d-56fe-40ae-b60d-b0e0aedbbbff service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:43.659984 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabc0d-56fe-40ae-b60d-b0e0aedbbbff service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:43.660859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabc0d-56fe-40ae-b60d-b0e0aedbbbff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:43.674100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aabc0d-56fe-40ae-b60d-b0e0aedbbbff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:43.676177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aabc0d-56fe-40ae-b60d-b0e0aedbbbff service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:43.695930 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3949/7899] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:31:43.988252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:43.990182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:44.011470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f078-c0a7-4e54-b28e-35d9d115bb75 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:44.016433 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:44.032400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:44.032400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:44.032400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:44.104247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:44.105820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:44.119176 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3951/7900] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:31:46.450500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:46.451103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:46.451103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:46.472964 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:31:46.474823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:46.482951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:46.612581 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3950/7901] 10.222.0.78 () {58 vars in 1009 bytes} [Sun Aug 28 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:31:46.816958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:46.818683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:46.870465 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:31:46.942904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949f8e-7894-4fae-9830-18ec0ef51e2d service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:46.950573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada568b0-c33c-4f65-9b6a-2a24a0918d1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:46.952086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada568b0-c33c-4f65-9b6a-2a24a0918d1b service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:46.952086 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada568b0-c33c-4f65-9b6a-2a24a0918d1b service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:46.952769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada568b0-c33c-4f65-9b6a-2a24a0918d1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:46.963576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada568b0-c33c-4f65-9b6a-2a24a0918d1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:46.965369 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada568b0-c33c-4f65-9b6a-2a24a0918d1b service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:46.976465 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3952/7902] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:31:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:31:49.974476 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:31:49.977949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:50.238599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbf2b-49ad-406e-9a57-e925d5d63f0a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:31:50.258379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:31:50.259037 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:31:50.259481 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:31:50.259719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:31:50.278295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:31:50.333518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:31:50.335524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:31:50.377362 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3951/7903] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:31:57.022759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=19 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:00.345226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=52 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:24.331776 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cc4fb-859b-4588-8125-236d883d1ddf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:24.332308 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cc4fb-859b-4588-8125-236d883d1ddf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:24.332501 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cc4fb-859b-4588-8125-236d883d1ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:24.354409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-998cc4fb-859b-4588-8125-236d883d1ddf None None] MFA Rules not processed for user `90089aa2d5534cc8b1be4287f94b4d73`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:24.355659 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-998cc4fb-859b-4588-8125-236d883d1ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:24.430940 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3953/7904] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:26.291503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:26.399071 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46b71-7e09-4a86-9326-df09500a63af service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:26.404680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:26.405426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:26.405780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:26.406840 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] PATH_INFO: `/v3/users/e19af791f8ca473893c263ad788f5df1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:26.408032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19af791f8ca473893c263ad788f5df1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:26.410222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:26.807405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19af791f8ca473893c263ad788f5df1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:26.808308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19af791f8ca473893c263ad788f5df1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:26.965379 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19af791f8ca473893c263ad788f5df1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:26.984720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19af791f8ca473893c263ad788f5df1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:26.984720 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19af791f8ca473893c263ad788f5df1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:27.046707 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3952/7905] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:32:26 2022] DELETE /identity/v3/users/e19af791f8ca473893c263ad788f5df1 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:27.048192 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:27.048658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:27.048788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:27.084338 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:27.085609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:27.177264 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3954/7906] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:32:27.187399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:27.188926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:27.300670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30daaf5-43c9-416a-b11a-22d6cc37b7d4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:27.308113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:27.309162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:27.309613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:27.310046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:27.322336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:27.323941 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:27.336508 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3953/7907] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:32:28.008615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:28.010144 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:28.027808 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75937c0a-21de-484b-8494-5d77fe671354 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:28.033264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:28.034256 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:28.034379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:28.034692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] PATH_INFO: `/v3/projects/d3fa36acd1824305910792fe65e826e6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:28.035955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3fa36acd1824305910792fe65e826e6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:28.038101 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:28.259083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3fa36acd1824305910792fe65e826e6', 'request_id': 'req-684935c4-4ac1-4ba2-8836-05dca9890bd3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:28.300869 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3fa36acd1824305910792fe65e826e6', 'request_id': 'req-684935c4-4ac1-4ba2-8836-05dca9890bd3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:28.324090 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3fa36acd1824305910792fe65e826e6', 'request_id': 'req-684935c4-4ac1-4ba2-8836-05dca9890bd3'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:28.429806 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] The token cache is being invalidate because project d3fa36acd1824305910792fe65e826e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:32:28.430217 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:28.431066 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:28.432718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3955/7908] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:28 2022] DELETE /identity/v3/projects/d3fa36acd1824305910792fe65e826e6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:28.437193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:28.448432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85db92f-8e95-4267-984e-5965901780cb service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:28.480613 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:28.529827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:28.530535 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:28.530894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:28.531204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] PATH_INFO: `/v3/users/3e021140fb0440c2bcc04f4dafe59052` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:28.532430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e021140fb0440c2bcc04f4dafe59052)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:28.534413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:28.941426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e021140fb0440c2bcc04f4dafe59052'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:28.942782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e021140fb0440c2bcc04f4dafe59052'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:29.189298 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e021140fb0440c2bcc04f4dafe59052'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:29.197760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e021140fb0440c2bcc04f4dafe59052'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:29.198534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3ba17878-05bf-4fbc-b172-bea87db680d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e021140fb0440c2bcc04f4dafe59052'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:29.220682 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3954/7909] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:32:28 2022] DELETE /identity/v3/users/3e021140fb0440c2bcc04f4dafe59052 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:30.128118 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:30.130149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:30.149685 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684935c4-4ac1-4ba2-8836-05dca9890bd3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:30.240415 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:30.295057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:30.295804 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:30.296149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:30.296522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] PATH_INFO: `/v3/projects/3fca95221523459d89673e99dba5cd5b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:30.301372 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fca95221523459d89673e99dba5cd5b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:30.304186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:30.564073 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fca95221523459d89673e99dba5cd5b', 'request_id': 'req-3149bf6a-be95-4a8a-871b-373e1415ec47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:30.577550 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fca95221523459d89673e99dba5cd5b', 'request_id': 'req-3149bf6a-be95-4a8a-871b-373e1415ec47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:30.604252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fca95221523459d89673e99dba5cd5b', 'request_id': 'req-3149bf6a-be95-4a8a-871b-373e1415ec47'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:30.737424 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] The token cache is being invalidate because project 3fca95221523459d89673e99dba5cd5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:32:30.737765 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:30.738449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3149bf6a-be95-4a8a-871b-373e1415ec47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:30.743547 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3956/7910] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:30 2022] DELETE /identity/v3/projects/3fca95221523459d89673e99dba5cd5b => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:30.747647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:30.747647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:30.747647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:30.786445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:30.787714 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:30.896950 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3955/7911] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:30.908010 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:30.908474 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:30.908880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:30.944437 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:30.951924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:30.974311 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3957/7912] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:30.975488 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:31.007596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306600d-fa5c-49d1-8510-a56935f66cb8 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:31.031343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:31.032761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:31.033273 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:31.033749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:31.034855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:32:31.035368 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:31.046468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:31.079038 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3956/7913] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:32:31.090951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:31.108348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa338bd-e3dc-412a-a8e4-30d8fffd9709 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:31.122736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:31.123407 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:31.123690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:31.123963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:31.124737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:31.133763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:31.326890 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3958/7914] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:32:31 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:31.332123 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:31.344218 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7694863-52e8-4325-907a-60195b238358 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:31.483989 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:31.586155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:31.586855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:31.587503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:31.587503 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:31.588362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:31.590820 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:31.743154 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3957/7915] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:32:31 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:32:31.747759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:31.765569 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc31d-af85-4ca6-98d9-9095689935ca admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:31.788819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:31.790875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:31.792075 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:31.792541 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:31.794203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:31.796247 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:31.832039 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3959/7916] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:31.836276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:31.854307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7071-13fe-40b9-a3d2-0bc5e2d68f3b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:31.864050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:31.865006 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:31.865445 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:31.866338 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:31.867267 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:31.875832 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:31.891806 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3958/7917] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:31.895829 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:31.908318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c402f-f0ee-41a9-99a9-db9401f2533f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:31.913932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482179-e75e-43f9-8eca-6deb023b13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:31.915038 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482179-e75e-43f9-8eca-6deb023b13d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:31.915586 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482179-e75e-43f9-8eca-6deb023b13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:31.915858 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482179-e75e-43f9-8eca-6deb023b13d8 admin admin] PATH_INFO: `/v3/projects/54684ae560bc435fa46898e76aaddea0/users/9272d6c164ff41639c083a1bb9cad682/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:31.935461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7482179-e75e-43f9-8eca-6deb023b13d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54684ae560bc435fa46898e76aaddea0, user_id=9272d6c164ff41639c083a1bb9cad682, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:31.938306 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7482179-e75e-43f9-8eca-6deb023b13d8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:32.050056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:32.053250 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:32.136903 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3960/7918] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:32:31 2022] PUT /identity/v3/projects/54684ae560bc435fa46898e76aaddea0/users/9272d6c164ff41639c083a1bb9cad682/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:32.150942 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:32.151233 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:32.151540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:32.208130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483135-be67-4a25-9d65-68b84ff08db8 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:32.220435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] MFA Rules not processed for user `9272d6c164ff41639c083a1bb9cad682`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:32.222024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:32.320821 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:32.344599 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:32.345391 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:32.345758 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:32.346133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:32.355658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:32.380044 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3961/7919] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:32:32.382508 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:32.528221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:32.533429 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:32.558094 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b413b-57fd-416a-adef-73396d0554dc None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:32.568458 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3959/7920] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:32:32.578650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:32.578817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:32.579650 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:32.581588 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:32.582439 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:32.584377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:32.730016 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3962/7921] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:32:32 2022] POST /identity/v3/projects => generated 379 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:32.734946 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:32.768983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cace7-f8cf-41cc-bbb2-e10349ca06d1 service swift] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:32.857102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:32.857780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:32.858038 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:32.858737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:32.859753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:32.861742 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:32.998030 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3960/7922] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:32:32 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:33.001951 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:33.021502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5fd8e-f785-468d-9786-f85a03550d36 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:33.038615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:33.039446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:33.039897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:33.040339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:33.041174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:33.047485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:33.071945 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3963/7923] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:33.081357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:33.096327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751488-4337-446d-a32c-4cd942e33945 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:33.103276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:33.103953 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:33.104409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:33.104693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] PATH_INFO: `/v3/projects/f7380cff74f044d5b9967befa88066cc/users/5da171ead64849d68b3649371a84a0e4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:33.123736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7380cff74f044d5b9967befa88066cc, user_id=5da171ead64849d68b3649371a84a0e4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:33.127434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:33.338909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:33.361982 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3961/7924] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:32:33 2022] PUT /identity/v3/projects/f7380cff74f044d5b9967befa88066cc/users/5da171ead64849d68b3649371a84a0e4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:33.368326 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:33.384652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dab995-a375-4ece-a142-4b4601612389 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:33.500983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b59776-a7c2-4dc2-af62-683e072414dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:33.502410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b59776-a7c2-4dc2-af62-683e072414dd admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:33.502701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b59776-a7c2-4dc2-af62-683e072414dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:33.502980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b59776-a7c2-4dc2-af62-683e072414dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:33.503694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b59776-a7c2-4dc2-af62-683e072414dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:33.505578 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b59776-a7c2-4dc2-af62-683e072414dd admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:33.530409 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3964/7925] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:33.539776 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:33.558068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881580-ebf2-4026-b0ad-5c6503d39a7d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:33.567424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:33.568151 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:33.569020 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:33.569424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] PATH_INFO: `/v3/projects/f7380cff74f044d5b9967befa88066cc/users/5da171ead64849d68b3649371a84a0e4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:33.572668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7380cff74f044d5b9967befa88066cc, user_id=5da171ead64849d68b3649371a84a0e4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:33.576184 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:33.589574 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3962/7926] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:32:33 2022] PUT /identity/v3/projects/f7380cff74f044d5b9967befa88066cc/users/5da171ead64849d68b3649371a84a0e4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:33.601914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:33.602246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:33.602495 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:33.637585 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] MFA Rules not processed for user `5da171ead64849d68b3649371a84a0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:33.638872 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:33.747932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:33.815748 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3965/7927] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:33.826304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:33.832943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:33.971551 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add076-625e-49d0-8810-cfb249cec87e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:33.978483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:33.979455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:33.980103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:33.980692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:34.028716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:34.034340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:34.085561 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3963/7928] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:32:35.899597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:35.912701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2d1a8-d0c1-4395-8bcc-37fbcbb7b66e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:35.919706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da171ead64849d68b3649371a84a0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7380cff74f044d5b9967befa88066cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:35.920478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:35.920828 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:35.921172 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:35.921989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:32:35.922478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:35.924249 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:35.939274 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3966/7929] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:32:35.943595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:35.961907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0dd7-ab15-46fd-96ed-8149d32e5ea3 service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:35.967636 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da171ead64849d68b3649371a84a0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7380cff74f044d5b9967befa88066cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:35.968326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:35.969149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:35.969446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:35.970509 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:35.973286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:36.106123 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3964/7930] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:32:35 2022] POST /identity/v3/projects => generated 354 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:36.110717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:36.126429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5807b-20d5-4354-9d74-a4632448037e tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:36.254553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da171ead64849d68b3649371a84a0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7380cff74f044d5b9967befa88066cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:36.255466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:36.255849 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:36.256202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:36.257106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:32:36.257577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:36.262156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:36.283176 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3967/7931] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:32:36.329288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:36.360639 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842439-d1e7-415b-ae18-8a7be4b885e6 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:36.374280 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da171ead64849d68b3649371a84a0e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7380cff74f044d5b9967befa88066cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:36.375009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:36.375311 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:36.375591 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] PATH_INFO: `/v3/projects/c6782d85a08d4cf1ac4e418ee637936e` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:36.376973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c6782d85a08d4cf1ac4e418ee637936e)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:36.379524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:36.407365 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:36.568530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6782d85a08d4cf1ac4e418ee637936e', 'request_id': 'req-3e75f3cf-9051-4140-a119-1039d86df24a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:36.576756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6782d85a08d4cf1ac4e418ee637936e', 'request_id': 'req-3e75f3cf-9051-4140-a119-1039d86df24a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:36.588195 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6782d85a08d4cf1ac4e418ee637936e', 'request_id': 'req-3e75f3cf-9051-4140-a119-1039d86df24a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:36.686351 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] The token cache is being invalidate because project c6782d85a08d4cf1ac4e418ee637936e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:32:36.686749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:36.687595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-3e75f3cf-9051-4140-a119-1039d86df24a tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:36.690522 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3965/7932] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:36 2022] DELETE /identity/v3/projects/c6782d85a08d4cf1ac4e418ee637936e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:37.937883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:37.941302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:38.056114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ec50-fe0b-41ae-bfce-cd9806376575 tempest-VolumeQuotaClassesTest-877066762 tempest-VolumeQuotaClassesTest-877066762-project-admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:38.154649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:38.155301 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:38.155614 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:38.155894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] PATH_INFO: `/v3/users/9272d6c164ff41639c083a1bb9cad682` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:38.158285 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9272d6c164ff41639c083a1bb9cad682)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:38.160005 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:38.175726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:38.477349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9272d6c164ff41639c083a1bb9cad682'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:38.491087 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9272d6c164ff41639c083a1bb9cad682'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:38.498794 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9272d6c164ff41639c083a1bb9cad682'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:38.500178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9272d6c164ff41639c083a1bb9cad682'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:38.500873 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9272d6c164ff41639c083a1bb9cad682'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:38.634391 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3968/7933] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:32:37 2022] DELETE /identity/v3/users/9272d6c164ff41639c083a1bb9cad682 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:38.639132 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e8ee-d3d5-4342-ac35-d7c71dda1cea None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:38.644358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e8ee-d3d5-4342-ac35-d7c71dda1cea None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:38.644358 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e8ee-d3d5-4342-ac35-d7c71dda1cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:38.663556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-35b3e8ee-d3d5-4342-ac35-d7c71dda1cea None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:38.664801 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-35b3e8ee-d3d5-4342-ac35-d7c71dda1cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:38.779231 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3966/7934] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:32:38.792351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:38.793965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:38.879096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f443f-e91f-48bf-8ce8-603cda669d55 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:38.882932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:38.883616 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:38.883900 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:38.884174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:38.896801 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:38.898303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:38.909900 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3969/7935] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:32:39.244072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:39.244563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:39.245010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:39.273619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] MFA Rules not processed for user `4898339418664af0b17fbfed27604480`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:39.274925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:39.373142 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3967/7936] 10.222.0.78 () {58 vars in 967 bytes} [Sun Aug 28 20:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:32:39.394809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:39.397162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:39.501303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6321c-ac6a-41aa-91c9-77e8b4521f0a service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:39.523114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1120d09d46e5416a9257f2a40da688d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:39.523820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:39.524108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:39.525244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:39.535607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:39.537417 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:39.548153 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3970/7937] 10.222.0.78 () {60 vars in 1384 bytes} [Sun Aug 28 20:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:32:39.763384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:39.766113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:39.793687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802849d6-1219-482c-a90f-c785188e2d4a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:39.799317 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:39.800487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:39.800634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:39.801111 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] PATH_INFO: `/v3/projects/54684ae560bc435fa46898e76aaddea0` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:39.802371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54684ae560bc435fa46898e76aaddea0)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:39.804333 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:40.160727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:40.168697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54684ae560bc435fa46898e76aaddea0', 'request_id': 'req-9bcd6407-5868-42d2-98d3-dec49838cc36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.175689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54684ae560bc435fa46898e76aaddea0', 'request_id': 'req-9bcd6407-5868-42d2-98d3-dec49838cc36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.182770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54684ae560bc435fa46898e76aaddea0', 'request_id': 'req-9bcd6407-5868-42d2-98d3-dec49838cc36'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.360271 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] The token cache is being invalidate because project 54684ae560bc435fa46898e76aaddea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:32:40.360576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.361283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.362980 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3968/7938] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:39 2022] DELETE /identity/v3/projects/54684ae560bc435fa46898e76aaddea0 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:40.367103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:40.378820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115259ce-326c-4f34-a1d8-0fd5e6a20776 service swift] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:40.398431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:40.451199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:40.452337 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:40.452818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:40.453955 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] PATH_INFO: `/v3/users/5da171ead64849d68b3649371a84a0e4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:40.455438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da171ead64849d68b3649371a84a0e4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:40.457701 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:40.823122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da171ead64849d68b3649371a84a0e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.845299 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da171ead64849d68b3649371a84a0e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.851464 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da171ead64849d68b3649371a84a0e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.852321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da171ead64849d68b3649371a84a0e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.853178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d64eeace-1c11-4468-92ce-bb14cc725174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da171ead64849d68b3649371a84a0e4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:40.998849 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3971/7939] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:32:40 2022] DELETE /identity/v3/users/5da171ead64849d68b3649371a84a0e4 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:42.005842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:42.005842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:42.022708 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6407-5868-42d2-98d3-dec49838cc36 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:42.100389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:42.101122 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:42.101416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:42.101701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] PATH_INFO: `/v3/projects/f7380cff74f044d5b9967befa88066cc` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:42.103040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7380cff74f044d5b9967befa88066cc)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:42.105056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:42.305734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7380cff74f044d5b9967befa88066cc', 'request_id': 'req-38db3285-d08b-42d6-8acb-fe7d82df54c9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:42.312668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7380cff74f044d5b9967befa88066cc', 'request_id': 'req-38db3285-d08b-42d6-8acb-fe7d82df54c9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:42.319487 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7380cff74f044d5b9967befa88066cc', 'request_id': 'req-38db3285-d08b-42d6-8acb-fe7d82df54c9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:42.417307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] The token cache is being invalidate because project f7380cff74f044d5b9967befa88066cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:32:42.417673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:42.418306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-38db3285-d08b-42d6-8acb-fe7d82df54c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:42.426250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:42.427400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:42.427845 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:42.431530 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3969/7940] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:42 2022] DELETE /identity/v3/projects/f7380cff74f044d5b9967befa88066cc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:42.453121 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:42.455461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:42.535150 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3972/7941] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:42.543377 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:42.543773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:42.544202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:42.569572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:42.571204 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:42.602522 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3970/7942] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:42.603637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:42.618055 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d1ca-d276-464b-a4fa-5c2c42b7c958 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:42.623076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:42.623666 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:42.623950 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:42.624225 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:42.624889 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:32:42.625195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:42.627817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:42.641721 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3973/7943] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:32:42.646416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:42.656515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d2d5c-505b-43c1-82ad-af5e18610456 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:42.661543 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:42.662208 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:42.662490 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:42.662768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:42.663400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:42.665320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:42.780276 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3971/7944] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:32:42 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:42.785311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:42.799509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d882563-dfdd-4b27-a64f-ad464c493108 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:42.833970 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:42.904687 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:42.905320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:42.905598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:42.905937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:42.906613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:42.912254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:43.028620 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3974/7945] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:32:42 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:43.034419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:43.057651 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b1599-902a-4921-98ca-62339f21b88a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:43.062951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:43.063557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:43.064635 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:43.064926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:43.065607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:43.067302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:43.081151 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3972/7946] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:43.085251 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:43.097170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e3cd-da34-4c4f-80a5-83a848875a62 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:43.102488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4770ea1-2bea-4226-9a97-058d5130054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:43.103122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4770ea1-2bea-4226-9a97-058d5130054b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:43.103408 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4770ea1-2bea-4226-9a97-058d5130054b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:43.103686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4770ea1-2bea-4226-9a97-058d5130054b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:43.104348 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4770ea1-2bea-4226-9a97-058d5130054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:43.106062 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4770ea1-2bea-4226-9a97-058d5130054b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:43.139584 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3975/7947] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:43.139977 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:43.160274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd87dfa-146e-4ceb-8b7c-62a3a0a1e2d6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:43.167533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:43.170659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:43.170659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:43.170659 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] PATH_INFO: `/v3/projects/a638f366d8cc430eb2ea1e742784b47c/users/4b6ef20b2fc04aa99fe3e23fd68d9487/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:43.189389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a638f366d8cc430eb2ea1e742784b47c, user_id=4b6ef20b2fc04aa99fe3e23fd68d9487, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:43.194614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:43.200475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:43.364287 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3973/7948] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:32:43 2022] PUT /identity/v3/projects/a638f366d8cc430eb2ea1e742784b47c/users/4b6ef20b2fc04aa99fe3e23fd68d9487/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:32:43.381403 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:43.381706 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:43.382060 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:43.433520 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] MFA Rules not processed for user `4b6ef20b2fc04aa99fe3e23fd68d9487`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:43.435011 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:43.556056 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3976/7949] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:43.560325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:43.694420 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea12e4-83ca-4838-9194-556d512dd13d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:43.713223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:43.714165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:43.714942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:43.714942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:43.715304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:43.718061 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:43.899940 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3974/7950] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:32:43 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:32:43.903905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:43.928750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55797-d178-424e-a0c4-f79bd3c0d058 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:44.047385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:44.047947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.048310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.048592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.049252 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:44.053074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:44.362858 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3977/7951] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:32:43 2022] POST /identity/v3/users => generated 297 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:32:44.368200 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:44.380607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908a06a-dd3b-45e4-8036-e7a2e26181a4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:44.386472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:44.387500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.387658 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.387895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.388560 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:44.390818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:44.407336 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3975/7952] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:44.417946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:44.429427 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c7bb-5ea2-4f54-be8e-688725383fef admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:44.435095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:44.436448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.437431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.437902 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] PATH_INFO: `/v3/projects/c5cd7d2cddd644db8fe42862fbee5bdc/users/a774917c59ce42ef9165967720b02b5f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.473110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cd7d2cddd644db8fe42862fbee5bdc, user_id=a774917c59ce42ef9165967720b02b5f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:44.476053 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:44.540923 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:44.544378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:44.623679 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:44.630511 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3978/7953] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:32:44 2022] PUT /identity/v3/projects/c5cd7d2cddd644db8fe42862fbee5bdc/users/a774917c59ce42ef9165967720b02b5f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:44.634949 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:44.719597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd34fd-e938-4968-b0d0-fe21103e713b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:44.792596 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea27c5-f159-4a89-8480-3caecfb0efee admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:44.809001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:44.810057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.810342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.810943 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.811621 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:44.814311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:44.830003 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3979/7954] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:32:44.833633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:44.835166 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:44.838579 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.838897 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.839175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.841260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:44.853740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932572c-ae68-4148-b80f-d726f8221bb5 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:44.858803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331404d3-a7c5-4d82-92bb-56153f8c4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:44.859627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331404d3-a7c5-4d82-92bb-56153f8c4d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.859908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331404d3-a7c5-4d82-92bb-56153f8c4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.860184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331404d3-a7c5-4d82-92bb-56153f8c4d16 admin admin] PATH_INFO: `/v3/projects/c5cd7d2cddd644db8fe42862fbee5bdc/users/a774917c59ce42ef9165967720b02b5f/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.862387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331404d3-a7c5-4d82-92bb-56153f8c4d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cd7d2cddd644db8fe42862fbee5bdc, user_id=a774917c59ce42ef9165967720b02b5f, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:44.863773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:44.865051 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331404d3-a7c5-4d82-92bb-56153f8c4d16 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:44.865875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:44.881926 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3980/7955] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:32:44 2022] PUT /identity/v3/projects/c5cd7d2cddd644db8fe42862fbee5bdc/users/a774917c59ce42ef9165967720b02b5f/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:32:44.894965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:44.895261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:44.900784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:44.906616 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3976/7956] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:32:44.957633 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] MFA Rules not processed for user `a774917c59ce42ef9165967720b02b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:44.958927 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:45.123637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:45.124873 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3981/7957] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:32:45.126955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:45.238657 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb7d36-aeb0-4e82-a700-0e750cb24fe5 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:45.341161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:45.342347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:45.343041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:45.346472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:45.377615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:45.379140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:45.402630 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3977/7958] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:32:45.596598 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:45.629904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06147-55b2-416c-ab6e-1177731efedf None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:45.630766 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:45.633288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:45.633288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:45.633288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:45.650855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:45.738682 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:45.740527 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:45.753079 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3982/7959] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:32:49.901158 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:49.902784 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:49.985257 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5da3a-5d0c-481c-a482-a0fb669091ce service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:49.993749 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:49.994822 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:49.995115 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:49.995406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:49.998562 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:50.109818 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:50.165721 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:50.169374 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:50.181222 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:50.183481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:50.197179 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3978/7960] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:32:50.203012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fd28b-579b-4a6a-aa4c-59dc4fed73e0 service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:50.209705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:50.210553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:50.210840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:50.211120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:50.213030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:50.224884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:50.233645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:50.236947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb5a2b-fc82-43f7-9f69-a642857f1c0c service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:50.257048 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3983/7961] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:32:55.021486 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:55.197045 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c053e6e-e6a2-4a5f-bd98-46180ea888fd service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:55.202954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:55.207346 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:55.207910 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:55.208340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] PATH_INFO: `/v3/users/4b6ef20b2fc04aa99fe3e23fd68d9487` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:55.212827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6ef20b2fc04aa99fe3e23fd68d9487)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:55.215309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:55.562456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6ef20b2fc04aa99fe3e23fd68d9487'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:55.568596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6ef20b2fc04aa99fe3e23fd68d9487'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:55.684367 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6ef20b2fc04aa99fe3e23fd68d9487'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:55.699748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6ef20b2fc04aa99fe3e23fd68d9487'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:55.700961 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6ef20b2fc04aa99fe3e23fd68d9487'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:55.765574 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3979/7962] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:32:55 2022] DELETE /identity/v3/users/4b6ef20b2fc04aa99fe3e23fd68d9487 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:55.767398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:55.767896 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:55.767988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:55.801447 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:32:55.814860 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:55.988463 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3984/7963] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:32:55.999663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:56.001596 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:56.177571 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e7d1-0642-4c7a-ac25-65a6d6f769d9 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:56.183126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:56.184011 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:56.184438 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:56.185935 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:56.202203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:56.204322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:56.234760 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3980/7964] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:32:57.112895 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:57.116752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:57.160575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a240-eaaf-4394-aa09-43e6c0c8d4a9 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:57.186753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:57.189443 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:57.192402 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:57.192973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] PATH_INFO: `/v3/projects/a638f366d8cc430eb2ea1e742784b47c` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:57.194629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a638f366d8cc430eb2ea1e742784b47c)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:57.197642 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:57.359001 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a638f366d8cc430eb2ea1e742784b47c', 'request_id': 'req-4c37cb3d-af81-42ce-bf17-d34ee0affabc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:57.368649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a638f366d8cc430eb2ea1e742784b47c', 'request_id': 'req-4c37cb3d-af81-42ce-bf17-d34ee0affabc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:57.379800 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a638f366d8cc430eb2ea1e742784b47c', 'request_id': 'req-4c37cb3d-af81-42ce-bf17-d34ee0affabc'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:57.498203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] The token cache is being invalidate because project a638f366d8cc430eb2ea1e742784b47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:32:57.498510 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:57.499540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:57.505894 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3985/7965] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:57 2022] DELETE /identity/v3/projects/a638f366d8cc430eb2ea1e742784b47c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:57.507193 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:57.530360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303b70-281c-450f-92b6-99d766a41573 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:57.563026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:57.659414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:57.660514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:57.661766 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:57.663363 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] PATH_INFO: `/v3/users/a774917c59ce42ef9165967720b02b5f` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:57.665838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a774917c59ce42ef9165967720b02b5f)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:57.669190 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:57.913322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a774917c59ce42ef9165967720b02b5f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:57.914790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a774917c59ce42ef9165967720b02b5f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:58.024125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a774917c59ce42ef9165967720b02b5f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:58.052140 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a774917c59ce42ef9165967720b02b5f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:58.052943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8ac12904-293d-4bfa-b34b-bbe749efb027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a774917c59ce42ef9165967720b02b5f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:58.101735 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3981/7966] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:32:57 2022] DELETE /identity/v3/users/a774917c59ce42ef9165967720b02b5f => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:32:59.580386 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:32:59.590645 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:32:59.623059 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cb3d-af81-42ce-bf17-d34ee0affabc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:32:59.746385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:32:59.748506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:32:59.749088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:32:59.749820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] PATH_INFO: `/v3/projects/c5cd7d2cddd644db8fe42862fbee5bdc` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:32:59.753017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cd7d2cddd644db8fe42862fbee5bdc)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:32:59.757271 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:32:59.798837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:32:59.911959 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cd7d2cddd644db8fe42862fbee5bdc', 'request_id': 'req-1c152545-ba3b-467e-bce6-b72f72e95e8c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:59.923297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cd7d2cddd644db8fe42862fbee5bdc', 'request_id': 'req-1c152545-ba3b-467e-bce6-b72f72e95e8c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:32:59.931556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cd7d2cddd644db8fe42862fbee5bdc', 'request_id': 'req-1c152545-ba3b-467e-bce6-b72f72e95e8c'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:00.046791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] The token cache is being invalidate because project c5cd7d2cddd644db8fe42862fbee5bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:00.047221 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:00.049290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c152545-ba3b-467e-bce6-b72f72e95e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:00.051682 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3986/7967] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:32:59 2022] DELETE /identity/v3/projects/c5cd7d2cddd644db8fe42862fbee5bdc => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:00.057114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:00.057616 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:00.057904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:00.110954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:00.114508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:00.279146 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3982/7968] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:00.288108 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544624b-346a-462f-b840-792cce8e8387 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:00.288744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544624b-346a-462f-b840-792cce8e8387 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:00.289267 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544624b-346a-462f-b840-792cce8e8387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:00.326190 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b544624b-346a-462f-b840-792cce8e8387 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:00.327640 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b544624b-346a-462f-b840-792cce8e8387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:00.350322 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3987/7969] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:00.356144 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:00.369557 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e540-6780-488e-99fd-3876050f7e81 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:00.374641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:00.375530 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:00.376480 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:00.376760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:00.377656 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:33:00.378216 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:00.380723 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:00.401904 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3983/7970] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:33:00.406207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544624b-346a-462f-b840-792cce8e8387 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:00.425648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544624b-346a-462f-b840-792cce8e8387 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:00.444158 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:00.444802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:00.445157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:00.445506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:00.446260 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:00.448303 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:00.608161 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3988/7971] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:00 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:00.618278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:00.647465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863bfac-068f-4e57-8be7-3b074959da6a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:00.693269 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:00.859866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:00.860505 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:00.860951 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:00.861237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:00.861998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:00.863909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:01.035133 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3984/7972] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:00 2022] POST /identity/v3/users => generated 290 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:01.039379 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:01.056493 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556809-b63d-4653-9f94-f290ac6c9b16 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:01.072544 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:01.073176 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:01.073448 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:01.073721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:01.074410 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:01.076045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:01.104444 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3989/7973] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:01.106876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:01.122993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6484e-d0e2-4eef-a450-c0d6d17d3fab admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:01.135731 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829591a4-604d-4eb0-8f31-54bbcd5eaf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:01.136348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829591a4-604d-4eb0-8f31-54bbcd5eaf9a admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:01.136634 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829591a4-604d-4eb0-8f31-54bbcd5eaf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:01.137003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829591a4-604d-4eb0-8f31-54bbcd5eaf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:01.137706 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829591a4-604d-4eb0-8f31-54bbcd5eaf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:01.139780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829591a4-604d-4eb0-8f31-54bbcd5eaf9a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:01.168316 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3985/7974] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:01.175241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:01.206277 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1580-08d5-4b7c-9704-e709b9f3fd96 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:01.222639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:01.223568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:01.223928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:01.224401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] PATH_INFO: `/v3/projects/b7b397d2536444ba8e2cef2bb5ea48a7/users/50e48aefd9a340adac2d9742e61f4d80/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:01.269661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b397d2536444ba8e2cef2bb5ea48a7, user_id=50e48aefd9a340adac2d9742e61f4d80, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:01.276500 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:01.383637 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3990/7975] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:01 2022] PUT /identity/v3/projects/b7b397d2536444ba8e2cef2bb5ea48a7/users/50e48aefd9a340adac2d9742e61f4d80/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:01.418225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:01.418686 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:01.419010 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:01.484381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] MFA Rules not processed for user `50e48aefd9a340adac2d9742e61f4d80`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:01.486129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:01.670158 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3986/7976] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:01.674680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:01.827395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bd5a-0581-4bd8-9ee1-35f6d2d2c325 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:01.827395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:01.827395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:01.828991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:01.828991 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:01.829290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:01.831553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:01.973112 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3991/7977] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:01 2022] POST /identity/v3/projects => generated 377 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:01.978248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:02.021809 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756221fe-dc25-48fe-87c0-0bd18b75a95e None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:02.183196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:02.183995 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:02.184601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:02.185077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:02.186225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:02.192500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:02.364823 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3987/7978] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:01 2022] POST /identity/v3/users => generated 289 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:02.371160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:02.396686 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254267-9e87-4173-8a23-7b8d4de1a339 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:02.401690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:02.402332 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:02.402613 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:02.402883 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:02.403677 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:02.405289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:02.426164 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3992/7979] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:02.432231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:02.480222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba604-6d16-4b5f-9dc8-80d00a51e10f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:02.495219 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368d014-b848-43aa-a2b9-82506cf5c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:02.496289 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d014-b848-43aa-a2b9-82506cf5c37d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:02.496748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d014-b848-43aa-a2b9-82506cf5c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:02.497223 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d014-b848-43aa-a2b9-82506cf5c37d admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:02.501125 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368d014-b848-43aa-a2b9-82506cf5c37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:02.515936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368d014-b848-43aa-a2b9-82506cf5c37d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:02.552613 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3988/7980] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:02.565629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:02.572805 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e52ad9-9caf-4925-9194-4701bc5967e3 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:02.592553 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:02.593248 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:02.594294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:02.594294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] PATH_INFO: `/v3/projects/4bce9e57d9fb4b00bba2b684971755d4/users/5b5a6f0ab427450abece4eb4fb7e1416/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:02.631769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce9e57d9fb4b00bba2b684971755d4, user_id=5b5a6f0ab427450abece4eb4fb7e1416, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:02.634718 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:02.640446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:02.724492 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3993/7981] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:02 2022] PUT /identity/v3/projects/4bce9e57d9fb4b00bba2b684971755d4/users/5b5a6f0ab427450abece4eb4fb7e1416/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:02.727406 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:02.727748 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:02.728034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:02.743630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:02.760937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] MFA Rules not processed for user `5b5a6f0ab427450abece4eb4fb7e1416`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:02.762324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:02.876290 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3989/7982] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:02.877294 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:02.967000 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6cc1-c8f7-49f6-a2c8-ec7782ac413f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:02.972577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:02.973457 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:02.974041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:02.974566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:02.976089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:02.978245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:03.133749 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3994/7983] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:02 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:33:03.138165 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:03.155323 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6d1a9-ef30-4d7b-b7f5-86f6e122269a None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:03.304704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:03.304704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:03.304704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:03.304704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:03.306221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:03.306416 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:03.435078 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3990/7984] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:03 2022] POST /identity/v3/users => generated 295 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:03.439992 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:03.457522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371ce7-facd-43a5-9503-aa8bcd47dea7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:03.465532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:03.467181 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:03.467746 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:03.468174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:03.469214 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:03.471727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:03.511983 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3995/7985] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:03.513247 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:03.529761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d61ded-e8aa-4fe3-8ed4-d2c1909ca707 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:03.542747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:03.543444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:03.543610 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:03.544389 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] PATH_INFO: `/v3/projects/f0f4debdd9c64e4e9940af69c6fd586b/users/566abd37fe6241d38a1474392b830cd6/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:03.576940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f4debdd9c64e4e9940af69c6fd586b, user_id=566abd37fe6241d38a1474392b830cd6, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:03.580828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:03.686466 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3991/7986] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:03 2022] PUT /identity/v3/projects/f0f4debdd9c64e4e9940af69c6fd586b/users/566abd37fe6241d38a1474392b830cd6/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:03.690651 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:03.716035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb6d03-bbb8-4de2-b7db-63aa1a51d492 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:03.809971 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597c763-5f55-4674-87f9-6342b408627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:03.810791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597c763-5f55-4674-87f9-6342b408627d admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:03.811310 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597c763-5f55-4674-87f9-6342b408627d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:03.811843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597c763-5f55-4674-87f9-6342b408627d admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:03.814116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597c763-5f55-4674-87f9-6342b408627d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:03.816065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597c763-5f55-4674-87f9-6342b408627d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:03.837085 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3996/7987] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:03.841325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:03.861183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9313-7be8-4ee1-978f-6acc5ba6011d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:03.892341 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:03.895493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:03.896462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:03.897400 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] PATH_INFO: `/v3/projects/f0f4debdd9c64e4e9940af69c6fd586b/users/566abd37fe6241d38a1474392b830cd6/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:03.905949 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f4debdd9c64e4e9940af69c6fd586b, user_id=566abd37fe6241d38a1474392b830cd6, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:03.912873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:03.954265 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3992/7988] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:03 2022] PUT /identity/v3/projects/f0f4debdd9c64e4e9940af69c6fd586b/users/566abd37fe6241d38a1474392b830cd6/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:03.964874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:03.965160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:03.965587 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:04.040076 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] MFA Rules not processed for user `566abd37fe6241d38a1474392b830cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:04.043431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:04.179770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:04.210849 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3997/7989] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:04.223807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:04.227584 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:04.357381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:04.363872 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb072b29-a7b2-4951-9c31-d436f8a89d52 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:04.373413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:04.373413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:04.373413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:04.373673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:04.396040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:04.398628 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:04.411322 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3993/7990] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:04.546973 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:04.564511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f36022-3ff9-4020-bd9e-10007b140f1e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:04.569825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:04.570604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:04.570988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:04.571362 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:04.740961 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:04.743438 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:04.762411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3998/7991] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:10.943936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:10.943936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:11.042143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3629-f264-4770-a9f8-46ea890c111b service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:11.069409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:11.070627 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:11.071258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:11.071736 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:11.074313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:11.209552 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:11.210996 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4100-34e1-4b13-a4a9-b3af39ba3c28 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:11.226978 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3994/7992] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:14.756812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=33 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:15.465887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:15.489106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dda50-c194-4f2a-ae92-c3392038112f service cinder] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:15.501244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:15.504775 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:15.506711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:15.506711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] PATH_INFO: `/v3/users/50e48aefd9a340adac2d9742e61f4d80` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:15.507652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e48aefd9a340adac2d9742e61f4d80)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:15.512120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:15.786240 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e48aefd9a340adac2d9742e61f4d80'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:15.823023 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e48aefd9a340adac2d9742e61f4d80'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:15.862431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e48aefd9a340adac2d9742e61f4d80'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:15.863573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e48aefd9a340adac2d9742e61f4d80'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:15.865371 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e48aefd9a340adac2d9742e61f4d80'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:15.996224 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 3999/7993] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:15 2022] DELETE /identity/v3/users/50e48aefd9a340adac2d9742e61f4d80 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:15.996600 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:15.997239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:15.997239 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:16.049212 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:16.050508 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:16.219150 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3995/7994] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:16.243905 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:16.246289 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:16.706168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8cba-4ae6-4d1e-8679-02e3a2799df0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:16.711637 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:16.712376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:16.712989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:16.713489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:16.728017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:16.729843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:16.756982 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4000/7995] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:17.989760 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:17.991441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:18.010839 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81cd1-e803-4bf6-9b17-0fddfa863f97 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:18.029044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:18.029710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:18.030067 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:18.030305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] PATH_INFO: `/v3/projects/b7b397d2536444ba8e2cef2bb5ea48a7` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:18.032112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b397d2536444ba8e2cef2bb5ea48a7)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:18.041630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:18.251147 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:18.268502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b397d2536444ba8e2cef2bb5ea48a7', 'request_id': 'req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.274734 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b397d2536444ba8e2cef2bb5ea48a7', 'request_id': 'req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.283527 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b397d2536444ba8e2cef2bb5ea48a7', 'request_id': 'req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.382793 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] The token cache is being invalidate because project b7b397d2536444ba8e2cef2bb5ea48a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:18.383302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.384081 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.386460 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3996/7996] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:17 2022] DELETE /identity/v3/projects/b7b397d2536444ba8e2cef2bb5ea48a7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:18.392085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:18.405347 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bf1f5-4ea5-4746-983a-69ce3bacc3a5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:18.543690 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:18.544575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:18.545058 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:18.545542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] PATH_INFO: `/v3/users/5b5a6f0ab427450abece4eb4fb7e1416` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:18.547149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5a6f0ab427450abece4eb4fb7e1416)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:18.549321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:18.573064 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:18.785133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:18.786680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:18.817122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5a6f0ab427450abece4eb4fb7e1416'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.852802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5a6f0ab427450abece4eb4fb7e1416'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.864658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5a6f0ab427450abece4eb4fb7e1416'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.866241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5a6f0ab427450abece4eb4fb7e1416'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.873626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5a6f0ab427450abece4eb4fb7e1416'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:18.941130 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360a2ed-870d-4ed1-b475-ca1f8f9f9c11 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:18.950403 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057be537-c198-409e-a729-f389bf7969fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:18.951581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be537-c198-409e-a729-f389bf7969fa service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:18.951925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be537-c198-409e-a729-f389bf7969fa service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:18.952253 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be537-c198-409e-a729-f389bf7969fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:18.955027 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-057be537-c198-409e-a729-f389bf7969fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:18.980032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057be537-c198-409e-a729-f389bf7969fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:18.982772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057be537-c198-409e-a729-f389bf7969fa service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:19.014198 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4001/7997] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:18 2022] DELETE /identity/v3/users/5b5a6f0ab427450abece4eb4fb7e1416 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:19.028685 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3997/7998] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:33:19.564670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:19.566384 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:19.692769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887dec9-8261-485d-832c-aee9b4b0304a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:19.709330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:19.710042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:19.711290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:19.711573 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] PATH_INFO: `/v3/users/eab435220eb1424985b28ec0642ef70e` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:19.713193 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab435220eb1424985b28ec0642ef70e)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:19.716674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:19.894387 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057be537-c198-409e-a729-f389bf7969fa service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:19.901276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-057be537-c198-409e-a729-f389bf7969fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:19.935532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057be537-c198-409e-a729-f389bf7969fa service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:19.946456 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:19.947119 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:19.947397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:19.947895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] PATH_INFO: `/v3/projects/4bce9e57d9fb4b00bba2b684971755d4` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:19.949357 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bce9e57d9fb4b00bba2b684971755d4)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:19.951618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:20.027314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab435220eb1424985b28ec0642ef70e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.042744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab435220eb1424985b28ec0642ef70e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.051965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab435220eb1424985b28ec0642ef70e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.052759 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab435220eb1424985b28ec0642ef70e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.053558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab435220eb1424985b28ec0642ef70e'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.105121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bce9e57d9fb4b00bba2b684971755d4', 'request_id': 'req-377133ab-1a7e-48da-bb46-b00e7bf03dae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.123449 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bce9e57d9fb4b00bba2b684971755d4', 'request_id': 'req-377133ab-1a7e-48da-bb46-b00e7bf03dae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.143894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bce9e57d9fb4b00bba2b684971755d4', 'request_id': 'req-377133ab-1a7e-48da-bb46-b00e7bf03dae'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.152363 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4002/7999] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:19 2022] DELETE /identity/v3/users/eab435220eb1424985b28ec0642ef70e => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:20.227618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] The token cache is being invalidate because project 4bce9e57d9fb4b00bba2b684971755d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:20.228075 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.229297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.234757 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3998/8000] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:19 2022] DELETE /identity/v3/projects/4bce9e57d9fb4b00bba2b684971755d4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:20.236071 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:20.237772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:20.258374 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:20.319963 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10d06-6814-4aff-9492-ad13dea1b88e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:20.325882 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:20.326908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:20.327197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:20.327470 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] PATH_INFO: `/v3/users/566abd37fe6241d38a1474392b830cd6` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:20.328710 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=566abd37fe6241d38a1474392b830cd6)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:20.331200 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:20.603388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566abd37fe6241d38a1474392b830cd6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.624812 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566abd37fe6241d38a1474392b830cd6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.633478 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566abd37fe6241d38a1474392b830cd6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.634582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566abd37fe6241d38a1474392b830cd6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.635203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d467d4a3-1273-4402-90a0-6a74712af264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566abd37fe6241d38a1474392b830cd6'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.648710 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:20.652413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:20.702803 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:20.740316 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377133ab-1a7e-48da-bb46-b00e7bf03dae admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:20.747577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:20.747577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:20.747577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:20.747577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] PATH_INFO: `/v3/projects/72a87c4db6d74cc1a996162e5ad35418` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:20.749202 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a87c4db6d74cc1a996162e5ad35418)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:20.752079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:20.815162 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4003/8001] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:20 2022] DELETE /identity/v3/users/566abd37fe6241d38a1474392b830cd6 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:20.981745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a87c4db6d74cc1a996162e5ad35418', 'request_id': 'req-ffabfd59-f137-4ff3-bc26-e2cbf483896a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.989921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a87c4db6d74cc1a996162e5ad35418', 'request_id': 'req-ffabfd59-f137-4ff3-bc26-e2cbf483896a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:20.997985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a87c4db6d74cc1a996162e5ad35418', 'request_id': 'req-ffabfd59-f137-4ff3-bc26-e2cbf483896a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:21.112015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] The token cache is being invalidate because project 72a87c4db6d74cc1a996162e5ad35418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:21.112800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:21.113612 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ffabfd59-f137-4ff3-bc26-e2cbf483896a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:21.116427 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 3999/8002] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:20 2022] DELETE /identity/v3/projects/72a87c4db6d74cc1a996162e5ad35418 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:33:21.121648 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:21.122445 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:21.122867 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:21.155485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:21.156908 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:21.282562 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4004/8003] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:21.291046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:21.291345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:21.291630 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:21.315689 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:21.316999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:21.327782 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4000/8004] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:21.337139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:21.349996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb69fb-081b-4fcd-bee6-569bbde9282f None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:21.355819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:21.357266 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:21.357695 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:21.358160 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:21.358836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:33:21.360406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:21.361720 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:21.386822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4005/8005] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:33:21.388874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:21.422930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f4d90-4337-440b-b6ae-ad3566a6dd5d None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:21.433673 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:21.434428 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:21.434767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:21.435098 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:21.435805 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:21.438220 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:21.531318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:21.534220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:21.559133 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4001/8006] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:21 2022] POST /identity/v3/projects => generated 395 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:21.566194 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:21.591988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56d47-1df2-4390-bb89-549d636e216e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:21.639850 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:21.775451 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:21.776152 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:21.776449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:21.777207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] PATH_INFO: `/v3/projects/f0f4debdd9c64e4e9940af69c6fd586b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:21.780810 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f4debdd9c64e4e9940af69c6fd586b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:21.784207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:21.801170 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c635a-2999-46c0-b05a-bf0a65324f67 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:21.806156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:21.807056 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:21.807519 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:21.807790 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:21.808443 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:21.810468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:21.949105 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4002/8007] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:21 2022] POST /identity/v3/users => generated 298 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:33:21.955409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:21.969626 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36a26-2e48-4d47-940f-914ce1b0a65a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:21.988764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f4debdd9c64e4e9940af69c6fd586b', 'request_id': 'req-c7eb9701-e3a3-4869-bbf6-58152658e0fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:21.997475 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f4debdd9c64e4e9940af69c6fd586b', 'request_id': 'req-c7eb9701-e3a3-4869-bbf6-58152658e0fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:22.005532 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f4debdd9c64e4e9940af69c6fd586b', 'request_id': 'req-c7eb9701-e3a3-4869-bbf6-58152658e0fe'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:22.023643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:22.083057 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.084824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.085237 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.095842 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.096807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.098800 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:22.117804 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4003/8008] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:33:22.122470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:22.134898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773b4a8-5000-420c-b94a-a577fe88ecda admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:22.142666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.144362 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.144838 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.149157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.149157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.149157 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:22.163653 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] The token cache is being invalidate because project f0f4debdd9c64e4e9940af69c6fd586b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:22.170924 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:22.175341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c7eb9701-e3a3-4869-bbf6-58152658e0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:22.177731 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4006/8009] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:21 2022] DELETE /identity/v3/projects/f0f4debdd9c64e4e9940af69c6fd586b => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:22.187333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f75f-48dc-45d0-9f24-3da0221d3d79 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.187333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f75f-48dc-45d0-9f24-3da0221d3d79 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.187333 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f75f-48dc-45d0-9f24-3da0221d3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.188150 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4004/8010] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:33:22.190040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:22.195353 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:22.226991 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d17d-4666-4480-8aea-419c3175a061 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:22.242437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d6668-c2dc-4fbe-8130-4ddde3bffe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.244325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6668-c2dc-4fbe-8130-4ddde3bffe3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.246424 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6668-c2dc-4fbe-8130-4ddde3bffe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.249983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6668-c2dc-4fbe-8130-4ddde3bffe3b admin admin] PATH_INFO: `/v3/projects/e55666f817734da483b0d9e84d672789/users/42fd857679bd4259abbe78897a56bca1/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.250112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-36e8f75f-48dc-45d0-9f24-3da0221d3d79 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:22.254535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-36e8f75f-48dc-45d0-9f24-3da0221d3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:22.287909 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4007/8011] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:22.297395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.298030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.298549 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.303336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d6668-c2dc-4fbe-8130-4ddde3bffe3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55666f817734da483b0d9e84d672789, user_id=42fd857679bd4259abbe78897a56bca1, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.308021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d6668-c2dc-4fbe-8130-4ddde3bffe3b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:22.340694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:22.342096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:22.356007 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4008/8012] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:22.362107 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:22.373734 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb732cb-1cd0-4a91-806d-5192fe0d606e None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:22.380506 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.381246 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.381767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.382116 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.383792 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:33:22.384330 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.387736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:22.421236 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4005/8013] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:22 2022] PUT /identity/v3/projects/e55666f817734da483b0d9e84d672789/users/42fd857679bd4259abbe78897a56bca1/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:22.426877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.427278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.427787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.430096 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4009/8014] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:33:22.443711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:22.461542 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:22.464539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:22.465916 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13e84-7d28-4720-8ee3-5f0f2b1bce3b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:22.580939 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4006/8015] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:22.590355 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:22.595295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:22.603917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.604574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.605556 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.606915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.606915 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.611537 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:22.713188 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625955d-a225-47cc-9751-e5a47a9d4ee7 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:22.719258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.720222 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.720888 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.721392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.738221 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.740859 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:22.741286 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4010/8016] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:22 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:22.745912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:22.756524 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4007/8017] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:33:22.767818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:22.847290 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3263f-4bf6-4394-80f7-cb8564e7d571 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:22.853798 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:22.855112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:22.855980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:22.856367 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:22.857127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:22.860125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:23.018849 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4011/8018] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:22 2022] POST /identity/v3/users => generated 291 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:23.020855 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:23.032623 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d56c-dd41-4346-babe-46f80650bc75 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:23.039136 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:23.040040 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:23.040325 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:23.040607 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:23.041572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:23.043577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:23.055279 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4008/8019] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:23.060485 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:23.072936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61354-e858-416a-9971-6efdb8d08d1d admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:23.079014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01e5d-78d0-46ad-a64a-1bd5ad2bf860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:23.079590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01e5d-78d0-46ad-a64a-1bd5ad2bf860 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:23.079881 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01e5d-78d0-46ad-a64a-1bd5ad2bf860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:23.080164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01e5d-78d0-46ad-a64a-1bd5ad2bf860 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:23.080888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01e5d-78d0-46ad-a64a-1bd5ad2bf860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:23.082557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01e5d-78d0-46ad-a64a-1bd5ad2bf860 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:23.100266 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4012/8020] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:23.106802 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:23.117301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104acb-8e12-4ec9-a925-cfcd9fa321d3 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:23.122583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:23.123290 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:23.123517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:23.123795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] PATH_INFO: `/v3/projects/2a29ba5062cc46e29425649e960e808c/users/6d30674cd087451fa6a05ce6e1e2cf15/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:23.152129 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a29ba5062cc46e29425649e960e808c, user_id=6d30674cd087451fa6a05ce6e1e2cf15, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:23.155254 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:23.320889 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:23.327120 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4009/8021] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:23 2022] PUT /identity/v3/projects/2a29ba5062cc46e29425649e960e808c/users/6d30674cd087451fa6a05ce6e1e2cf15/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:23.343459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10c895-a4a6-4e39-a412-993357c95eaa None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:23.344061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10c895-a4a6-4e39-a412-993357c95eaa None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:23.344579 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10c895-a4a6-4e39-a412-993357c95eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:23.373504 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3e10c895-a4a6-4e39-a412-993357c95eaa None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:23.378477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3e10c895-a4a6-4e39-a412-993357c95eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:23.483982 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4013/8022] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:23.529563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:23.537068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:23.657954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb4fcf-05c2-483f-b7c1-cc32b9fe1fe5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:23.666833 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c996d8-f7e5-4df6-a618-dbef68659b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:23.668174 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c996d8-f7e5-4df6-a618-dbef68659b57 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:23.668577 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c996d8-f7e5-4df6-a618-dbef68659b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:23.668955 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c996d8-f7e5-4df6-a618-dbef68659b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:23.680934 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c996d8-f7e5-4df6-a618-dbef68659b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:23.684046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c996d8-f7e5-4df6-a618-dbef68659b57 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:23.695062 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4010/8023] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:33.473826 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:33.690460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=27 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:34.803391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:34.803855 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:34.803933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:34.897972 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] MFA Rules not processed for user `42fd857679bd4259abbe78897a56bca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:34.899244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:35.134061 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4014/8024] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:35.145433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:35.145433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:35.145433 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:35.206102 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] MFA Rules not processed for user `42fd857679bd4259abbe78897a56bca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:35.220465 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:35.240921 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4011/8025] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:35.256481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:35.265888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:35.294538 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:35.298479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:35.372062 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae952-ce33-4195-a67c-6b889bcec403 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:35.377728 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:35.378974 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:35.379419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:35.379841 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] PATH_INFO: `/v3/users/b0facde714a347dbaf3a6f6bca7e8306` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:35.381470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0facde714a347dbaf3a6f6bca7e8306)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:35.385297 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:35.495985 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aa4f8-df97-4e9d-9c3c-b706055d4e60 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:35.520112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b222a51-1e62-4f37-97ba-eabdfc8aa995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:35.520769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b222a51-1e62-4f37-97ba-eabdfc8aa995 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:35.521057 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b222a51-1e62-4f37-97ba-eabdfc8aa995 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:35.521339 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b222a51-1e62-4f37-97ba-eabdfc8aa995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:35.543530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b222a51-1e62-4f37-97ba-eabdfc8aa995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:35.545241 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b222a51-1e62-4f37-97ba-eabdfc8aa995 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:35.564816 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4015/8026] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:35 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:35.643012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0facde714a347dbaf3a6f6bca7e8306'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:35.645434 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0facde714a347dbaf3a6f6bca7e8306'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:35.712621 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0facde714a347dbaf3a6f6bca7e8306'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:35.727283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0facde714a347dbaf3a6f6bca7e8306'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:35.729260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0facde714a347dbaf3a6f6bca7e8306'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:35.791772 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4012/8027] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:35 2022] DELETE /identity/v3/users/b0facde714a347dbaf3a6f6bca7e8306 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:35.793499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189ef71-79e6-4eac-b409-660bc10aa9cc None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:35.794026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189ef71-79e6-4eac-b409-660bc10aa9cc None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:35.794562 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189ef71-79e6-4eac-b409-660bc10aa9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:35.885414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-c189ef71-79e6-4eac-b409-660bc10aa9cc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:35.887626 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-c189ef71-79e6-4eac-b409-660bc10aa9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:36.130102 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4016/8028] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:36.152318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:36.155987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:36.399261 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603e2a-6598-4ba4-9572-5000ccdb8d27 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:36.419376 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:36.420015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:36.420364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:36.420564 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:36.492105 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:36.497199 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:36.549416 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4013/8029] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:33:36.739639 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:36.741020 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:36.741913 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:36.853199 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] MFA Rules not processed for user `6d30674cd087451fa6a05ce6e1e2cf15`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:36.861012 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:36.881325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=100 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:37.048071 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4017/8030] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:37.052498 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.054491 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:37.085906 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a27a7-bc05-4696-895a-e0cb59bef70e service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.092211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.093468 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.093759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.094532 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.098566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.098566 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.185809 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4014/8031] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:37 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:37.186607 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.204311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cc0e2-4129-486c-9d92-03563a640515 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.242457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.242457 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:37.337264 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.337928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.338219 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.338496 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.339400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.342168 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.370296 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:37.398156 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5353-318a-4a29-8f25-016488e0493c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.403523 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.404421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.404700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.405135 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] PATH_INFO: `/v3/projects/ed03447844244decb86aed85d040005a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.407597 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed03447844244decb86aed85d040005a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.417493 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.419061 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4018/8032] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:37 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:37.419999 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.431647 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3f7db-4f06-4e58-8b1e-01440f63ed9c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.438387 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.439209 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.439328 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.439557 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.440220 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.443002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.459446 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4019/8033] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:37.463911 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.492162 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa913a1-59d7-4710-8d88-bce79301a03f admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.503581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.504716 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.505164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.505436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] PATH_INFO: `/v3/projects/39d774b89d2d4495b652532fadcaeed9/users/9b1ed8eda42345ae9dcdfa77c94090b5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.526007 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d774b89d2d4495b652532fadcaeed9, user_id=9b1ed8eda42345ae9dcdfa77c94090b5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.528888 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.620380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4020/8034] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:37 2022] PUT /identity/v3/projects/39d774b89d2d4495b652532fadcaeed9/users/9b1ed8eda42345ae9dcdfa77c94090b5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:33:37.626388 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.644149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed03447844244decb86aed85d040005a', 'request_id': 'req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:37.659936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed03447844244decb86aed85d040005a', 'request_id': 'req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:37.685601 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed03447844244decb86aed85d040005a', 'request_id': 'req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:37.808126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] The token cache is being invalidate because project ed03447844244decb86aed85d040005a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:37.808502 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:37.808945 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b9d37-56b8-4d90-a49f-ceecdefda8a0 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.809563 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-b0df0c1f-3cba-4a76-8123-4e17bc51cd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:37.813200 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4015/8035] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:37 2022] DELETE /identity/v3/projects/ed03447844244decb86aed85d040005a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:37.819459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.819819 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.820016 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.821534 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.823215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.823982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.824917 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.826914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.830654 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.834939 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:37.852125 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4021/8036] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:37.857318 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:37.861901 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:37.885227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73680-09a1-4141-90a3-549d01e9efb4 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:37.897117 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa74632-15f9-4800-a24b-ebeb5f7f1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:37.898128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74632-15f9-4800-a24b-ebeb5f7f1d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:37.898834 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74632-15f9-4800-a24b-ebeb5f7f1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:37.899226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74632-15f9-4800-a24b-ebeb5f7f1d77 admin admin] PATH_INFO: `/v3/projects/39d774b89d2d4495b652532fadcaeed9/users/9b1ed8eda42345ae9dcdfa77c94090b5/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:37.903530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74632-15f9-4800-a24b-ebeb5f7f1d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d774b89d2d4495b652532fadcaeed9, user_id=9b1ed8eda42345ae9dcdfa77c94090b5, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:37.904680 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:37.908084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74632-15f9-4800-a24b-ebeb5f7f1d77 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:37.911065 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:37.928710 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4022/8037] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:37 2022] PUT /identity/v3/projects/39d774b89d2d4495b652532fadcaeed9/users/9b1ed8eda42345ae9dcdfa77c94090b5/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:38.061583 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4016/8038] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:38.076196 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.076708 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.076819 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.131170 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:38.139649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:38.165906 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4023/8039] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:38.169352 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:38.189315 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98425108-66f0-4c15-abc9-a566abfcb8be None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:38.202709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:38.204293 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.204795 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.205274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.206217 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:33:38.206643 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:38.209236 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:38.231298 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4017/8040] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:33:38.236660 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:38.255380 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb49a3e-6b3f-4f74-afb6-0daf7225103a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:38.281528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:38.282831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.282831 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.285611 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.286582 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:38.292307 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:38.436038 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4024/8041] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:38 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:33:38.441139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:38.457442 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46744-5a32-442f-8fa6-74985572e285 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:38.620348 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:38.620985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.621272 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.621553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.622248 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:38.624663 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:38.658459 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:38.752509 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4018/8042] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:38 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:38.756740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:38.774228 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750719e7-ddb9-4df3-a4f0-176fbd2d9589 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:38.794535 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:38.795254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.795879 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.796187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.796964 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:38.799409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:38.836057 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4025/8043] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:38.840324 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:38.880161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c629-ba59-4d60-a38a-31291f9633a4 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:38.894421 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d1999-611d-4421-aba9-d88b61d3e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:38.898876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d1999-611d-4421-aba9-d88b61d3e7df admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.898876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d1999-611d-4421-aba9-d88b61d3e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.898876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d1999-611d-4421-aba9-d88b61d3e7df admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.898876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d1999-611d-4421-aba9-d88b61d3e7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:38.898876 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d1999-611d-4421-aba9-d88b61d3e7df admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:38.917996 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4019/8044] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:38.918174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:38.929297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077d33-232d-4e82-a1ec-cc21ae19e2dc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:38.957376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:38.959216 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:38.959769 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:38.961788 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] PATH_INFO: `/v3/projects/0a2a67c7a55b4aa89f6f80d6b4d14fc5/users/0ea4bfdc64e2413db7c2c221bf111dee/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:38.995353 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2a67c7a55b4aa89f6f80d6b4d14fc5, user_id=0ea4bfdc64e2413db7c2c221bf111dee, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:38.998612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:39.916295 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4026/8045] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:38 2022] PUT /identity/v3/projects/0a2a67c7a55b4aa89f6f80d6b4d14fc5/users/0ea4bfdc64e2413db7c2c221bf111dee/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:39.935072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:39.935624 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:39.938479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:39.981153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] MFA Rules not processed for user `0ea4bfdc64e2413db7c2c221bf111dee`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:39.982669 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:40.074342 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4020/8046] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:40.085344 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:40.087351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:40.277591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebcb0-7e89-42bd-852f-a9b44dc8c9f7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:40.294002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc52716-af2d-4ad3-849f-6f6cb2498179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:40.294856 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52716-af2d-4ad3-849f-6f6cb2498179 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:40.295296 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52716-af2d-4ad3-849f-6f6cb2498179 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:40.295743 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52716-af2d-4ad3-849f-6f6cb2498179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:40.323843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc52716-af2d-4ad3-849f-6f6cb2498179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:40.325509 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc52716-af2d-4ad3-849f-6f6cb2498179 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:40.348688 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4027/8047] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:41.929080 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:42.164956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dbe15-709f-40df-826a-cc0b60c05db5 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:42.182698 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:42.184053 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:42.184332 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:42.184619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] PATH_INFO: `/v3/users/0ea4bfdc64e2413db7c2c221bf111dee` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:42.186012 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea4bfdc64e2413db7c2c221bf111dee)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:42.191770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:42.516821 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea4bfdc64e2413db7c2c221bf111dee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:42.521606 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea4bfdc64e2413db7c2c221bf111dee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:42.640641 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea4bfdc64e2413db7c2c221bf111dee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:42.651182 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea4bfdc64e2413db7c2c221bf111dee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:42.668960 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea4bfdc64e2413db7c2c221bf111dee'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:42.711215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:42.739972 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4021/8048] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:41 2022] DELETE /identity/v3/users/0ea4bfdc64e2413db7c2c221bf111dee => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:42.741772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:42.742259 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:42.742630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:42.807236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:42.810956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:43.001946 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4028/8049] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:33:43.013327 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:43.015524 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:43.163594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4ced-8f43-41f3-81d6-88c6e9d1c033 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:43.168242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591efda-e219-4030-a94d-0f3e3220f78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:43.169300 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591efda-e219-4030-a94d-0f3e3220f78a service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:43.169774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591efda-e219-4030-a94d-0f3e3220f78a service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:43.170230 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591efda-e219-4030-a94d-0f3e3220f78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:43.189747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591efda-e219-4030-a94d-0f3e3220f78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:43.192112 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591efda-e219-4030-a94d-0f3e3220f78a service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:43.236657 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4022/8050] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:44.071576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:44.071576 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:44.105399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca15d8-dfe5-49e5-8987-806e63ae5c0a None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:44.127717 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:44.132414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:44.132719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:44.133080 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] PATH_INFO: `/v3/projects/0a2a67c7a55b4aa89f6f80d6b4d14fc5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:44.134530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2a67c7a55b4aa89f6f80d6b4d14fc5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:44.142726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:44.212019 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:44.396237 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2a67c7a55b4aa89f6f80d6b4d14fc5', 'request_id': 'req-1c6a065d-ffcc-4386-9618-15281ccd2e14'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:44.421897 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2a67c7a55b4aa89f6f80d6b4d14fc5', 'request_id': 'req-1c6a065d-ffcc-4386-9618-15281ccd2e14'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:44.430514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2a67c7a55b4aa89f6f80d6b4d14fc5', 'request_id': 'req-1c6a065d-ffcc-4386-9618-15281ccd2e14'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:44.537820 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] The token cache is being invalidate because project 0a2a67c7a55b4aa89f6f80d6b4d14fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:44.538499 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:44.539591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1c6a065d-ffcc-4386-9618-15281ccd2e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:44.541599 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4029/8051] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:44 2022] DELETE /identity/v3/projects/0a2a67c7a55b4aa89f6f80d6b4d14fc5 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:44.547347 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:44.547761 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:44.548013 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:44.574371 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:44.576183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:44.692099 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4023/8052] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:44.699494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:44.699763 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:44.700112 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:44.745368 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:44.748135 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:44.767346 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4030/8053] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:44.771288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:44.783937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edecb16-4df6-467b-9306-d060aec9ebdc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:44.789713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:44.789914 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:44.790154 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:44.790343 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:44.798531 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:33:44.800113 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:44.802674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:44.820624 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4024/8054] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:33:44.824753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:44.839280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14131b-0f16-4f3e-90af-ddabf8d494f5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:44.879880 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:44.880511 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:44.880818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:44.881088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:44.883401 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:44.887032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:44.989081 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4031/8055] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:44 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:44.993304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:45.035213 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4365d8-0973-419d-ada1-ce873a4d086d admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:45.194745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:45.195939 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:45.196485 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:45.196993 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:45.197904 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:45.200517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:45.328592 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4025/8056] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:44 2022] POST /identity/v3/users => generated 291 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:45.330809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:45.355250 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3566-5644-43af-84e1-ef37fc46288b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:45.371014 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:45.375274 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:45.375638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:45.378205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:45.378946 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:45.386936 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:45.418953 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4032/8057] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:45.423384 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:45.443017 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd074bd-b60f-4cf5-a7ce-4b29b5c9deb5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:45.461705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029802-9364-476e-9a21-459ad27d8a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:45.462730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029802-9364-476e-9a21-459ad27d8a8b admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:45.463258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029802-9364-476e-9a21-459ad27d8a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:45.463757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029802-9364-476e-9a21-459ad27d8a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:45.464633 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029802-9364-476e-9a21-459ad27d8a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:45.468796 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029802-9364-476e-9a21-459ad27d8a8b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:45.486890 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:45.504682 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4026/8058] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:45.508577 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:45.523770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0fc85-4a34-400a-8399-b324c15eb88b admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:45.542280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:45.543311 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:45.543953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:45.544409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] PATH_INFO: `/v3/projects/1b26b90f49184bed89e2bcbbd09fbd2a/users/e8dd4110597846d7b62c7dcc5d118102/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:45.590110 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b26b90f49184bed89e2bcbbd09fbd2a, user_id=e8dd4110597846d7b62c7dcc5d118102, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:45.593740 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:45.682846 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4033/8059] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:45 2022] PUT /identity/v3/projects/1b26b90f49184bed89e2bcbbd09fbd2a/users/e8dd4110597846d7b62c7dcc5d118102/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:45.685197 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:45.685638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:45.685778 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:45.775258 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] MFA Rules not processed for user `e8dd4110597846d7b62c7dcc5d118102`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:45.778143 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:45.953691 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4027/8060] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:45.958008 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:46.084842 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d065e4-8e91-40c9-b693-8471d95d7886 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:46.097887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:46.097887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:46.097887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:46.097887 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:46.098507 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:46.100453 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:46.299159 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4034/8061] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:45 2022] POST /identity/v3/projects => generated 381 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:33:46.300430 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:46.324133 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299279c8-9248-4ebc-9efb-c7086c72eb91 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:46.430954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:46.434032 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:46.434426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:46.434828 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:46.436060 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:46.439360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:46.540076 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4028/8062] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:46 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:46.544218 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:46.561315 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fece5d-9585-475e-a230-eab2284fb459 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:46.568261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:46.569395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:46.569750 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:46.570140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:46.571082 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:46.572840 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:46.586286 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4035/8063] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:46.590518 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:46.604033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72c0d4-5805-4239-95e9-64777ff4487a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:46.610142 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:46.611002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:46.611295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:46.613169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] PATH_INFO: `/v3/projects/88a4b55457c04bae9f9988d566f29c63/users/bd33a8d3cd7c412ab133d19ea1aae5c4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:46.648580 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a4b55457c04bae9f9988d566f29c63, user_id=bd33a8d3cd7c412ab133d19ea1aae5c4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:46.651936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:46.757891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4029/8064] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:46 2022] PUT /identity/v3/projects/88a4b55457c04bae9f9988d566f29c63/users/bd33a8d3cd7c412ab133d19ea1aae5c4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:46.765773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:46.785662 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cba1ea-c0bb-4982-a380-43d2220528e1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:46.821017 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:46.990727 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a57c4-d2ad-483d-b82d-b24511271605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:46.991463 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a57c4-d2ad-483d-b82d-b24511271605 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:46.991952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a57c4-d2ad-483d-b82d-b24511271605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:46.992297 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a57c4-d2ad-483d-b82d-b24511271605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:46.994139 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a57c4-d2ad-483d-b82d-b24511271605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:46.999566 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a57c4-d2ad-483d-b82d-b24511271605 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:47.031079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:47.031619 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4036/8065] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:47.048824 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f268aa-6bb5-4aeb-97cb-5934ad663b1e admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:47.064274 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:47.065163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:47.065447 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:47.065950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] PATH_INFO: `/v3/projects/88a4b55457c04bae9f9988d566f29c63/users/bd33a8d3cd7c412ab133d19ea1aae5c4/roles/5f91ad37e210416db6e993bd952ab9e3` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:47.069089 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a4b55457c04bae9f9988d566f29c63, user_id=bd33a8d3cd7c412ab133d19ea1aae5c4, role_id=5f91ad37e210416db6e993bd952ab9e3)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:47.079150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:47.113202 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4030/8066] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:47 2022] PUT /identity/v3/projects/88a4b55457c04bae9f9988d566f29c63/users/bd33a8d3cd7c412ab133d19ea1aae5c4/roles/5f91ad37e210416db6e993bd952ab9e3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:47.115049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:47.115414 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:47.115732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:47.178694 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] MFA Rules not processed for user `bd33a8d3cd7c412ab133d19ea1aae5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:47.179965 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:47.477420 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4037/8067] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:47.502581 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:47.505444 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:47.645501 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:47.683372 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495d4fa-325e-4c46-bc36-53abf7eda42b admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:47.703437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40565c15-d558-4a5c-8e0f-338d0437a119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:47.704153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40565c15-d558-4a5c-8e0f-338d0437a119 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:47.704452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40565c15-d558-4a5c-8e0f-338d0437a119 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:47.704741 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40565c15-d558-4a5c-8e0f-338d0437a119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:47.724319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40565c15-d558-4a5c-8e0f-338d0437a119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:47.726004 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40565c15-d558-4a5c-8e0f-338d0437a119 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:47.749633 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4031/8068] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:48.567592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:48.771672 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c51f-94ea-43fe-a58b-36140eb61df5 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:48.781156 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:48.782042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:48.790096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:48.790096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] PATH_INFO: `/v3/users/e8dd4110597846d7b62c7dcc5d118102` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:48.790096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dd4110597846d7b62c7dcc5d118102)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:48.790096 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:49.096205 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:49.106391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dd4110597846d7b62c7dcc5d118102'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:49.126753 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dd4110597846d7b62c7dcc5d118102'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:49.137982 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dd4110597846d7b62c7dcc5d118102'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:49.141481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dd4110597846d7b62c7dcc5d118102'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:49.143032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dd4110597846d7b62c7dcc5d118102'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:49.383938 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4038/8069] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:48 2022] DELETE /identity/v3/users/e8dd4110597846d7b62c7dcc5d118102 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:33:49.389952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102b112-6d3a-4a6a-8fd1-0264f0245326 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:49.390925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102b112-6d3a-4a6a-8fd1-0264f0245326 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:49.391440 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102b112-6d3a-4a6a-8fd1-0264f0245326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:49.438050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5102b112-6d3a-4a6a-8fd1-0264f0245326 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:49.439322 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5102b112-6d3a-4a6a-8fd1-0264f0245326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:49.536987 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4032/8070] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:49.550254 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:49.551836 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:49.641719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d40d-f1e9-4461-bffd-8a6f71bfd459 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:49.647554 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:49.648817 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:49.649390 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:49.649914 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:49.672689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:49.674133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:49.687729 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4039/8071] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:50.459585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:50.460059 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:50.460533 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:50.522483 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] MFA Rules not processed for user `9b1ed8eda42345ae9dcdfa77c94090b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:50.523870 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:50.609253 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4033/8072] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:50.624561 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:50.626512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:50.732540 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b7a2-acfa-42e6-9e56-ffeab897bda6 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:50.738419 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:50.739033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:50.739316 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:50.739612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:50.749349 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:50.751016 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:50.761771 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4040/8073] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:50.771756 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:50.774637 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:50.793747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bccf7c-3324-41d3-a4ef-899f0184568b None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:50.800109 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:50.801950 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:50.802242 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:50.802522 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] PATH_INFO: `/v3/projects/1b26b90f49184bed89e2bcbbd09fbd2a` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:50.803937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b26b90f49184bed89e2bcbbd09fbd2a)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:50.805987 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:50.954713 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b26b90f49184bed89e2bcbbd09fbd2a', 'request_id': 'req-ec5ef858-a215-42a9-8f3d-23737ad56ca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:50.971284 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b26b90f49184bed89e2bcbbd09fbd2a', 'request_id': 'req-ec5ef858-a215-42a9-8f3d-23737ad56ca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:50.980849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b26b90f49184bed89e2bcbbd09fbd2a', 'request_id': 'req-ec5ef858-a215-42a9-8f3d-23737ad56ca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:50.984652 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:51.204226 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] The token cache is being invalidate because project 1b26b90f49184bed89e2bcbbd09fbd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:51.204638 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.205382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.207268 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4034/8074] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:50 2022] DELETE /identity/v3/projects/1b26b90f49184bed89e2bcbbd09fbd2a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:51.218083 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:51.230505 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe842c-abf9-4dc0-959f-3330371fdfff service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:51.278129 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:51.296539 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:51.297300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:51.297608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:51.297997 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] PATH_INFO: `/v3/users/bd33a8d3cd7c412ab133d19ea1aae5c4` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:51.299459 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd33a8d3cd7c412ab133d19ea1aae5c4)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:51.301399 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:51.449022 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:51.452704 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:51.560956 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ef858-a215-42a9-8f3d-23737ad56ca1 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:51.570670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:51.571307 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:51.572041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:51.572470 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:51.578707 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:51.609423 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:51.611536 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:51.634312 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd33a8d3cd7c412ab133d19ea1aae5c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.634535 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4035/8075] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:51.651864 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd33a8d3cd7c412ab133d19ea1aae5c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.661103 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd33a8d3cd7c412ab133d19ea1aae5c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.661947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd33a8d3cd7c412ab133d19ea1aae5c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.662742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-de9bd797-33e1-4ad3-9470-302f88b4a9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd33a8d3cd7c412ab133d19ea1aae5c4'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:51.755430 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4041/8076] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:33:51 2022] DELETE /identity/v3/users/bd33a8d3cd7c412ab133d19ea1aae5c4 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:52.506455 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:52.509687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:52.525879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63462e-f7ef-498a-8379-396d6ac63827 service placement] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:52.591590 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:52.592646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:52.592646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:52.592851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] PATH_INFO: `/v3/projects/88a4b55457c04bae9f9988d566f29c63` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:52.595806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a4b55457c04bae9f9988d566f29c63)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:52.597782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:52.832695 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a4b55457c04bae9f9988d566f29c63', 'request_id': 'req-8d2ebd78-5edf-4383-be4b-6a5c17997666'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:52.844126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a4b55457c04bae9f9988d566f29c63', 'request_id': 'req-8d2ebd78-5edf-4383-be4b-6a5c17997666'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:52.860462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a4b55457c04bae9f9988d566f29c63', 'request_id': 'req-8d2ebd78-5edf-4383-be4b-6a5c17997666'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:52.972515 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] The token cache is being invalidate because project 88a4b55457c04bae9f9988d566f29c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:33:52.979150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:52.980177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-8d2ebd78-5edf-4383-be4b-6a5c17997666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:33:52.989332 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4036/8077] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:33:52 2022] DELETE /identity/v3/projects/88a4b55457c04bae9f9988d566f29c63 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:33:52.991155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:52.991652 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:52.992030 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.021705 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:53.023363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:53.105139 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4042/8078] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:53.114431 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.114722 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.115187 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.136901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:53.140026 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:53.151991 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4037/8079] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:53.156987 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.168257 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626f70e-536a-45d2-9d75-1dbe858ade16 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.174354 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.176114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.176605 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.177283 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.178305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:33:53.178802 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.180700 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.212718 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4043/8080] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:33:53.219806 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.241583 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857bea-99c8-4cec-960d-9e0205a81cef None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.251381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.252150 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.252441 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.252719 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.253586 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.255619 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.409733 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4038/8081] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:33:53 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:53.413604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.425552 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789515-975c-437a-a665-9df61ca88d5e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.526988 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:53.530462 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.532936 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:53.575929 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.577400 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.577760 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.578164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.578899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.580957 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.633177 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5c0f7-3213-4045-8582-7906e77f1a72 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.637947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.638874 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.639209 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.640001 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.642198 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:53.657309 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.659425 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.677243 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4039/8082] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:33:53.711794 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4044/8083] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:33:53 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:33:53.711999 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.722980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:53.733172 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fae9-05b4-4c66-a32e-dc481e706e0f service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.746595 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.751134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.751134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.751134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.751134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.751134 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.773794 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4040/8084] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:33:53.775128 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.791770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2caa-19d6-4fa4-99d3-5df9b1fbd3d8 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.803514 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768076d2-e2f3-44c7-b291-ea5b68c7f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.804147 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768076d2-e2f3-44c7-b291-ea5b68c7f4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.804431 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768076d2-e2f3-44c7-b291-ea5b68c7f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.804704 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768076d2-e2f3-44c7-b291-ea5b68c7f4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.805363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768076d2-e2f3-44c7-b291-ea5b68c7f4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.807231 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768076d2-e2f3-44c7-b291-ea5b68c7f4e2 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.850219 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4045/8085] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:33:53.851415 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:53.862661 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde166cd-3c44-4489-bb5e-e6925951bf30 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:53.869163 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:53.869926 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:53.870215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:53.870496 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] PATH_INFO: `/v3/projects/c171837629b740fda0c7c5a6f8d3b977/users/d586b664f97a4360bcea1e36e1b4060a/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:53.894050 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c171837629b740fda0c7c5a6f8d3b977, user_id=d586b664f97a4360bcea1e36e1b4060a, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:53.896937 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:53.991965 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4041/8086] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:33:53 2022] PUT /identity/v3/projects/c171837629b740fda0c7c5a6f8d3b977/users/d586b664f97a4360bcea1e36e1b4060a/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:33:54.002630 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40baa8-3ac0-4feb-a548-baab781fb2e2 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:54.004095 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40baa8-3ac0-4feb-a548-baab781fb2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:54.004683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40baa8-3ac0-4feb-a548-baab781fb2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:54.123830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-5d40baa8-3ac0-4feb-a548-baab781fb2e2 None None] MFA Rules not processed for user `d586b664f97a4360bcea1e36e1b4060a`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:33:54.125481 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-5d40baa8-3ac0-4feb-a548-baab781fb2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:54.263411 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4046/8087] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:33:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:33:54.278511 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:54.280969 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:33:54.431229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09aaf-0f11-41aa-b22d-ccc951fd15f2 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:54.441042 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:54.441692 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:54.442005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:54.442283 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:54.464116 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:54.465687 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:54.506210 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4042/8088] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:00.204195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:00.204724 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:00.204830 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:00.256681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] MFA Rules not processed for user `90089aa2d5534cc8b1be4287f94b4d73`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:00.258203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:00.550202 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4047/8089] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:04.544410 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:06.575099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:06.577173 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:06.777427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f0f3-f2da-4837-bf38-7d1d9e9a99fd service cinder] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:06.783475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:06.784340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:06.784983 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:06.785419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] PATH_INFO: `/v3/users/6d30674cd087451fa6a05ce6e1e2cf15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:06.786812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d30674cd087451fa6a05ce6e1e2cf15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:06.788919 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:07.197998 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d30674cd087451fa6a05ce6e1e2cf15'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:07.199409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d30674cd087451fa6a05ce6e1e2cf15'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:07.296963 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d30674cd087451fa6a05ce6e1e2cf15'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:07.306632 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d30674cd087451fa6a05ce6e1e2cf15'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:07.308895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d30674cd087451fa6a05ce6e1e2cf15'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:07.393778 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4043/8090] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:06 2022] DELETE /identity/v3/users/6d30674cd087451fa6a05ce6e1e2cf15 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:07.432719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:07.439952 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:07.578300 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6c654-bca0-49fc-9bc1-2b572ba46d86 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:07.610791 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:07.652488 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:07.653604 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:07.654093 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:07.654574 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:07.657099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:07.673187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:07.675114 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:07.690951 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4048/8091] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:07.961845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:07.970852 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:08.196878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f912-3c8b-458a-8551-7b10b3b26982 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:08.206099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:08.206099 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:08.206419 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:08.206629 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] PATH_INFO: `/v3/projects/2a29ba5062cc46e29425649e960e808c` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:08.207858 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a29ba5062cc46e29425649e960e808c)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:08.228587 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:08.287308 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:08.478118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a29ba5062cc46e29425649e960e808c', 'request_id': 'req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:08.493210 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a29ba5062cc46e29425649e960e808c', 'request_id': 'req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:08.515647 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a29ba5062cc46e29425649e960e808c', 'request_id': 'req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:08.697997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] The token cache is being invalidate because project 2a29ba5062cc46e29425649e960e808c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:34:08.699645 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:08.700815 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:08.703469 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4044/8092] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:34:07 2022] DELETE /identity/v3/projects/2a29ba5062cc46e29425649e960e808c => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:08.708429 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:08.731894 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3c40-c29b-4c54-87f6-29a8bf0a1b90 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:08.887494 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:08.888351 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:08.889325 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:08.890434 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] PATH_INFO: `/v3/users/9b1ed8eda42345ae9dcdfa77c94090b5` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:08.893320 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1ed8eda42345ae9dcdfa77c94090b5)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:08.897084 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:09.200441 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1ed8eda42345ae9dcdfa77c94090b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:09.235681 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1ed8eda42345ae9dcdfa77c94090b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:09.253818 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1ed8eda42345ae9dcdfa77c94090b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:09.254711 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1ed8eda42345ae9dcdfa77c94090b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:09.255563 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1ed8eda42345ae9dcdfa77c94090b5'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:09.361735 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4049/8093] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:08 2022] DELETE /identity/v3/users/9b1ed8eda42345ae9dcdfa77c94090b5 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:09.686021 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:09.686576 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:09.706031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef84d-04ea-4c60-9b80-7f1c4bfae74f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:09.872901 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:09.878287 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:09.878594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:09.879063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] PATH_INFO: `/v3/users/42fd857679bd4259abbe78897a56bca1` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:09.880701 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42fd857679bd4259abbe78897a56bca1)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:09.885175 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:10.190268 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:10.192383 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:10.223394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c64bff-0f88-4d9c-885e-0fc4508d986e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:10.233426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:10.238912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:10.239317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:10.239602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] PATH_INFO: `/v3/projects/39d774b89d2d4495b652532fadcaeed9` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:10.242937 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d774b89d2d4495b652532fadcaeed9)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:10.246525 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:10.302540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42fd857679bd4259abbe78897a56bca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.303259 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42fd857679bd4259abbe78897a56bca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.452286 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42fd857679bd4259abbe78897a56bca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.470360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42fd857679bd4259abbe78897a56bca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.481310 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42fd857679bd4259abbe78897a56bca1'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.481471 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:10.512342 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d774b89d2d4495b652532fadcaeed9', 'request_id': 'req-4bae9ca4-7249-4a34-973c-f7273406272f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.530568 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d774b89d2d4495b652532fadcaeed9', 'request_id': 'req-4bae9ca4-7249-4a34-973c-f7273406272f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.542672 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4045/8094] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:09 2022] DELETE /identity/v3/users/42fd857679bd4259abbe78897a56bca1 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:10.546728 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d774b89d2d4495b652532fadcaeed9', 'request_id': 'req-4bae9ca4-7249-4a34-973c-f7273406272f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.702280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] The token cache is being invalidate because project 39d774b89d2d4495b652532fadcaeed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:34:10.702956 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.703837 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-4bae9ca4-7249-4a34-973c-f7273406272f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:10.705820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4050/8095] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:34:10 2022] DELETE /identity/v3/projects/39d774b89d2d4495b652532fadcaeed9 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:11.068593 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:11.070162 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:11.277370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:11.342381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe415eaf-aee2-4eec-a6f2-8384da811b70 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:11.357780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:11.358703 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:11.358787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:11.359041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] PATH_INFO: `/v3/projects/e55666f817734da483b0d9e84d672789` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:11.360768 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55666f817734da483b0d9e84d672789)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:11.364161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:11.553015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55666f817734da483b0d9e84d672789', 'request_id': 'req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:11.566753 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55666f817734da483b0d9e84d672789', 'request_id': 'req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:11.581068 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55666f817734da483b0d9e84d672789', 'request_id': 'req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:11.686540 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] The token cache is being invalidate because project e55666f817734da483b0d9e84d672789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:34:11.686807 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:11.687537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-2a7bf21f-0bd2-47a3-b889-210c9c857ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:11.689621 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4046/8096] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:34:11 2022] DELETE /identity/v3/projects/e55666f817734da483b0d9e84d672789 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:11.695204 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:11.696054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:11.696054 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:11.757767 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:11.764737 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:11.897771 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4051/8097] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:34:11.910798 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:11.911572 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:11.912033 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:11.962649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:11.964399 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:11.975965 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4047/8098] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:11.980732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:11.994590 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58654-6969-4f4a-a1c8-b0c309b5b0d4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.004288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.005186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.005575 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.005983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.007106 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:34:12.007702 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.009736 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.049957 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4052/8099] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:12.061933 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:12.074070 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171c196-1ffb-4916-81fb-8889495d8a68 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.082203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.083326 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.083827 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.084313 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.085183 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.089003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.219482 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:12.222284 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4048/8100] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:34:12 2022] POST /identity/v3/projects => generated 397 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:12.233875 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb815fc-bd9e-4faf-bcca-089a2f12894e admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.481366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.481366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.481366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.481366 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.482042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.482042 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.576793 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4053/8101] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:34:12 2022] POST /identity/v3/users => generated 299 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:12.578178 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:12.591608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b827-1e36-4b5f-a174-25987864c353 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.597370 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.598534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.599044 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.600041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.600737 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.603787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.633288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:12.635602 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:12.635803 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4049/8102] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:12.640558 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:12.653492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48780687-e72d-44ed-9485-da523babfd7c admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.654114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc98c2-d762-4035-b211-bccb6e501698 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.661702 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.662537 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.662921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.663103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.663744 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.665380 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.666898 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.667385 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.667674 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.667954 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] PATH_INFO: `/v3/users/d586b664f97a4360bcea1e36e1b4060a` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.669215 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d586b664f97a4360bcea1e36e1b4060a)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.672182 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.679874 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4050/8103] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:12.684882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:12.707504 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982d653-b101-4a5c-a4d9-917fee230bc5 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:12.721550 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276a0e9-219a-4562-a5c3-4b16ce21ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:12.722360 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a0e9-219a-4562-a5c3-4b16ce21ea35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.722709 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a0e9-219a-4562-a5c3-4b16ce21ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.723078 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a0e9-219a-4562-a5c3-4b16ce21ea35 admin admin] PATH_INFO: `/v3/projects/d33ea4d569e74d978e0eed1df9acdf70/users/c5023f056af24d27b3d77db9f62694e0/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.741959 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276a0e9-219a-4562-a5c3-4b16ce21ea35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33ea4d569e74d978e0eed1df9acdf70, user_id=c5023f056af24d27b3d77db9f62694e0, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:12.745882 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276a0e9-219a-4562-a5c3-4b16ce21ea35 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:12.837898 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4051/8104] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:34:12 2022] PUT /identity/v3/projects/d33ea4d569e74d978e0eed1df9acdf70/users/c5023f056af24d27b3d77db9f62694e0/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:12.847302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:12.847681 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:12.848028 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:12.873715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:12.875126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:12.898940 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:12.911886 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd586b664f97a4360bcea1e36e1b4060a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:12.947207 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd586b664f97a4360bcea1e36e1b4060a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:12.967226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd586b664f97a4360bcea1e36e1b4060a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:12.969395 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd586b664f97a4360bcea1e36e1b4060a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:12.970732 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-dd815dfc-8e69-44fa-841f-86fe900e15fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd586b664f97a4360bcea1e36e1b4060a'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:12.999034 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:13.025213 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4052/8105] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:13.036003 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:13.037649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:13.145103 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c735e98-9747-48a7-8aba-351b0f3dd1bf None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:13.149215 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:13.149879 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:13.150171 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:13.150478 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:13.162898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:13.164345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:13.171316 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4054/8106] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:12 2022] DELETE /identity/v3/users/d586b664f97a4360bcea1e36e1b4060a => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:34:13.177031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:13.177542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:13.178074 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:13.182736 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4053/8107] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:34:13.224092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:13.224092 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:13.294806 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4055/8108] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:13.310893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:13.310893 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:13.326891 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097281a6-2483-4509-a02d-253b57c890f1 service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:13.391063 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee34d2-8fe7-4f7f-8cf6-5846b918bf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:13.391727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee34d2-8fe7-4f7f-8cf6-5846b918bf5b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:13.391982 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee34d2-8fe7-4f7f-8cf6-5846b918bf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:13.392260 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee34d2-8fe7-4f7f-8cf6-5846b918bf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:13.409763 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee34d2-8fe7-4f7f-8cf6-5846b918bf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:13.415747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee34d2-8fe7-4f7f-8cf6-5846b918bf5b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:13.440092 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4054/8109] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:14.042673 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:14.046649 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:14.063155 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6701bb-3587-4c64-b651-b9bbbf6a2a44 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:14.067899 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:14.068668 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:14.068809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:14.069089 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] PATH_INFO: `/v3/projects/c171837629b740fda0c7c5a6f8d3b977` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:14.070261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c171837629b740fda0c7c5a6f8d3b977)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:14.072317 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:14.374159 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c171837629b740fda0c7c5a6f8d3b977', 'request_id': 'req-c58f73d6-e0d7-4695-9c00-d92e4209e60d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:14.390394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c171837629b740fda0c7c5a6f8d3b977', 'request_id': 'req-c58f73d6-e0d7-4695-9c00-d92e4209e60d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:14.402195 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c171837629b740fda0c7c5a6f8d3b977', 'request_id': 'req-c58f73d6-e0d7-4695-9c00-d92e4209e60d'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:14.507418 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] The token cache is being invalidate because project c171837629b740fda0c7c5a6f8d3b977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:34:14.512406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:14.512406 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-c58f73d6-e0d7-4695-9c00-d92e4209e60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:14.512406 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4056/8110] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:34:14 2022] DELETE /identity/v3/projects/c171837629b740fda0c7c5a6f8d3b977 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:14.516883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:14.519079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:14.519079 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:14.554320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:14.555875 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:14.634990 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4055/8111] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:14.644021 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:14.644302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:14.644643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:14.669184 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:14.670489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:14.678937 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4057/8112] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:34:14.683461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:14.694303 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f7d28-fed4-45e6-a1e6-7263d86476db None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:14.703100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:14.703100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:14.703100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:14.703100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:14.703697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:34:14.703697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:14.703697 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:14.726946 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4056/8113] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:14.732227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:14.751357 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df97cd-f523-4a25-8831-58aa43dd286d None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:14.765426 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:14.766149 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:14.766608 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:14.766892 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:14.767543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:14.769480 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:14.879443 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4058/8114] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:34:14 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:34:14.887856 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:14.902153 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb39ef-59a5-4dca-8834-ebfb922a41ac admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:14.919561 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:14.974678 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:14.975340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:14.975625 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:14.975902 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] PATH_INFO: `/v3/users` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:14.976546 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:14.978694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:15.093000 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4057/8115] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:34:14 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:15.097528 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:15.109363 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547587a-7a05-47c1-8983-2d7d47083a50 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:15.114996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:15.116615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:15.116615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:15.116615 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:15.121933 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:15.124658 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:15.127477 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:15.137544 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4059/8116] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:15.145292 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:15.158114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a918ac-4a1e-4dc7-8b37-15e4b004717c admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:15.171646 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f057a9-a90a-4bab-870b-92945991bfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:15.172405 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f057a9-a90a-4bab-870b-92945991bfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:15.173615 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f057a9-a90a-4bab-870b-92945991bfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:15.174000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f057a9-a90a-4bab-870b-92945991bfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:15.174767 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f057a9-a90a-4bab-870b-92945991bfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:15.176539 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f057a9-a90a-4bab-870b-92945991bfe3 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:15.189666 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4058/8117] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:34:15.194398 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:15.210811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975d90-f789-471a-a14e-bf9f4757e77a admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:15.216102 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:15.216846 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:15.217127 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:15.217404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] PATH_INFO: `/v3/projects/fcbd5576d9424cbaae373124ccead831/users/c49368c5c47949d4bdef01ad33fdeb1f/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:15.237004 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbd5576d9424cbaae373124ccead831, user_id=c49368c5c47949d4bdef01ad33fdeb1f, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:15.240489 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:15.413831 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4060/8118] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:34:15 2022] PUT /identity/v3/projects/fcbd5576d9424cbaae373124ccead831/users/c49368c5c47949d4bdef01ad33fdeb1f/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:15.426664 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b077bce-47ee-41d5-85c7-b6b38143448a None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:15.426948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b077bce-47ee-41d5-85c7-b6b38143448a None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:15.427231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b077bce-47ee-41d5-85c7-b6b38143448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:15.469015 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-9b077bce-47ee-41d5-85c7-b6b38143448a None None] MFA Rules not processed for user `c49368c5c47949d4bdef01ad33fdeb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:15.470108 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-9b077bce-47ee-41d5-85c7-b6b38143448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:15.580348 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4059/8119] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:15.588041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:15.591697 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:15.686619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3d295-e9a6-4cd3-b137-4f8cc940ee46 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:15.690435 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff67ca-fc34-4b9e-bd1e-bd1a0f2f3a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:15.691133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff67ca-fc34-4b9e-bd1e-bd1a0f2f3a0a service cinder] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:15.691420 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff67ca-fc34-4b9e-bd1e-bd1a0f2f3a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:15.691646 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff67ca-fc34-4b9e-bd1e-bd1a0f2f3a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:15.702519 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff67ca-fc34-4b9e-bd1e-bd1a0f2f3a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:15.703958 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff67ca-fc34-4b9e-bd1e-bd1a0f2f3a0a service cinder] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:15.715822 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4061/8120] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:22.137774 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:22.139694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:22.140306 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:22.199393 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:22.203772 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:22.322721 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4060/8121] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:22.333136 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:22.334085 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:22.334521 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:22.367670 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:22.368953 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:22.377380 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4062/8122] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:22.392549 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:22.392854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:22.424461 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:22.535161 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f53b8-f975-4253-a0ee-ec94017fc898 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:22.544845 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef5089-9ea6-4177-88e2-7f582a94a9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:22.545510 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef5089-9ea6-4177-88e2-7f582a94a9de service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:22.546887 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef5089-9ea6-4177-88e2-7f582a94a9de service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:22.547823 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef5089-9ea6-4177-88e2-7f582a94a9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:22.563302 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef5089-9ea6-4177-88e2-7f582a94a9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:22.566947 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef5089-9ea6-4177-88e2-7f582a94a9de service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:22.579018 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4061/8123] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:25.672045 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:25.830689 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb6582-a8c9-47fe-a8d3-bd459c3e5b00 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:25.835772 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:25.836492 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:25.836843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:25.837186 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] PATH_INFO: `/v3/users/c49368c5c47949d4bdef01ad33fdeb1f` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:25.838726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49368c5c47949d4bdef01ad33fdeb1f)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:25.840876 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:26.172235 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49368c5c47949d4bdef01ad33fdeb1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:26.193661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49368c5c47949d4bdef01ad33fdeb1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:26.209392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:26.214174 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49368c5c47949d4bdef01ad33fdeb1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:26.215302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49368c5c47949d4bdef01ad33fdeb1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:26.216188 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49368c5c47949d4bdef01ad33fdeb1f'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:26.343364 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4063/8124] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:25 2022] DELETE /identity/v3/users/c49368c5c47949d4bdef01ad33fdeb1f => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:26.349602 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:26.350783 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:26.350943 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:26.379730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:26.380997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:26.508544 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4062/8125] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:26.512194 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:26.514405 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:26.622628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b991-441b-4538-95f1-0a05c6319cbc admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:26.627667 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775408c-7121-4e44-8005-34b09a56fec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:26.628422 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775408c-7121-4e44-8005-34b09a56fec3 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:26.628784 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775408c-7121-4e44-8005-34b09a56fec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:26.629122 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775408c-7121-4e44-8005-34b09a56fec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:26.648996 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775408c-7121-4e44-8005-34b09a56fec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:26.651619 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775408c-7121-4e44-8005-34b09a56fec3 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:26.687619 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4064/8126] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:27.449009 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:27.451525 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:27.469954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d73054-cbc0-414c-8912-1d557c77eb53 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:27.479149 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:27.479826 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:27.480225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:27.480649 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] PATH_INFO: `/v3/projects/fcbd5576d9424cbaae373124ccead831` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:27.485276 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbd5576d9424cbaae373124ccead831)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:27.502381 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:27.702866 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbd5576d9424cbaae373124ccead831', 'request_id': 'req-5def2720-c534-4820-af90-e59a24e70ee6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:27.710479 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbd5576d9424cbaae373124ccead831', 'request_id': 'req-5def2720-c534-4820-af90-e59a24e70ee6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:27.719243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbd5576d9424cbaae373124ccead831', 'request_id': 'req-5def2720-c534-4820-af90-e59a24e70ee6'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:27.820077 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] The token cache is being invalidate because project fcbd5576d9424cbaae373124ccead831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:34:27.820435 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:27.821191 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-5def2720-c534-4820-af90-e59a24e70ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:27.823120 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4063/8127] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:34:27 2022] DELETE /identity/v3/projects/fcbd5576d9424cbaae373124ccead831 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:27.828558 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:27.829133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:27.829133 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:27.851721 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:27.853245 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:27.950039 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4065/8128] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:27.950553 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:27.950851 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:27.951039 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:27.973745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:27.974966 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:27.985891 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4064/8129] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:27.988921 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:28.000941 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8acd-c66c-4d37-a07e-59fc1818bf81 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:28.006230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:28.006878 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:28.007171 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:28.007538 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:28.010088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:34:28.010088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:28.010088 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:28.052550 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4066/8130] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:28.058121 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:28.078000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8dd8d-82c6-4335-9301-8927431c1ab9 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:28.087211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:28.087925 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:28.088164 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:28.088446 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:28.089203 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:28.092114 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:28.135730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:28.292313 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4065/8131] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:34:28 2022] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:28.297288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:28.317719 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038ecb0-e05f-4a86-b520-1a81b5cda117 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:28.463979 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:28.464868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:28.465305 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:28.465729 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:28.467151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:28.470037 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:28.802778 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4067/8132] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:34:28 2022] POST /identity/v3/users => generated 282 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:28.806295 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:28.818685 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4379c7-9f3c-4f10-85a0-ffef705ecdb6 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:28.827921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:28.828534 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:28.829097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:28.829097 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:28.829730 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:28.831437 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:28.849925 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4066/8133] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:28.851392 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:28.878125 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb47b2-9bdc-456f-a9c1-39fe83119da1 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:28.901455 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2be218-ad00-41b7-8b7c-cbc2dc30a0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:28.902341 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2be218-ad00-41b7-8b7c-cbc2dc30a0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:28.902839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2be218-ad00-41b7-8b7c-cbc2dc30a0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:28.903262 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2be218-ad00-41b7-8b7c-cbc2dc30a0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:28.904581 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2be218-ad00-41b7-8b7c-cbc2dc30a0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:28.906498 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2be218-ad00-41b7-8b7c-cbc2dc30a0c9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:28.909202 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:28.929596 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4068/8134] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:28.934211 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:28.954270 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1226cd-21f8-441f-9622-83e0aab55eba admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:28.961792 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:28.962666 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:28.963030 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:28.963409 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] PATH_INFO: `/v3/projects/f276e8f3b0c54af38517ca4ec37f8de5/users/81cdf02bf65148e0a38718fe3204fa91/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:28.986952 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f276e8f3b0c54af38517ca4ec37f8de5, user_id=81cdf02bf65148e0a38718fe3204fa91, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:28.990005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:29.117081 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4067/8135] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:34:28 2022] PUT /identity/v3/projects/f276e8f3b0c54af38517ca4ec37f8de5/users/81cdf02bf65148e0a38718fe3204fa91/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:29.126157 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f793-aa79-4469-99ce-c40373384837 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:29.126461 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f793-aa79-4469-99ce-c40373384837 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:29.126744 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f793-aa79-4469-99ce-c40373384837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:29.164600 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9eb2f793-aa79-4469-99ce-c40373384837 None None] MFA Rules not processed for user `81cdf02bf65148e0a38718fe3204fa91`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:29.165843 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9eb2f793-aa79-4469-99ce-c40373384837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:29.249765 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4069/8136] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:29.262683 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:29.270812 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:29.370747 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabb839-2b50-4ca3-b170-e22dccdc7c32 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:29.376024 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff4d0-4ff4-4c3c-9d3f-dc66b96d1411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cb76d30b8a4dc7961464c640315123', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:29.377716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff4d0-4ff4-4c3c-9d3f-dc66b96d1411 service cinder] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:29.377716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff4d0-4ff4-4c3c-9d3f-dc66b96d1411 service cinder] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:29.377716 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff4d0-4ff4-4c3c-9d3f-dc66b96d1411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:29.391000 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff4d0-4ff4-4c3c-9d3f-dc66b96d1411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:29.395762 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff4d0-4ff4-4c3c-9d3f-dc66b96d1411 service cinder] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:29.415326 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4068/8137] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:37.363286 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447ef2f-64e3-4b5e-b97a-1f7682489f41 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:37.363861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447ef2f-64e3-4b5e-b97a-1f7682489f41 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:37.363861 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447ef2f-64e3-4b5e-b97a-1f7682489f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:37.395749 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-7447ef2f-64e3-4b5e-b97a-1f7682489f41 None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:37.397331 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-7447ef2f-64e3-4b5e-b97a-1f7682489f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:37.480896 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4070/8138] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:37.550878 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d874e9-9a5f-40b3-94d2-afc9cdf2d5fd None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:37.551529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d874e9-9a5f-40b3-94d2-afc9cdf2d5fd None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:37.551529 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d874e9-9a5f-40b3-94d2-afc9cdf2d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:37.571074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-a8d874e9-9a5f-40b3-94d2-afc9cdf2d5fd None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:37.572620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-a8d874e9-9a5f-40b3-94d2-afc9cdf2d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:37.587396 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4069/8139] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:37.618643 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69449-45fb-43d1-99ab-d2d9de239054 None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:37.619413 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69449-45fb-43d1-99ab-d2d9de239054 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:37.620031 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69449-45fb-43d1-99ab-d2d9de239054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:37.651346 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-3da69449-45fb-43d1-99ab-d2d9de239054 None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:37.652280 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-3da69449-45fb-43d1-99ab-d2d9de239054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:37.670820 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4071/8140] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:37.719516 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:37.719973 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:37.720413 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:37.747345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:37.748880 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:37.757166 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4070/8141] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:37.795024 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:37.795314 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:37.795762 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:37.819065 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] MFA Rules not processed for user `c5023f056af24d27b3d77db9f62694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:37.829976 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:37.829976 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4072/8142] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:44.570700 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:44.574715 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:44.811243 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521349-af0a-4ad6-a773-13814f4e0f85 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:44.822985 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:44.824072 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:44.824573 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:44.825684 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:44.831345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:44.895930 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:44.912007 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:44.914556 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:44.944115 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4071/8143] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:47.814187 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=64 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:49.383609 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:49.385793 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:49.642780 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700077da-27fa-4c5e-ad9c-2e8390a685ad None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:49.649244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:49.650115 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:49.650450 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:49.651394 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] PATH_INFO: `/v3/users/c5023f056af24d27b3d77db9f62694e0` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:49.652751 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5023f056af24d27b3d77db9f62694e0)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:49.654904 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:49.940302 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5023f056af24d27b3d77db9f62694e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:49.972884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5023f056af24d27b3d77db9f62694e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:49.972884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5023f056af24d27b3d77db9f62694e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:49.972884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5023f056af24d27b3d77db9f62694e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:49.972884 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-014567f8-b349-4b9b-a365-75d57c2bf689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5023f056af24d27b3d77db9f62694e0'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:50.162676 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4073/8144] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:49 2022] DELETE /identity/v3/users/c5023f056af24d27b3d77db9f62694e0 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:50.594083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:50.608674 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0d63-f0d6-42f6-9341-c50f5ff6deca service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:50.726620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:50.728206 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:50.728693 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:50.729139 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] PATH_INFO: `/v3/projects/d33ea4d569e74d978e0eed1df9acdf70` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:50.730773 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33ea4d569e74d978e0eed1df9acdf70)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:50.732954 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:50.895907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33ea4d569e74d978e0eed1df9acdf70', 'request_id': 'req-6dbdb0df-eb38-4ec8-94a6-344252f7d723'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:50.903843 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33ea4d569e74d978e0eed1df9acdf70', 'request_id': 'req-6dbdb0df-eb38-4ec8-94a6-344252f7d723'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:50.912620 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33ea4d569e74d978e0eed1df9acdf70', 'request_id': 'req-6dbdb0df-eb38-4ec8-94a6-344252f7d723'} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:51.046319 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] The token cache is being invalidate because project d33ea4d569e74d978e0eed1df9acdf70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:34:51.047196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:51.047196 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.notifications [None req-6dbdb0df-eb38-4ec8-94a6-344252f7d723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:51.049051 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4072/8145] 10.222.0.78 () {58 vars in 1233 bytes} [Sun Aug 28 20:34:50 2022] DELETE /identity/v3/projects/d33ea4d569e74d978e0eed1df9acdf70 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:34:51.055243 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.055783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.055783 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.086932 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:51.088712 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:51.161152 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4074/8146] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:51.169830 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.170169 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.171229 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.201336 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:51.202727 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:51.211262 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4073/8147] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:51.216041 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:51.230236 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b53fe-71e9-4b5b-a387-e4ed6e66ebdb None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:51.236591 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:51.237179 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.237466 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.237742 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.238458 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:34:51.238770 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:51.240663 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:51.254815 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4075/8148] 10.222.0.78 () {58 vars in 1153 bytes} [Sun Aug 28 20:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:51.259757 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:51.271694 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c452c-8e72-44e8-8d0b-982e4d432adc None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:51.282058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:51.282058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.282058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.282058 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.282608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:51.282608 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:51.589580 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4074/8149] 10.222.0.78 () {60 vars in 1153 bytes} [Sun Aug 28 20:34:51 2022] POST /identity/v3/projects => generated 365 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:51.590874 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:51.603627 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce69d4e-8286-4a0c-9928-81e958e74cb7 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:51.610033 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:51.687771 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:51.688423 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.688612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.689035 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] PATH_INFO: `/v3/users` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.689543 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:51.691522 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:51.794305 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4076/8150] 10.222.0.78 () {60 vars in 1144 bytes} [Sun Aug 28 20:34:51 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:34:51.795940 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:51.808305 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0290de-884f-40ea-8e3d-df6336cf0da0 admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:51.814126 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:51.815002 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.815589 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.815877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] PATH_INFO: `/v3/roles` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.816789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:51.818871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:51.836638 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:51.845395 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4075/8151] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:51.848099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12f097-22fe-4d31-9cb9-2ca90022b287 admin admin] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:51.852868 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef799a1-9dad-419e-a201-9c99da3eddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:51.853542 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef799a1-9dad-419e-a201-9c99da3eddac admin admin] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.853947 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef799a1-9dad-419e-a201-9c99da3eddac admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.854278 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef799a1-9dad-419e-a201-9c99da3eddac admin admin] PATH_INFO: `/v3/roles` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.854988 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef799a1-9dad-419e-a201-9c99da3eddac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:51.856680 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef799a1-9dad-419e-a201-9c99da3eddac admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:51.867870 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4077/8152] 10.222.0.78 () {58 vars in 1122 bytes} [Sun Aug 28 20:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:34:51.872146 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:51.882854 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdd95f-5214-4f3a-bcad-3ed5ae23822f admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:51.888472 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:51.892345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] REQUEST_METHOD: `PUT` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:51.892345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:51.892345 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] PATH_INFO: `/v3/projects/feed5e2804334ba79dd530a1f18e6b15/users/d9da6c3ee920429381896e47cdb9f50b/roles/34f645bea60445e09a81ac9342eb51e8` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:51.906921 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=feed5e2804334ba79dd530a1f18e6b15, user_id=d9da6c3ee920429381896e47cdb9f50b, role_id=34f645bea60445e09a81ac9342eb51e8)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:51.909594 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.039543 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4076/8153] 10.222.0.78 () {60 vars in 1483 bytes} [Sun Aug 28 20:34:51 2022] PUT /identity/v3/projects/feed5e2804334ba79dd530a1f18e6b15/users/d9da6c3ee920429381896e47cdb9f50b/roles/34f645bea60445e09a81ac9342eb51e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:52.050287 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0041a7-517a-40cf-a1c1-be73dd9add8d None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.050683 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0041a7-517a-40cf-a1c1-be73dd9add8d None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.051034 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0041a7-517a-40cf-a1c1-be73dd9add8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.087994 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9d0041a7-517a-40cf-a1c1-be73dd9add8d None None] MFA Rules not processed for user `d9da6c3ee920429381896e47cdb9f50b`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:52.089223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d0041a7-517a-40cf-a1c1-be73dd9add8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:52.178975 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4078/8154] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:34:52.192997 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:52.200085 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:52.219780 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:52.301942 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4f09-b01f-43be-b7a1-27296d52e85a admin admin] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:52.308622 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:52.309895 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.310475 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.310759 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.321614 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:52.323263 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.336918 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4077/8155] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:52.353173 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecd170-a251-4cb4-be07-3fe670ae12e6 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.354142 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecd170-a251-4cb4-be07-3fe670ae12e6 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.354629 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecd170-a251-4cb4-be07-3fe670ae12e6 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.356744 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4079/8156] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:34:52.366883 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:34:52.388299 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:52.411927 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdef1c-48d2-4851-a59e-a4f5834a3e0d service nova] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:52.421128 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9da6c3ee920429381896e47cdb9f50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feed5e2804334ba79dd530a1f18e6b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:52.422005 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.422970 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.423364 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] PATH_INFO: `/v3/projects/feed5e2804334ba79dd530a1f18e6b15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.424813 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorizing `identity:get_project(project_id=feed5e2804334ba79dd530a1f18e6b15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:52.431861 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.431861 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4078/8157] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:34:52 2022] GET /identity/v3/projects/feed5e2804334ba79dd530a1f18e6b15 => generated 365 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 20:34:52.479227 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329d21-3608-4400-bb96-cb69ecba56e1 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.479530 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329d21-3608-4400-bb96-cb69ecba56e1 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.479811 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329d21-3608-4400-bb96-cb69ecba56e1 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.483060 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4080/8158] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:34:52.488528 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:34:52.491948 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:52.534225 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:52.562083 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac700b9-729d-4593-ae86-5cac756ef144 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:52.567041 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9da6c3ee920429381896e47cdb9f50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feed5e2804334ba79dd530a1f18e6b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:52.567938 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.568740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.569046 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] PATH_INFO: `/v3/projects/feed5e2804334ba79dd530a1f18e6b15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.570378 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorizing `identity:get_project(project_id=feed5e2804334ba79dd530a1f18e6b15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:52.573231 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.576359 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4079/8159] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:34:52 2022] GET /identity/v3/projects/feed5e2804334ba79dd530a1f18e6b15 => generated 365 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:52.635288 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55000f-36bb-4163-89ff-2c2c75920dc3 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.638197 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55000f-36bb-4163-89ff-2c2c75920dc3 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.639111 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55000f-36bb-4163-89ff-2c2c75920dc3 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.641988 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4081/8160] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:34:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:34:52.647585 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:34:52.667846 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:52.680494 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12526c79-5d09-4582-83e8-ec468b026f23 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:52.689789 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9da6c3ee920429381896e47cdb9f50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feed5e2804334ba79dd530a1f18e6b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:52.690477 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.690849 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.691427 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] PATH_INFO: `/v3/projects/feed5e2804334ba79dd530a1f18e6b15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.693214 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorizing `identity:get_project(project_id=feed5e2804334ba79dd530a1f18e6b15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:52.695383 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.697929 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4080/8161] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:34:52 2022] GET /identity/v3/projects/feed5e2804334ba79dd530a1f18e6b15 => generated 365 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:52.731628 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397940c8-1ea4-4bce-8002-fe0dc9e14e3e None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.731912 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397940c8-1ea4-4bce-8002-fe0dc9e14e3e None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.732226 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397940c8-1ea4-4bce-8002-fe0dc9e14e3e None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.733684 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4082/8162] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:34:52.739460 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:34:52.762835 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:52.775740 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fee62-3b6b-402b-9d40-e74c78158a68 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:52.785725 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9da6c3ee920429381896e47cdb9f50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feed5e2804334ba79dd530a1f18e6b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:52.786452 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.786745 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.787031 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] PATH_INFO: `/v3/projects/feed5e2804334ba79dd530a1f18e6b15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.789463 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorizing `identity:get_project(project_id=feed5e2804334ba79dd530a1f18e6b15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:52.791382 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.804760 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4081/8163] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:34:52 2022] GET /identity/v3/projects/feed5e2804334ba79dd530a1f18e6b15 => generated 365 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:52.836969 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab240220-f029-4f04-84ea-8169488fd8b4 None None] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.838203 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab240220-f029-4f04-84ea-8169488fd8b4 None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.838707 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab240220-f029-4f04-84ea-8169488fd8b4 None None] PATH_INFO: `/` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.841435 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4083/8164] 10.222.0.78 () {54 vars in 912 bytes} [Sun Aug 28 20:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 20:34:52.847670 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating service token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 20:34:52.873074 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:52.883609 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81dea-96e3-43de-b6d6-5a8a1d4c0319 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:52.889118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9da6c3ee920429381896e47cdb9f50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feed5e2804334ba79dd530a1f18e6b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:52.889770 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:52.890235 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:52.891871 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] PATH_INFO: `/v3/projects/feed5e2804334ba79dd530a1f18e6b15` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:52.893288 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorizing `identity:get_project(project_id=feed5e2804334ba79dd530a1f18e6b15)` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:52.895318 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:52.897054 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4082/8165] 10.222.0.78 () {58 vars in 1443 bytes} [Sun Aug 28 20:34:52 2022] GET /identity/v3/projects/feed5e2804334ba79dd530a1f18e6b15 => generated 365 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:34:52.935928 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab240220-f029-4f04-84ea-8169488fd8b4 None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:53.027360 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab240220-f029-4f04-84ea-8169488fd8b4 None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:53.034178 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70e7022229a4fab8fd47caffd01ba01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '926e861f54084884ae9dc19520ca2e6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:53.034989 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:53.035377 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:53.035756 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] PATH_INFO: `/v3/users/d9da6c3ee920429381896e47cdb9f50b` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:53.037167 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9da6c3ee920429381896e47cdb9f50b)` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:53.039334 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:53.061049 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:53.301376 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9da6c3ee920429381896e47cdb9f50b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:53.316261 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9da6c3ee920429381896e47cdb9f50b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:53.329356 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9da6c3ee920429381896e47cdb9f50b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:53.330446 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9da6c3ee920429381896e47cdb9f50b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:53.331153 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.notifications [None req-7c98541d-7b37-40ed-a4eb-d265f0d98af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9da6c3ee920429381896e47cdb9f50b'} {{(pid=82299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:34:53.410301 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:53.412320 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:53.469983 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4084/8166] 10.222.0.78 () {58 vars in 1224 bytes} [Sun Aug 28 20:34:52 2022] DELETE /identity/v3/users/d9da6c3ee920429381896e47cdb9f50b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:34:53.475411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] REQUEST_METHOD: `POST` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:53.475411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:53.475411 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:53.484124 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24d25-7213-472e-8a9d-a8ba79c45103 tempest-QuotasTestJSON-1393542285 tempest-QuotasTestJSON-1393542285-project] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:53.494796 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.auth.core [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] MFA Rules not processed for user `f70e7022229a4fab8fd47caffd01ba01`. Rule list: `[]` (Enabled: `True`). {{(pid=82299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:34:53.496061 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:53.544055 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:53.544618 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:53.544909 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:53.545181 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:53.546986 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:53.571250 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4085/8167] 10.222.0.78 () {58 vars in 958 bytes} [Sun Aug 28 20:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:34:53.577432 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=100 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:53.582752 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:53.584164 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:53.608870 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5667a8-60a1-4b37-994b-a2a77e9be7fe None None] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:53.615189 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:53.616140 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:53.616612 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:53.617169 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:53.633391 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:53.648223 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:53.666764 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:53.668264 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:53.671219 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4086/8168] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:34:53.685680 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4083/8169] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:56.364099 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:56.365592 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:56.462026 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb3fd-9069-4724-b98e-b2f0c9c2e6c5 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:56.469036 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cf360f24634e1aa0edb2900994d9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:56.469661 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:56.469980 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:56.470258 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:56.472764 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:34:56.491151 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:56.492803 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:56.512904 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4087/8170] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:35:03.681907 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=18 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:35:06.503773 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:35:48.881414 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:35:48.882945 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:35:48.959094 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c768585-532f-4224-b1fc-ed61734a203b service neutron] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:35:48.964877 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:35:48.965392 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:35:48.965705 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:35:48.966100 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:35:48.968064 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:35:48.982894 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:35:48.984500 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623785a-4b55-4734-952a-d5f76e723e61 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:35:48.997121 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4084/8171] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:35:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:35:58.990340 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=32 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:36:10.586993 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:36:10.602726 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6581-a39c-4487-b32a-cf27c106a705 service nova] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:36:10.607919 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:36:10.608483 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:36:10.608825 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:36:10.609105 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:36:10.613120 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:36:10.629502 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:36:10.631161 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:36:10.646213 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4088/8172] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:36:20.638809 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:40:08.274155 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] REQUEST_METHOD: `POST` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:40:08.274752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:40:08.274752 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:40:08.357517 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.auth.core [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] MFA Rules not processed for user `a4db71575637416dacaae1294f043167`. Rule list: `[]` (Enabled: `True`). {{(pid=82298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:40:08.358787 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:40:08.401098 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4085/8173] 10.222.0.78 () {58 vars in 1062 bytes} [Sun Aug 28 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:40:08.410449 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:40:08.431841 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654dde8-5a7f-44c3-a8d1-766ff497c08a service placement] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:40:08.435597 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4db71575637416dacaae1294f043167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:40:08.436230 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:40:08.436512 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:40:08.436789 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:40:08.438583 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.fernet_utils [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:40:08.451983 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:40:08.453436 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:40:08.464191 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4089/8174] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:40:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:40:18.397873 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=39 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:40:18.458032 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=11 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:40:53.888426 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] Authenticating user token {{(pid=82298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:40:53.889898 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.fernet_utils [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:40:53.953278 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4415bc-2523-4dcb-8b1a-9f0903133a29 None None] Validating token access rules against request {{(pid=82298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:40:53.958514 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05715124-a0d9-4871-8365-7d896abdf758 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:40:53.959118 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05715124-a0d9-4871-8365-7d896abdf758 service placement] REQUEST_METHOD: `GET` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:40:53.959397 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05715124-a0d9-4871-8365-7d896abdf758 service placement] SCRIPT_NAME: `/identity` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:40:53.959668 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05715124-a0d9-4871-8365-7d896abdf758 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:40:53.972185 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05715124-a0d9-4871-8365-7d896abdf758 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:40:53.973782 n-d-854121-7 devstack@keystone.service[82298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05715124-a0d9-4871-8365-7d896abdf758 service placement] RBAC: Authorization granted {{(pid=82298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:40:53.988245 n-d-854121-7 devstack@keystone.service[82298]: [pid: 82298|app: 0|req: 4086/8175] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:40:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:41:03.980304 n-d-854121-7 devstack@keystone.service[82298]: DEBUG dbcounter [-] [82298] Writing DB stats keystone:SELECT=24 {{(pid=82298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:41:15.585321 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] Authenticating user token {{(pid=82299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:41:15.600725 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b09a58-229d-4469-bcae-c431a8f20054 service neutron] Validating token access rules against request {{(pid=82299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:41:15.605839 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a40dac-015a-4803-b69e-47ae4fa12b7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c56d2d2a803e41b894ab6417646db98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e688fcd3bf3b411b8d462d92e13c068e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:41:15.606409 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a40dac-015a-4803-b69e-47ae4fa12b7a service placement] REQUEST_METHOD: `GET` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:41:15.606692 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a40dac-015a-4803-b69e-47ae4fa12b7a service placement] SCRIPT_NAME: `/identity` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:41:15.606968 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a40dac-015a-4803-b69e-47ae4fa12b7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:41:15.619404 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a40dac-015a-4803-b69e-47ae4fa12b7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:41:15.621002 n-d-854121-7 devstack@keystone.service[82299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a40dac-015a-4803-b69e-47ae4fa12b7a service placement] RBAC: Authorization granted {{(pid=82299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:41:15.633858 n-d-854121-7 devstack@keystone.service[82299]: [pid: 82299|app: 0|req: 4090/8176] 10.222.0.78 () {60 vars in 1365 bytes} [Sun Aug 28 20:41:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:41:25.627244 n-d-854121-7 devstack@keystone.service[82299]: DEBUG dbcounter [-] [82299] Writing DB stats keystone:SELECT=6 {{(pid=82299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}